Discussion about this post

User's avatar
Manar's avatar

Oooo. I was chatting last month with a friend about how the brain is like multiple specialised AI systems working together so maybe agi or consciousness needs that. He mentioned he'd been wishing he had the gear to play with constructing a large "model" from multiple distilled focussed llms as he suspect it would be a big win. Pretty sure that's the first of k2's two tricks you're describing.

Lots of followup then possible (cue matrix reference, snapping in a helicopter pilot specialist); it's not just an efficiency trick. Odd there's not much of this visible tinkering in the US (he's in LA but gearless so musing with only minor experiments... Also he's a hermit, albeit one who designed tech that made it to mars)

Expand full comment

No posts