Looking over Block’s voice model Dessa, this aside in the announcement post made me laugh:

LLMs need an insane amount of text. Dessa learned language from hundreds of times fewer words (in fairness, LLMs also have to learn C++ and whatever the hell Angular is).