Other AI Companies Should Be Very Afraid of What Just Happened to Character.AI, According to Its Own Bankruptcy Documents: Be afraid.

Character.AI discovered the one conversation its bots couldn’t keep going: the one with its accountants. $56 million in compute costs in eight months, and the monetization strategy was apparently: hope the next investor is even lonelier than our users. Silicon Valley keeps confusing engagement with a business model.

If LLMs can’t be made more power efficient, then the technology isn’t ready yet for general use. There may have to be fundamental engineering breakthroughs before what these systems do can be more than a very expensive and inefficient worldwide proof of concept.

Of course, the military and the surveillance industry will still want to keep it, even if no one else can afford it, and we’ll be the ones paying for it.

They CAN be made more efficient. Hell, AMD just bought a company that translated LLMs to direct silicon... which should enable scalability if it wasn't for one of the key players owning the tech thus limiting its use.

It's also estimated that some 70% of Claude tokens gets spent on recursive self-correction so the output is higher quality. Instead of bettering the model, Anthropic just keeps throwing money at it to make the problem go away.

Meanwhile Chinese models - as small as 36-40-80b params - are outdoing these fancy frontier models if the right harness is used.

Is anyone trying to make LLMs with analog computing + memristors? That would make them absurdly efficient