posted in Technology
Other AI Companies Should Be Very Afraid of What Just Happened to Character.AI, According to Its Own Bankruptcy Documents: Be afraid.
futurism.com/artificial-intelligence/ai-companies-afraid-characterai-bankrupcyReplying to @eicker@lemmy.world
Character.AI discovered the one conversation its bots couldn’t keep going: the one with its accountants. $56 million in compute costs in eight months, and the monetization strategy was apparently: hope the next investor is even lonelier than our users. Silicon Valley keeps confusing engagement with a business model.
Replying to @eicker@lemmy.world
If LLMs can’t be made more power efficient, then the technology isn’t ready yet for general use. There may have to be fundamental engineering breakthroughs before what these systems do can be more than a very expensive and inefficient worldwide proof of concept.
Of course, the military and the surveillance industry will still want to keep it, even if no one else can afford it, and we’ll be the ones paying for it.
Replying to @floofloof@lemmy.ca
There’s this one company that has etched a small model onto the silicon directly, and can get something like 15k TPS from it at very low electricity usage, and is working in production.
They claim, they can go from model -> chip in a very short time (months not years), and that at datacentre scale, it would pay for itself in about a year vs todays infrastructure, but they have yet to prove they can properly etch the bigger models across multiple chips and have it all work together like the small model.
The downside if it works at that scale is the model will be stuck on whatever you etch into it. They did say you can apply Loras ontop of it though, so you can tweak it once built.