posted in Technology
Nobody Will Say Why Every Major AI Chatbot Suddenly Went Down Yesterday
futurism.com/artificial-intelligence/nobody-saying-why-major-chatbot-outageposted in Technology
Nobody Will Say Why Every Major AI Chatbot Suddenly Went Down Yesterday
futurism.com/artificial-intelligence/nobody-saying-why-major-chatbot-outageReplying to @GolfFoxtrotLima@sh.itjust.works
Because they all use the illegal Colossus 2 data centre from SpaceX/XAi/fascism central and that data centre went down.
Google, Anthropic, and OpenAI all have contracts with them.
When that illegally running environmental disaster of data centre goes down, all those services all go over capacity and you get 502 rate limit errors.
Replying to @panda_abyss@lemmy.ca
It’s kinda surprising,
I know specifically where one of the big ones hosts its models and its not there, but I guess they could have infrastructure in there.
Replying to @BarbecueCowboy@lemmy.dbzer0.com
They’re oversold though, especially prompt caching and the parameter count war
The US model is that they think more training compute and parameters will result in the winning model, while the Chinese are focusing on RL and parameters efficiency due to compute limits.
Replying to @panda_abyss@lemmy.ca
The efficiency of Chinese models really is impressive. I generated sooo much code yesterday with Qwen3.6 35B-A3B running on an RTX 5060 Ti 16GB (+ a little CPU offloading). It got the jobs done at ~50 tokens/sec.
(It’s not super complex code, just some scripts that I would not have taken to time to write manually.)
I’d love to upgrade to something with more VRAM, but even my current card has doubled in price since I bought it last year 😬
Replying to @percent@infosec.pub
Show me your set up!
Replying to @isVeryLoud@lemmy.ca
There’s not really anything interesting to show. It’s just a home server in a 13 year old desktop ATX case.
There’s no desk, monitor, keyboard, or mouse… But also no cool server rack.
Function over form, and it sits in a spare bedroom out of sight.
EDIT: I found the receipt for the case. It’s a Cougar Volant Black Steel mid tower, purchased in 2013. So my server just looks like this:
Replying to @percent@infosec.pub
Gotta love the black slab.