posted in Technology
Just say no to OpenAI and Anthropic
cross-posted from: https://piefed.world/c/tech/p/1460036/just-say-no-to-openai-and-anthropic
micahflee.com/just-say-no-to-openai-and-anthropic/Who do you say yes to?
Replying to @Carrots@quokk.au
me :3
I do like it loud.
Replying to @Carrots@quokk.au
DeepSeek r1 or small local models
And how do I run it without paying billionaires for hardware?
Replying to @Carrots@quokk.au
Find used 16gb GPUs off your local marketplace, Jensen (and by extension, Jenson’s leather jacket) don’t make shit on the used market
Replying to @Carrots@quokk.au
The article contains the answer
Als ob Gemini besser wäre….. Tinfoil ist offline nicht verwendbar und GLM-5.3-Flash scheint nicht unter Windows mit einer AMD gpu zu laufen?
I say no to all of it.
Replying to @beep@piefed.world
I’m also impressed with GLM-5.3-Flash. This is similar to Claude Opus 4.8. It’s much smaller and cheaper than GLM-5.3, and still incredibly capable. It’s also actually feasible for an individual person to get hardware to run it, like if you can one day get your hands on a Mac Studio with 512GB of RAM.
512 GB of RAM?!
My brother in christ I don’t even have 12 GB of ram! I don’t even have 512GB of SSD storage!
Replying to @Skullgrid@lemmy.world
It looks like one can’t get a 512GB Mac Studio until the end of the month, so right now, nobody does.
Replying to @beep@piefed.world
It’s also actually feasible for an individual person to get hardware to run it, like if you can one day get your hands on a Mac Studio with 512GB of RAM.
From the article.
Apple announced the M5 Ultra Mac Studio on August 26, 2026, with pre-orders open today and shipping on September 22. The headline number for local AI is 512GB of unified memory at 1.2 TB/s of memory bandwidth, starting at $5,499.
modelfit.io/…/mac-studio-m5-ultra-512gb-local-llm…
Can’t find any for sale, because it seems completely unavailable at the moment. That aside, I wouldn’t call a price point of $5500 USD ‘feasible’.
Replying to @DupaCycki@lemmy.world
Ehhh if it’s a hobby you’re really into it’s not a crazy amount, I spent way more than that on motorcycles just for shits and giggles, 5k of photography equipment is a pretty small and sad pile, same with hi-fi, fishing, watches, bicycles etc.
Replying to @DupaCycki@lemmy.world
I’m pretty sure it has to be way more than $5500 for the 512GB model. By boss bought a couple (older models) to run local inference at work, and he paid like $20K each.
Replying to @beep@piefed.world
I’ve preferred Chinese alternatives since they became available. Fuck clammy Sam Altman and Wario, and I don’t really give a shit otf the Chinese know I can’t write my own yaml
The tech is legitimately cool, but American AI CEOs are unbearable cunts that only make hype