posted in Technology
OpenAI Hoarding Tens Of Thousands Of Apple Mac mini And Mac Studio Devices, As ASUS And MSI Burn Through Their Entire First Batch Of NVIDIA RTX Spark Chip And Beg For More.
wccftech.com/openai-hoarding-tens-of-thousands-of-apple-mac-mini-and-mac-studio-devices-as-asus-and-msi-burn-through-their-entire-first-batch-of-nvidia-rtx-spark-chip-and-beg-for-more/
Has the computers for local AI become that good?
Replying to @xSikes@feddit.online
No, no, they have not.
I did the math the other day, and the cost of the mac versus the token rate that you get off of it for a decent model would take you over 70 years of 100% 24/7/365 usage to pay for itself versus just using hosted inference.
They are wildly poor options for local AI models, at least on a cost basis. If you don’t care about spending $10,000 to run a halfway okay model at 100x the cost, then go for it.
Replying to @douglasg14b@lemmy.world
I just tried some local llm on my gaming rig, sufficient for chat and images.
But buying the rig just for this is most likely not worth it.