Replying to @⁨eicker@lemmy.world⁩

The funniest part is that the thing that could actually make AI useful at scale might be what wrecks the investment thesis: cheap, local, open weight models. Wall Street funded a trillion dollar server farm to discover that sometimes the answer is a smaller model running on your laptop. The technology might win while the investors lose. Nevertheless, companies such as Google, Amazon, and Microsoft – as well as Nvidia and AMD – are a very long way from simply going under.

en

Replying to @⁨eicker@lemmy.world⁩

Nevertheless, companies such as Google, Amazon, and Microsoft – as well as Nvidia and AMD – are a very long way from simply going under.

Not really, once you look at the startups like OpenAI they have enormous expenses that depend on constant debt and investment funding, and the cost and risk of sustaining that debt can easily reach a point where they struggle to get new investors to foot the bill.

The whole market is based on a belief in a huge pot of gold some time in the future, and it is driven by unfathomable amounts of debt to keep the machinery running towards that goal. Once the belief in the goal getting reached gets broken, the change in momentum breaks the whole system.

That includes the big players, huge amounts of their balance sheets, including claims of revenue, are circular trades between themselves. Even google claims revenue from asset price growth in their AI subsidiaries.

Once it shifts from investment to repaying bad debts the numbers will look completely different for all the big companies involved. We’re talking potentially bail outs basically across the board

Replying to @⁨scytale@piefed.zip⁩

they’re doing far more than just that, the way jensen has been able to structure all almost all of these deals essentially offloading all the risk. they sell essentially lease the hardware, ontop of huge chunk of premium up front, ontop of paying for compute itself, ontop of offloading any actual buildout cost onto any greedy schmuck willimg to pay the tab. nvda will be completely fine (though stock price will obviously correct as bubble-levels income drops)

Replying to @⁨scytale@piefed.zip⁩

At the same time, they are doing extreme price gouging with little improvement between generations since h200. Huawei actually has better $/performance ratio and accelerating faster. Others have better inference solution, with AMD doing better on $/training performance too. The fact that Nvidia is the one propping up the AI bubble, sinking their cashflow into dead ends, makes it a bad stock too. Peak NVidia BS got exposed in an Australian IPO this week. It was too absurd to get anyone to buy and got cancelled. Heavily backed by NVidia.

Replying to @⁨dangling_cat@piefed.blahaj.zone⁩

lol you’re kidding, right? Have you looked at component prices lately? Have you missed the part about how basically all consumer electronics that use LPDDR are getting price hikes, because the demand for high performance memory has skyrocketed by an order of magnitude in the last few years?

Edit: yeah I realized I was replying to a rhetorical question 🙃

Replying to @⁨gravitas_deficiency@sh.itjust.works⁩

He didn’t mean to question the premise that the consumer market is being starved, he was highlighting the reality of that and connecting it as being motivated by a fear of local models.

Admittedly, the question was ambiguous and could be taken either way, but the comment didn’t mention that consumer market was starved, his question brought it into the discussion.

Note that I don’t think that it is fear of local models personally, I think it’s fear of each other. I think cloud infrastructure providers already proved that even when people can locally host stuff, they mostly don’t. So many consumer electronics could meet their promises all locally, but still force the users to connect to their internet services. The tech market has already proven time and time again they are suckers for subscription eshitification, no need to panic over it being different for AI.