tyler

That’s pretty funny that you say ten years ago because that’s exactly how long ago we moved into this house. So the last apartment we stayed at was exactly ten years ago (and a few months).

The rent we paid at the time was $2200 USD. It’s now $3000 which is actually less than inflation.

… we had autocomplete that worked better before LLMs came along. If you’re not using an LLM to generate more code then what the fuck is the point.

I gave one example. In fact that’s one of the least bad examples. If that was the only problem with LLMs it wouldn’t really be that bad. But the actual reality is so much worse. But I was arguing to the point that the person I replied to made, which was about development. The problems I have with AI are not fixable without literally every government on earth taking a stand, which just will not happen.

The overwhelming majority of software development occurs on a team. You understanding what you’ve asked an AI to do doesn’t mean jack when you need to make sure an entire team can understand it five years from now. And LLMs tend to write code that is incomprehensible to another person the next day.

Completely disagree. The difficult part of software development was never writing code OR speed of delivery. It was understanding requirements and problem solving. LLMs still can not do either of those things and there is no evidence they ever will be able to.

An example of how harmful LLMs actually are to development can succinctly be described with an issue I had a few weeks ago. I found an issue in an open source project, code was fine if a bit hard to understand. I came up with a PR to fix the problem.

In the time from me checking out the code to submitting the PR, a little less than 24 hours, the maintainer had completely rewritten the entire project with Claude. It was complete nonsense. Incredibly difficult to understand. Abstracting things that didn’t need abstracting. My PR was useless, because the entire project was new. The maintainer definitely didn’t understand the changes either. If a bug came up there’s no way AI would be able to solve it (the bug was still there even though the code was entirely new).

LLMs don’t understand the code. They just make things that look like they will work. And then a human has to maintain it (or keep paying billions of dollars for Claude to try to fix it).

Yeah I was already viewing the website, but I’m interested if it can replace Willow

Wait, what is this SnapOtter thing you mention? Apparently it’s based on some AI tool, but what has me really intrigued is its Whisper capabilities? There was another project I tried to use a few years ago called Willow, in order to have a VTT connection to home assistant. community.home-assistant.io/t/…/664916

The creator tragically died in a car accident soon after though and the project went kaput.

This looks like maybe it could do the same thing???

What the hell does this have to do with politics or the left? Good fucking grief conservatives think everyone is attacking them and use it as justification to make everything shitty for everyone.

The visual novel was a joke reference to an LLM using up an entire gpu. It’s quite sad that you’re so addicted to LLMs that you don’t even notice your biases.

All of those things you listed take a fraction of the power of these models.

The one you’re using with power in your own house already used enough power to run a city, so yeah…of course that one is getting disparaged.

And no, it doesn’t depend on the hardware. Thinking that a local llm only uses a portion of your gpu while games max them out is just ignorant. Games do not have to load up the entire vram and run the gpu at full power just to run a basic visual novel. An llm does both of those things, anytime you are using it. It’s absolutely nothing like a game.

The temperature my computer room gets to when gaming vs using a local model says otherwise. I’ll gladly plug in a measuring tool and show you the data if you want.

Power consumption for AI is way higher than for games…your gpu is rarely at full usage when running a game, only really if you’re one of the few people that tries to get every single bit out of your game with the highest level graphics and even then you’re not using the full amount because the game would stutter. It doesn’t matter if an llm stutters. They use the full power of your gpu no matter what you’re doing.

And the models being trained on other models mean that local LLMs use more energy than a model like Claude. You have all the energy of multiple data centers training one model and then you go and train a model off of that.

Yeah good read. I don’t agree that Microsoft isn’t dying though. They are, because people and companies alike are tired of other corporations throwing them under the bus. So many people are realizing that the companies don’t want what they want, and it kills their business or happiness.