posted in Technology
Linus Torvalds used AI to fix a Linux bug, and now LLM critics on Linux face an uncomfortable choice
lists.debian.org/debian-project/…/msg00041.html
www.xda-developers.com/linus-used-ai-bug-llm-critics-face-choice/
Replying to @themachinestops@lemmy.dbzer0.com
If the model is adequately FOSS, i.e. open weights, and can run on a single consumer GPU (or NPU), and the “author” (quotations because I’m personally undecided if one can claim code generated by an aforementioned model is theirs) understands it, then I really don’t see what the problem is…
Personally I have nothing against SLMs/LLMs as a technology, to me my grievances against ChatGPT or Claude are mostly about their environmental impacts and selling us back our own art, also keeping knowledge behind a for-profit black-box - if those aren’t appropriate for a specific model, then I say using that model is fair, and good for productivity.
Replying to @bl4ckp1xx13@lemmy.dbzer0.com
The problem with open weight models is that they are still hard to deploy. For DeepSeek for example you require NVIDIA HGX B200, these things are expensive.
Replying to @themachinestops@lemmy.dbzer0.com
Yes, unfortunately they are, and I do think efficiency is going to be a significant research front for open-weight models. The nature of this topic is highly speculative as our compute capabilities have only recently reached what is required to consider running generative AI models, what we have today are very crude first implementations of what I personally believe will become an everyday tool for developers, and more.
And we have seen this, there are models now capable of running on an individual’s hardware (and not particularly expensive hardware either) that can outperform what ChatGPT initially launched with.