posted in Technology
Why your local LLM feels dumber than it is
forum.level1techs.com/t/why-your-local-llm-feels-dumber-than-it-is/253917posted in Technology
Why your local LLM feels dumber than it is
forum.level1techs.com/t/why-your-local-llm-feels-dumber-than-it-is/253917If you ascribe any level of sentience or intelligence to a computer, you definitely feel much less dumb than you actually are.
And who are you to assert that? How well defined is sentience already?
Replying to @SlimePirate@lemmy.dbzer0.com
I mean, I’m all for local LLMs, but they are as sentient as a really good weather prediction model.
aka not at all.
Its just a fact of how they operate, mechanically. They are missing too many characteristics for it to even be an entertainable question.
They might operate differently but they still appear the same as us, 99.9% of the time. Imo if it looks like a duck and acts like a duck…
Replying to @hirihit640@sh.itjust.works
I mean… No? Absolutely not.
I dont even know where to begin. Maybe with their state being fixed in time; LLMs do not change. An sci fi analogy might be the “no timers” in orion’s arm, who are but a single thought frozen in an infinite loop in time:
www.orionsarm.com/eg-article/47f4311eaef31
Except they arent even that, because its just a next word completion model, not something that thinks. It is not self aware.
openreview.net/forum?id=klU4737opt
This becomes (to me) very obvious if you ever use an LLM in raw completion mode. It very smart, but at the end of the day its no different than a weather prediction model spitting out probabilities for a storm system.
Chat finetuning is meant to get humans to anthropomorphize them by training on human preferences, and the interface further reinforces this. Its all a trick, albeit a very elaborote one.
Will future architectures be closer to “thinking?”
Maybe.
But we are a long way away.
Are we not just prediction systems with more neurons?
Now im not saying LLMs are human at all because to be human is to have gone through our exact evolutionary path, but we really are in a lot of ways much more similar than you think. At least the speaking part of our brain is.
The argument that LLMs are fixed in time does not contradict consciousness. Say a human was stuck in a time loop and the human is asked the same question every single loop, at the exact same time, in the exact same way, with every single atom being in the exact place. Would their answer change? I would argue no, the same exact neurons would be stimulated every time that would cause the same exact answer every time.
We don’t even have a solid definition of what is concious. Are insects conscious? Like the fruit fly, we have modeled all of its neural paths and it simplifies down to essentially being a robot that responds to stimuli.
What does make humans special is our ability to learn. But what when an LLM trains its self? Is that not learning? I think the question of consciousness is too complex to simply say one way or the other and it is foolish to simply it this way.
I can’t believe how many pro-AI arguments essentially boil down to “I do not understand words”.
We have a very solid and explicit definition of what conscious means:
www.merriam-webster.com/dictionary/conscious#medi…
The best neuroscientists in the world do not even fully understand the complicated intricacies of the workings of the human mind. We do understand 100% exactly how computers work. There is no comparison.
Discussing the consciousness of neural networks is NOT being pro-AI. I’d say it’s even the opposite, as it displays the danger of such a technology.
Most of the words in the definition have multiple interpretations, it is not as easy as you wish it would be.
Finally, we do NOT at all know how trained neural networks work. We know how training and inference work. We can read the neurons, but the shear size of weights make it a rather impenetrable black box we have to study, partially, to understand the goals of the emergent sub networks.
Fearmongering about the idea of a neural network gaining consciousness is basically like doing free advertising for AI companies lmao
You are ascribing a power to them that they do not possess
For the record, I think neural networks have a lot of useful applications; for example, radiological image recognition. The term “AI” basically has no meaning though, and is most commonly used to describe LLMs, a technology that has very few (if any) good real world applications.
I am not fearmongering the fact it helps or not AI companies is not relevant here.
You are getting off topic.