← Back to post

Edit history

Most recent

I mean… No? Absolutely not.

I dont even know where to begin. Maybe with their state being fixed in time; LLMs do not change. An sci fi analogy might be the “no timers” in orion’s arm, who are but a single thought frozen in an infinite loop in time:

www.orionsarm.com/eg-article/47f4311eaef31

Except they arent even that, because its just a next word completion model, not something that thinks. It is not self aware.

arxiv.org/pdf/2503.09211

openreview.net/forum?id=klU4737opt

arxiv.org/abs/2504.09762

This becomes (to me) very obvious if you ever use an LLM in raw completion mode. It very smart, but at the end of the day its no different than a weather prediction model spitting out probabilities for a storm system.

Chat finetuning is meant to get humans to anthropomorphize them by training on human preferences, and the interface further reinforces this. Its all a trick, albeit a very elaborote one.

Will future architectures be closer to “thinking?”

Maybe.

But we are a long way away.

Original

I mean… No? Absolutely not.

I dont even know where to begin. Maybe with their state being fixed in time; LLMs do not change. An sci fi analogy might be the “no timers” in orion’s arm, who are but a single thought frozen in an infinite loop in time:

www.orionsarm.com/eg-article/47f4311eaef31

Except they arent even that, because its just a next word completion model, not something that thinks. It is not self aware.

arxiv.org/pdf/2503.09211

openreview.net/forum?id=klU4737opt

arxiv.org/abs/2504.09762

This becomes (to me) very obvious if you ever use an LLM in raw completion mode. It very smart, but at the end of the day its no different than a weather prediction model spitting out probabilities for a storm system.