posted in Technology
Torvalds: AI Is the New Compiler, Not the New Programmer
pbxscience.com/torvalds-ai-is-the-new-compiler-not-the-new-programmer/
Never seen a non-deterministic compiler though
Replying to @piyuv@lemmy.world
Technically, LLMs (and most ML models) are deterministic with the same input and same seed.
I get what you mean though.
So does ChatGPT intentionally change seed at every interaction so it always spits two different outputs given the same input?
In short: yes. You can tune these values when self hosting - it basically changes the b chance which tokens will be used under which circumstances.