Um… yes. Matrix multiplication is deterministic, there’s nothing non-deterministic about an LLM, unless you artificially add randomness to them, like randomly selecting 1 of the top N ranked tokens.
Edit history
Um… yes. Matrix multiplication is deterministic, there’s nothing non-deterministic about an LLM, unless you artificially add randomness to them, like randomly selecting 1 of the top N ranked tokens.
ordering of operations
??? Lol what?
Um… yes. Matrix multiplication is deterministic, there’s nothing non-deterministic about an LLm, unless you artificially add randomness to them, like randomly selecting 1 of the top N ranked tokens.