Comment on I built a local AI movie recommender for Radarr using Ollama
four@lemmy.zip 2 weeks agoI’m not an expert, but LLMs should still be deterministic. If you run the model with 0 creativity (or whatever the randomness setting is called) and provide exactly the same input, it should provide the same output. That’s not how it’s usually configured, but it should be possible. Now, if you change the input at all (change order of movies, misspell a title, etc) then the output can change in an unpredictable way
hendrik@palaver.p3x.de 2 weeks ago
Yes. I think determinism a misunderstood concept. In computing, it means exact same input leads to always the same output. Could be 100% wrong, though. As long as it stays the same. There’s some benefit in introducing randomness to AI. But it can be run in an entirely deterministic way as well. Just depends on the settings. (It’s called “temperature”.)