Comment on CEO of Palantir Says AI Means You’ll Have to Work With Your Hands Like a Peasant
phutatorius@lemmy.zip 1 day agoThe degree of randomness in generative models is not necessarily fixed, it can at least potentially be tunable. I’ve built special-purpose generative models that work that way (not LLMs, another application). More entropy in the model can increase the likelihood of excursions from the mean and surprising outcomes, though at greater risk of overall error.
There’s a broader debate to be had about how much that has to do with creativity, but if you think divergence from the mean is part of it, that’s within LLM capabilities.
yeahiknow3@lemmy.dbzer0.com 1 day ago
That’s a good point. The problem is that LLM’s are calibrated for prediction. Their randomness is tweaked for efficacy. Forcing them to be more chaotic just makes them much less effective. This inherent tension is why they’re mathematically incapable of any sort of consistent creativity.