Comment

Comment on CEO of Palantir Says AI Means You’ll Have to Work With Your Hands Like a Peasant

yeahiknow3@lemmy.dbzer0.com ⁨2⁩ ⁨days⁩ ago

Even less plausible. There was a paper published recently arguing that by design LLMs are quite literally incapable of creativity. These predictive statistical models represent averages. They always and only generate the most banal outputs. That’s what makes them useful.

source

Sort:hotnew top

dukemirage@lemmy.world ⁨2⁩ ⁨days⁩ ago
Well, every academic field needs creativity. But it’s nothing new that people from economic or tech bubbles have a disdain for humanities.

source
phutatorius@lemmy.zip ⁨1⁩ ⁨day⁩ ago
The degree of randomness in generative models is not necessarily fixed, it can at least potentially be tunable. I’ve built special-purpose generative models that work that way (not LLMs, another application). More entropy in the model can increase the likelihood of excursions from the mean and surprising outcomes, though at greater risk of overall error.

There’s a broader debate to be had about how much that has to do with creativity, but if you think divergence from the mean is part of it, that’s within LLM capabilities.

source
- yeahiknow3@lemmy.dbzer0.com ⁨21⁩ ⁨hours⁩ ago
  That’s a good point. The problem is that LLM’s are calibrated for prediction. Their randomness is tweaked for efficacy. Forcing them to be more chaotic just makes them much less effective. This inherent tension is why they’re mathematically incapable of any sort of consistent creativity.
  
  source