Comment on We need to stop pretending AI is intelligent
stephen01king@lemmy.zip 3 weeks agoLLMs don’t learn because we don’t let them, not because they can’t. It would be too expensive to re-train them on every interaction.
Comment on We need to stop pretending AI is intelligent
stephen01king@lemmy.zip 3 weeks agoLLMs don’t learn because we don’t let them, not because they can’t. It would be too expensive to re-train them on every interaction.
terrific@lemmy.ml 3 weeks ago
I know it’s part of the AI jargon, but using the word “learning” to describe the slow adaptation of massive arrays of single precision numbers to some loss function, is a very generous interpretation of that word, IMO.
stephen01king@lemmy.zip 3 weeks ago
But that’s exactly how we learn stuff, as well. Artificial neural networks are modelled after how our neuron affect each other while we learn and store memories.
terrific@lemmy.ml 3 weeks ago
Neural networks are about as much a model of a brain as a stick man is a model of human anatomy.
I don’t think anybody knows how we actually, really learn. I’m not a neuro scientist (I’m a computer scientist specialised in AI) but I don’t think the mechanism of learning is that well understood.
AI hype-people will say that it’s “like a neural network” but I really doubt that. There is no loss-function in reality and certainly no way for the brain to perform gradient descent.