Comment on We need to stop pretending AI is intelligent
jpeps@lemmy.world 3 weeks agoCouldn’t agree more - there are some wonderful insights to gain from seeing your own kids grow up, but I don’t think this is one of them.
Kids are certainly building a vocabulary and learning about the world, but LLMs don’t learn.
stephen01king@lemmy.zip 3 weeks ago
LLMs don’t learn because we don’t let them, not because they can’t. It would be too expensive to re-train them on every interaction.
terrific@lemmy.ml 3 weeks ago
I know it’s part of the AI jargon, but using the word “learning” to describe the slow adaptation of massive arrays of single precision numbers to some loss function, is a very generous interpretation of that word, IMO.
stephen01king@lemmy.zip 3 weeks ago
But that’s exactly how we learn stuff, as well. Artificial neural networks are modelled after how our neuron affect each other while we learn and store memories.
terrific@lemmy.ml 3 weeks ago
Neural networks are about as much a model of a brain as a stick man is a model of human anatomy.
I don’t think anybody knows how we actually, really learn. I’m not a neuro scientist (I’m a computer scientist specialised in AI) but I don’t think the mechanism of learning is that well understood.
AI hype-people will say that it’s “like a neural network” but I really doubt that. There is no loss-function in reality and certainly no way for the brain to perform gradient descent.