I know that they’re “autocorrect on steroids” and what that means, I don’t see how that makes it any less ai. I’m not saying that LLMs have that magic sauce that is needed to be considered truly “intelligent”, I’m saying that ai doesn’t need any magic sauce to be ai. the code controlling bats in Minecraft is called ai, and no one complained about that.
Comment on AI is like a hammer
kescusay@lemmy.world 2 months agoSoftware developer, here.
It’s not actually AI. A large language model is essentially autocomplete on steroids. Very useful in some contexts, but it doesn’t “learn” the way a neutral network can. When you’re feeding corrections into, say, ChatGPT, you’re making small, temporary, cached adjustments to its data model, but you’re not actually teaching it anything, because by its nature, it can’t learn.
I’m not trying to diss LLMs, by the way. Like I said, they can be very useful in some contexts. I use Copilot to assist with coding, for example. Don’t want to write a bunch of boilerplate code? Copilot is excellent for speeding that process up.
0laura@lemmy.world 2 months ago
Zos_Kia@lemmynsfw.com 2 months ago
Very useful in some contexts, but it doesn’t “learn” the way a neural network can. When you’re feeding corrections into, say, ChatGPT, you’re making small, temporary, cached adjustments to its data model, but you’re not actually teaching it anything, because by its nature, it can’t learn.
But that’s true of all (most ?) neural networks ? Are you saying Neural Networks are not AI and that they can’t learn ?
NNs don’t retrain while they are being used, they are trained once then they cannot learn new behaviour or correct existing behaviour. If you want to make them better you need to run them a bunch of times, collect and annotate good/bad runs, then re-train them from scratch (or fine-tune them) with this new data. Just like LLMs because LLMs are neural networks.
celliern@lemmy.world 2 months ago
LLMs are part of AI, which is a fairly large research domain of math/info, including machine learning among other. God, even linear regression can be classified as AI : that term is reeeally large
kescusay@lemmy.world 2 months ago
I mean, I guess the way people use the term “AI” these days, sure, but we’re really beating all specificity out of the term.
celliern@lemmy.world 2 months ago
This is a domain research domain that contain statistic methods and knowledge modeling among other. That’s not new, but the fact that this is marketed like that everywhere is new
AI is really not a specific term. You may refer as global AI, and I suspect that’s what you refer to when you say AI?
0laura@lemmy.world 2 months ago
it’s always been this broad, and that’s a good thing. if you want to talk about AGI then say AGI.