LLMs can’t learn. It’s one of their inherent properties that they are literally incapable of learning. You can train a new model, but you can’t teach new things to an already trained one. All you can do is adjust its behavior a little bit. That creates an extremely expensive cycle where you just have to spend insane amounts of energy to keep training better models over and over and over again. And the wall of diminishing returns on that has already been smashed into. That, and the fact that they simply don’t have concepts like logic and reasoning, puts a rather hard limit on their potential. It’s gonna take several sizeable breakthroughs to make LLMs noticeably better than they are now.
There might be another kind of AI that solves those problems inherent to LLMs, but at present that is pure sci-fi.
rob_t_firefly@lemmy.world 3 weeks ago
Our microorganism ancestors also did all those things, and they were far beyond anything an LLM can do. Turning words into numbers, doing a string of math to those numbers, and turning the resulting numbers back into words is not consciousness or wisdom and never will be.
TankovayaDiviziya@lemmy.world 3 weeks ago
You think microorganisms can reason? Wow, AI haters are grasping for straws.
Honestly, I don’t understand Lemmy scoffing at AI and thinking the current iteration is all it ever will be. I’m sure no one thought that the automobile technology would go anywhere simply because the first model was running at 3mph. These things always takes time.
To be clear, I’m not endorsing AI, but I think there is a huge potential in years to come, for better or worse. And it is especially important to never underestimate something, especially by AI haters, because of what destructive potential AI has.
rob_t_firefly@lemmy.world 3 weeks ago
The straw I’m grasping at here is a reasonably well-accepted scientific consensus, but you do you.
TankovayaDiviziya@lemmy.world 3 weeks ago
Can you explain how quorom sensing is reasoning?
plyth@feddit.org 3 weeks ago
Neither is moving electrolytes around fat barriers.
TankovayaDiviziya@lemmy.world 3 weeks ago
I think given how a substantial number of users in Lemmy are old, I think there is simply a natural aversion to the new and grasping for straws. I never hear of younger folks with IT background dismiss AI completely, as much as Lemmy does. I’m not a fan of AI, especially how company shove AI to us, but to dismiss that it won’t evolve and improve is a ridiculous position to me.