Comment on Is AI Facing a Trough of Disillusionment?
jacksilver@lemmy.world 3 weeks agoWe definitely haven’t cracked AGI, that’s without a doubt.
But yeah, LLMs are big (I’d say really Transformers were the breakthrough). My point though was that Deep Learning is the underlying technology driving all of this and we certainly haven’t run out of ideas in that space even if LLMs may be hitting a dead end.
CheeseNoodle@lemmy.world 3 weeks ago
I feel like LLMs didn’t hit a deadend so much as people started trying to use them in completely inappropriate applications.
jacksilver@lemmy.world 3 weeks ago
I think it’s a mixture of that and the fact that when OpenAI saw that throwing more data drastically improved the models, they thought they would continue to see jumps like that.
However, we now know that bad benchmarks were misleading how steep the improvements were, and much like with autonomous vehicles, solving 90% of the problem is still a farcry away from 100%.