Comment on Bill Gates feels Generative AI has plateaued, says GPT-5 will not be any better
astronaut_sloth@mander.xyz 11 months agoExcept that scaling alone won’t lead to AGI. It may generate better, more convincing text, but the core algorithm is the same. That “special juice” is almost certainly going to come from algorithmic development rather than just throwing more compute at the problem.
0ops@lemm.ee 11 months ago
See my reply to the person you replied to. I think you’re right that there will need to be more algorithmic development (like some awareness of it’s confidence so that the network can say IDK instead of hallucinating its best guess). Fundamentally though, llm’s don’t have the same dimensions of awareness that a person does, and I think that that’s the main bottleneck of human-like understanding.