Comment on What If There’s No AGI?
JcbAzPx@lemmy.world 1 week agoLLMs weren’t out of left field. Chatbots have been in development since the '90s at least. Probably even longer. People just don’t pay attention until it’s commercially available.
Comment on What If There’s No AGI?
JcbAzPx@lemmy.world 1 week agoLLMs weren’t out of left field. Chatbots have been in development since the '90s at least. Probably even longer. People just don’t pay attention until it’s commercially available.
scratchee@feddit.uk 1 week ago
Modern llms were a left field development.
Most ai research has serious and obvious scaling problems. It did well at first, but scaling up the training didn’t significantly improve the results. LLMs went from more of the same to a gold rush the day it was revealed that they scaled “well” (relatively speaking). They then went through orders of magnitude improvements very quickly because they could (unlike previous ai training models which wouldn’t have benefited like this).
We’ve had chatbots for decades, but with a the same low capability ceiling that most other old techniques had, they really were a different beast to modern LLMs with their stupidly excessive training regimes.