Comment on What If There’s No AGI?
jj4211@lemmy.world 1 week agoPretty much this. LLMs came out of left field going from morning to what it is more really quickly.
If expect the same of AGI, not correlated to who spent the most or is best at LLM. It might happen decades from now or in the next couple of months. It’s a breakthrough that is just going to come out of left field when it happens.
JcbAzPx@lemmy.world 1 week ago
LLMs weren’t out of left field. Chatbots have been in development since the '90s at least. Probably even longer. People just don’t pay attention until it’s commercially available.
scratchee@feddit.uk 1 week ago
Modern llms were a left field development.
Most ai research has serious and obvious scaling problems. It did well at first, but scaling up the training didn’t significantly improve the results. LLMs went from more of the same to a gold rush the day it was revealed that they scaled “well” (relatively speaking). They then went through orders of magnitude improvements very quickly because they could (unlike previous ai training models which wouldn’t have benefited like this).
We’ve had chatbots for decades, but with a the same low capability ceiling that most other old techniques had, they really were a different beast to modern LLMs with their stupidly excessive training regimes.