Generally, yes. However, there have been some incredible (borderline “magic”) emergent generalization capabilities that I don’t think anyone was expecting.
Modern AI is more than just “pattern matching” at this point. Yes at the lowest levels, sure that’s what it’s doing, but then you could also say human brains are just pattern matching at that same low level.
SinningStromgald@lemmy.world 1 month ago
Remember the “white genocide in South Africa” nonsense? That kind of rewriting of history.
BrokenGlepnir@lemmy.world 1 month ago
It’s not the LLM doing that though. It’s the people feeding it information
MajinBlayze@lemmy.world 1 month ago
Try rereading the whole tweet, it’s not very long. It’s specifically saying that they plan to “correct” the dataset using Grok, then retain with that dataset.
It would be way too expensive to go through it by hand
zqps@sh.itjust.works 1 month ago
Yes.
He wants to prompt grok to rewrite history according to his worldview, then retrain the model on that output.