Comment on Stack Overflow in freefall: 78 percent drop in number of questions
rumba@lemmy.zip 2 days agoInteresting story, but I’ve seen the same work with how many ass in assassian
you can probe the stuff it’s bad at, and a lot of it doesn’t line up well with the story that it’s how people were corrected.
webadict@lemmy.world 2 days ago
But that’s exactly how an LLM is trained. It doesn’t know how words are spelled because words are turned into numbers and processed. But it does know when its dataset has multiple correlations for something. Specifically, people spell out words, so it will regurgitate to you how to spell strawberry, but it can’t count letters because that’s not a thing that language models do.
Generative AI and LLMs are just giant reconstruction bots that take all the data they have and reconstruct something. That’s literally what they do.
Like, without knowing what your answer is for assassin, I will assume that your issue is that the question is probably “How many asses are in assassin?” But, like, that’s a joke. Assassins only has one ass, just like the rest of us. That’s a joke. And nobody would ever spell assassin as assin, so why would it learn that there are two asses in assassin?
I’m confused where you are getting your information from, but this is not particularly special behavior.