Comment on Anthropic has developed an AI 'brain scanner' to understand how LLMs work and it turns out the reason why chatbots are terrible at simple math and hallucinate is weirder than you thought

<- View Parent
elbarto777@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

You’re comparing two different things.

Of course I can reflect on how I came with a math result.

“Wait, how did you come up with 4 when I asked you 2+2?”

You can confidently say: “well, my teacher said it once and I’m just parroting it.” Or “I pictured two fingers in my mind, then pictured two more fingers and then I counted them.” Or “I actually thought that I’d say some random number, came up with 4 because it’s my favorite digit, said it and it was pure coincidence that it was correct!”

Whereas it doesn’t seem like Claude can’t do this.

Of course, you could ask me “what’s the physical/chemical process your neurons follow for you to form those four fingers you picture in your mind?” And I would tell you I don’t know. But again, that’s a different thing.

source
Sort:hotnewtop