Comment on I'm looking for an article showing that LLMs don't know how they work internally

<- View Parent
lgsp@feddit.it ⁨2⁩ ⁨days⁩ ago

Even if LLM “neurons” and their interconnections are modeled to the biological ones, LLMs aren’t modeled on human brain, where a lot is not understood.

The first thing is that how the neurons are organized is completely different. Think about the cortex and the transformer.

Second is the learning process. Nowhere close.

The fact explained in the article about how we do math, through logical steps while LLMs use resemblance is a small but meaningful example. And it also shows that you can see how LLMs work, it’s just very difficult

source
Sort:hotnewtop