Comment on I'm looking for an article showing that LLMs don't know how they work internally

<- View Parent
glizzyguzzler@lemmy.blahaj.zone ⁨5⁩ ⁨days⁩ ago

Improper comparison; an audio file isn’t the basic action data it is the data, the audio codec is the basic action on the data

“An LLM model isn’t really an LLM because it’s just a series of numbers”

But the action of turning the series of numbers into something of value (audio codec for an audio file, matrix math for an LLM) are actions that can be analyzed

And clearly matrix multiplication cannot reason any better than an audio codec algorithm. It’s matrix math, it’s cool we love matrix math. Really big matrix math is really cool and makes real sounding stuff. But it’s just matrix math, that’s how we know it can’t think

source
Sort:hotnewtop