Comment on In heat
It’s not even words, it “thinks” in “word parts” called tokens.
and those tokens? just numbers, indexes. LLMs have no concept of language or words or anything, it’s literally just a statistical calculator where the numbers encode some combination of letter(s)
Swedneck@discuss.tchncs.de 1 month ago
and those tokens? just numbers, indexes. LLMs have no concept of language or words or anything, it’s literally just a statistical calculator where the numbers encode some combination of letter(s)