Comment on I'm looking for an article showing that LLMs don't know how they work internally

• glizzyguzzler@lemmy.blahaj.zone ⁨1⁩ ⁨month⁩ ago

  You can prove it’s not by doing some matrix multiplication and seeing its matrix multiplication. Much easier way to go about it

  source

  • theunknownmuncher@lemmy.world ⁨1⁩ ⁨month⁩ ago

    Yes, neural networks can be implemented with matrix operations. What does that have to do with proving or disproving the ability to reason? You didn’t post a relevant or complete thought

    source

    • glizzyguzzler@lemmy.blahaj.zone ⁨1⁩ ⁨month⁩ ago

      Improper comparison; an audio file isn’t the basic action data it is the data, the audio codec is the basic action on the data

      “An LLM model isn’t really an LLM because it’s just a series of numbers”

      But the action of turning the series of numbers into something of value (audio codec for an audio file, matrix math for an LLM) are actions that can be analyzed

      And clearly matrix multiplication cannot reason any better than an audio codec algorithm. It’s matrix math, it’s cool we love matrix math. Really big matrix math is really cool and makes real sounding stuff. But it’s just matrix math, that’s how we know it can’t think

      source

      • theunknownmuncher@lemmy.world ⁨1⁩ ⁨month⁩ ago

        LOL you didn’t really make the point you thought you did. It isn’t an “improper comparison” (it’s called a false equivalency FYI), because there’s isn’t a real distinction between information and this thing you just made up called “basic action on data”, but anyway have it your way:

        Your comment is still exactly like saying an audio pipeline isn’t really playing music because it’s actually just doing basic math.

        source

        • -> View More Comments
      • DarkDarkHouse@lemmy.sdf.org ⁨1⁩ ⁨month⁩ ago

        Do LLMs not exhibit emergent behaviour? But who am I, a simple skin-bag of chemicals, to really say.

        source

        • -> View More Comments
      • BB84@mander.xyz ⁨1⁩ ⁨month⁩ ago

        Can humans think?

        source
  • whaleross@lemmy.world ⁨1⁩ ⁨month⁩ ago

    People that can not do Matrix multiplication do not possess the basic concepts of intelligence now? Or is software that can do matrix multiplication intelligent?

    source

    • futatorius@lemm.ee ⁨1⁩ ⁨month⁩ ago

      People that can not do Matrix multiplication do not possess the basic concepts of intelligence now?

      As a mathematician (at least by education), I think that’s a great definition, yes.

      source
    • glizzyguzzler@lemmy.blahaj.zone ⁨1⁩ ⁨month⁩ ago

      So close, LLMs work via matrix multiplication, which is well understood by many meat bags and matrix math can’t think. If a meat bag can’t do matrix math, that’s ok, because the meat bag doesn’t work via matrix multiplication. lol imagine forgetting how to do matrix multiplication and disappearing into a singularity or something

      source

      • whaleross@lemmy.world ⁨1⁩ ⁨month⁩ ago

        Well, on the other hand. Meat bags can’t really do neuron stuff either, despite that is essential for any meat bag operation. Humans are still here though and so are dogs.

        source