Comment on Squiggly Boie

trxxruraxvr@lemmy.world ⁨1⁩ ⁨month⁩ ago

• WanderingThoughts@europe.pub ⁨1⁩ ⁨month⁩ ago

  Hundred billion circles should be close enough

  source

  • Nikelui@lemmy.world ⁨1⁩ ⁨month⁩ ago

    Maybe I’m wrong, but aren’t the parameters the actual connections between neurons? The circles should be orders of magnitude less.

    source

    • WanderingThoughts@europe.pub ⁨1⁩ ⁨month⁩ ago

      Parameters are even more. A quick search tells me:

      ChatGPT-4 is estimated to have roughly 1.8 trillion parameters

      source