Comment on Some local LLMs tested on an average gaming PC

slazer2au@lemmy.world ⁨2⁩ ⁨months⁩ ago

• Duke_Nukem_1990@feddit.org ⁨2⁩ ⁨months⁩ ago

  Yeah, not even a 5090? Pf, nice Dwarf Fortress machine I guess.

  source

  • superkret@feddit.org ⁨2⁩ ⁨months⁩ ago

    A dwarf Fortress machine would have an i9-14900KS, 192GB DDR5 RAM and no graphics card.

    source

    • Nibodhika@lemmy.world ⁨2⁩ ⁨months⁩ ago

      You still need a GPU, otherwise your CPU is wasting precious operations drawing the screen instead of simulating dwarves.

      source
• iAmTheTot@sh.itjust.works ⁨2⁩ ⁨months⁩ ago

  No kidding. Steam survey definitely does not agree with this definition of average lmao

  source
• archonet@lemy.lol ⁨2⁩ ⁨months⁩ ago

  I was gonna say, 4x the amount of RAM I have, made me feel inadequate.

  source

  • surewhynotlem@lemmy.world ⁨2⁩ ⁨months⁩ ago

    is my 2080 now considered potato gaming?"

    I’m going to keep using this 1070 until it fails it I get bored of Skyrim.

    source

    • GnuLinuxDude@lemmy.ml ⁨2⁩ ⁨months⁩ ago

      At this rate it seems like I will also never be upgrading from the 1070. Miners, NFTs, supply chain, AI, tariffs… how is an honest guy supposed to just buy a decent GPU when squeezed between all that bs?

      source

      • lka1988@lemmy.dbzer0.com ⁨1⁩ ⁨month⁩ ago

        I got my 7900XTX for MSRP in 2023 and have no plans on “upgrading” any time soon. The same PC’s 5800X3D is also showing no signs of letting up, and given the tariff bullshit going on right now, I plan on keeping it that way for as long as possible.

        source
  • donatas@feddit.uk ⁨2⁩ ⁨months⁩ ago

    128GB won’t make any difference in gaming when compared to, say, 32GB, so it’s just to fit larger LLMs into memory. However, 0.5t/s is hardly usable for every day tasks, so 32GB will still be more realistic combination with the RTX4070.

    source

    • Snazz@lemmy.world ⁨2⁩ ⁨months⁩ ago

      Nuh-uh! You can configure Minecraft to use all that memory to run buttery smooth. Just make sure to not play longer than 15 minutes so you don’t get the mother-of-god lagspike when the garbage collector finally runs.

      source
    • Keelhaul@sh.itjust.works ⁨2⁩ ⁨months⁩ ago

      So it is not running llms on an average gaming pc

      source
• False@lemmy.world ⁨2⁩ ⁨months⁩ ago

  I thought I had a lot of RAM with 64

  source

  • Valmond@lemmy.world ⁨2⁩ ⁨months⁩ ago

    Well, you do.

    source
  • sus@programming.dev ⁨2⁩ ⁨months⁩ ago

    64 gigs of ram costs less than $200 these days

    source