128GB won’t make any difference in gaming when compared to, say, 32GB, so it’s just to fit larger LLMs into memory. However, 0.5t/s is hardly usable for every day tasks, so 32GB will still be more realistic combination with the RTX4070.
Comment on Some local LLMs tested on an average gaming PC
archonet@lemy.lol 1 month agoI was gonna say, 4x the amount of RAM I have, made me feel inadequate.
donatas@feddit.uk 1 month ago
Snazz@lemmy.world 1 month ago
Nuh-uh! You can configure Minecraft to use all that memory to run buttery smooth. Just make sure to not play longer than 15 minutes so you don’t get the mother-of-god lagspike when the garbage collector finally runs.
Keelhaul@sh.itjust.works 1 month ago
So it is not running llms on an average gaming pc
surewhynotlem@lemmy.world 1 month ago
I’m going to keep using this 1070 until it fails it I get bored of Skyrim.
GnuLinuxDude@lemmy.ml 1 month ago
At this rate it seems like I will also never be upgrading from the 1070. Miners, NFTs, supply chain, AI, tariffs… how is an honest guy supposed to just buy a decent GPU when squeezed between all that bs?
lka1988@lemmy.dbzer0.com 1 month ago
I got my 7900XTX for MSRP in 2023 and have no plans on “upgrading” any time soon. The same PC’s 5800X3D is also showing no signs of letting up, and given the tariff bullshit going on right now, I plan on keeping it that way for as long as possible.