128GB won’t make any difference in gaming when compared to, say, 32GB, so it’s just to fit larger LLMs into memory. However, 0.5t/s is hardly usable for every day tasks, so 32GB will still be more realistic combination with the RTX4070.
Comment on Some local LLMs tested on an average gaming PC
archonet@lemy.lol 1 week agoI was gonna say, 4x the amount of RAM I have, made me feel inadequate.
donatas@feddit.uk 1 week ago
Snazz@lemmy.world 1 week ago
Nuh-uh! You can configure Minecraft to use all that memory to run buttery smooth. Just make sure to not play longer than 15 minutes so you don’t get the mother-of-god lagspike when the garbage collector finally runs.
Keelhaul@sh.itjust.works 1 week ago
So it is not running llms on an average gaming pc
surewhynotlem@lemmy.world 1 week ago
I’m going to keep using this 1070 until it fails it I get bored of Skyrim.
GnuLinuxDude@lemmy.ml 1 week ago
At this rate it seems like I will also never be upgrading from the 1070. Miners, NFTs, supply chain, AI, tariffs… how is an honest guy supposed to just buy a decent GPU when squeezed between all that bs?
lka1988@lemmy.dbzer0.com 1 week ago
I got my 7900XTX for MSRP in 2023 and have no plans on “upgrading” any time soon. The same PC’s 5800X3D is also showing no signs of letting up, and given the tariff bullshit going on right now, I plan on keeping it that way for as long as possible.