So it is not running llms on an average gaming pc
Comment on Some local LLMs tested on an average gaming PC
donatas@feddit.uk 1 week ago128GB won’t make any difference in gaming when compared to, say, 32GB, so it’s just to fit larger LLMs into memory. However, 0.5t/s is hardly usable for every day tasks, so 32GB will still be more realistic combination with the RTX4070.
Keelhaul@sh.itjust.works 1 week ago
Snazz@lemmy.world 1 week ago
Nuh-uh! You can configure Minecraft to use all that memory to run buttery smooth. Just make sure to not play longer than 15 minutes so you don’t get the mother-of-god lagspike when the garbage collector finally runs.