Comment on What budget friendly GPU for local AI workloads should I aim for?

poVoq@slrpnk.net ⁨1⁩ ⁨week⁩ ago

Recent models run surprisignly well on CPUs if you have sufficient regular RAM. You can also use a low VRAM GPU and offload parts to the CPU. If you are just starting out and want to play around I would try that first. 64gb system RAM is a good amount for that.

source
Sort:hotnewtop