Comment on Consumer GPUs to run LLMs
Natanox@discuss.tchncs.de 1 week agoThey would run with 8x speed each. Should not be too much of a bottleneck though, I don’t expect the performance to suffer noticeably more than 5% from this. Annoying, but getting a CPU+Board with 32 lanes or more would throw off the price/performance ratio.
marauding_gibberish142@lemmy.dbzer0.com 1 week ago
I have an alternative for you if your power bills are cheap: X99 motherboard + CPU combos from China