Comment on Consumer GPUs to run LLMs
marauding_gibberish142@lemmy.dbzer0.com 1 month agoDo you have 2 PCIE X16 slots on your motherboard (speaking in terms of electrical connections)?
Comment on Consumer GPUs to run LLMs
marauding_gibberish142@lemmy.dbzer0.com 1 month agoDo you have 2 PCIE X16 slots on your motherboard (speaking in terms of electrical connections)?
Natanox@discuss.tchncs.de 1 month ago
They would run with 8x speed each. Should not be too much of a bottleneck though, I don’t expect the performance to suffer noticeably more than 5% from this. Annoying, but getting a CPU+Board with 32 lanes or more would throw off the price/performance ratio.
marauding_gibberish142@lemmy.dbzer0.com 1 month ago
I have an alternative for you if your power bills are cheap: X99 motherboard + CPU combos from China