Comment on Researchers figured out how to run a 120-billion parameter model across four regular desktop PCs
WereCat@lemmy.world 3 weeks ago
OFC you can… I can run the 70B DeepSeek on my 16GB RX 6800 XT with 64GB RAM already…
Comment on Researchers figured out how to run a 120-billion parameter model across four regular desktop PCs
WereCat@lemmy.world 3 weeks ago
OFC you can… I can run the 70B DeepSeek on my 16GB RX 6800 XT with 64GB RAM already…
SharkAttak@kbin.melroy.org 3 weeks ago
That last amount you mentioned could be a little problematic, at the moment...