Comment on Researchers figured out how to run a 120-billion parameter model across four regular desktop PCs
WereCat@lemmy.world 4 days ago
OFC you can… I can run the 70B DeepSeek on my 16GB RX 6800 XT with 64GB RAM already…
Comment on Researchers figured out how to run a 120-billion parameter model across four regular desktop PCs
WereCat@lemmy.world 4 days ago
OFC you can… I can run the 70B DeepSeek on my 16GB RX 6800 XT with 64GB RAM already…
SharkAttak@kbin.melroy.org 4 days ago
That last amount you mentioned could be a little problematic, at the moment...