Finally! My dumb dumb 1TB ram server (4x E5-4640 + 32x32GB DDR3 ECC) can shine.
Comment on The first GPT-4-class AI model anyone can download has arrived: Llama 405B
Deceptichum@quokk.au 5 months agoOr you could run it via cpu and ram at a much slower rate.
chiisana@lemmy.chiisana.net 5 months ago
errer@lemmy.world 5 months ago
Yeah uh let me just put in my 512GB ram stick…
Deceptichum@quokk.au 5 months ago
Samsung do make them.
Goodluck finding 512gb of VRAM.
bruhduh@lemmy.world 5 months ago
www.ebay.com/p/116332559 lga2011 motherboards quite cheap, insert 2 xeon 2696v4 44 threads each totalling at 88 threads and 8 ddr4 32gb sticks, it comes quite cheap actually, you can also install Nvidia p40 with 24gb each, you can max out this build for ai for under 2000$