Time to buy a thread ripper and 800gb of ram so that I can run this model at 1 token per hour.
Comment on The first GPT-4-class AI model anyone can download has arrived: Llama 405B
Ripper@lemmy.world 3 months agoits around 800gb
2001zhaozhao@sh.itjust.works 3 months ago
hperrin@lemmy.world 3 months ago
God damn.
bruhduh@lemmy.world 3 months ago
That’s some thick model