Comment on The first GPT-4-class AI model anyone can download has arrived: Llama 405B
hperrin@lemmy.world 5 months ago
Yo this is big. In both that it is momentous, and holy shit that’s a lot of parameters. How many GB is this model?? I’d be able to run it if I had an few extra $10k bills lying around to buy the required hardware.
Ripper@lemmy.world 5 months ago
its around 800gb
hperrin@lemmy.world 5 months ago
God damn.
bruhduh@lemmy.world 5 months ago
That’s some thick model
2001zhaozhao@sh.itjust.works 5 months ago
Time to buy a thread ripper and 800gb of ram so that I can run this model at 1 token per hour.