Comment on The first GPT-4-class AI model anyone can download has arrived: Llama 405B
obbeel@lemmy.eco.br 1 month agoAccording to huggingface, you can run a 34B model using 22.4GBs of RAM max. That’s a RTX 3090 Ti.
Comment on The first GPT-4-class AI model anyone can download has arrived: Llama 405B
obbeel@lemmy.eco.br 1 month agoAccording to huggingface, you can run a 34B model using 22.4GBs of RAM max. That’s a RTX 3090 Ti.