Comment on Smaug-72B-v0.1: The New Open-Source LLM Roaring to the Top of the Leaderboard

<- View Parent
Amaltheamannen@lemmy.ml ⁨4⁩ ⁨months⁩ ago

Though with quantisatiom you can get it down to like 30GB of vram or less.

source
Sort:hotnewtop