Comment on Smaug-72B-v0.1: The New Open-Source LLM Roaring to the Top of the Leaderboard
Fisch@lemmy.ml 7 months agoThe models you have should be .gguf files right? I think those are the only ones where that’s supported
Comment on Smaug-72B-v0.1: The New Open-Source LLM Roaring to the Top of the Leaderboard
Fisch@lemmy.ml 7 months agoThe models you have should be .gguf files right? I think those are the only ones where that’s supported
miss_brainfarts@lemmy.blahaj.zone 7 months ago
All of them are gguf, yeah