Comment on Smaug-72B-v0.1: The New Open-Source LLM Roaring to the Top of the Leaderboard
Fisch@lemmy.ml 11 months agoThe models you have should be .gguf files right? I think those are the only ones where that’s supported
Comment on Smaug-72B-v0.1: The New Open-Source LLM Roaring to the Top of the Leaderboard
Fisch@lemmy.ml 11 months agoThe models you have should be .gguf files right? I think those are the only ones where that’s supported
miss_brainfarts@lemmy.blahaj.zone 11 months ago
All of them are gguf, yeah