Comment on Smaug-72B-v0.1: The New Open-Source LLM Roaring to the Top of the Leaderboard
OutrageousUmpire@lemmy.world 9 months ago
If only I had the $ to get a rig that could run this locally
Comment on Smaug-72B-v0.1: The New Open-Source LLM Roaring to the Top of the Leaderboard
OutrageousUmpire@lemmy.world 9 months ago
If only I had the $ to get a rig that could run this locally
DarkThoughts@fedia.io 9 months ago
Since I had an okay experience with EasyDiffusion I tried running text gen locally through oobabooga, but no matter which model I load, it just crashes whenever it tries to generate anything, regardless if it runs through the UI's chat or SillyTavern. No error in the terminal either, it just stops and throws me back into the command line.