Comment on Music Library Management
hellmo_luciferrari@lemmy.zip 2 days agoI luckily do, I have a 3090 with 24GB of vram that copper modded. Hermes you say, may have to investigate.
I have 3 copies of my library
Comment on Music Library Management
hellmo_luciferrari@lemmy.zip 2 days agoI luckily do, I have a 3090 with 24GB of vram that copper modded. Hermes you say, may have to investigate.
I have 3 copies of my library
freedom@lemy.lol 2 days ago
Yeah, it’s all the rage now. Qwen3.6 35B or Google Gemma 26B should work fine for the task. Llmfan on hugging face uses the heretic framework to “abliterate” them and remove any safe guards that might prevent working with “pirated” content.
You can run hermes in a container or vm if you’re worried about the ai hallucinating, though I haven’t seen that happen. Use as high of a Q quant value as you can and run llama.cpp for speed. Or just try a free cloud model with hermes and see if it works.
The agent installed a bunch of mp3 scanning tools, did an inventory of my library and generated a list of actions for me to approve before it ran. Feels like the future.
hellmo_luciferrari@lemmy.zip 2 days ago
If I run Hermes, or anything AI, I’ll want to investigate how to containerize it. Which may be difficult with one GPU.
freedom@lemy.lol 1 day ago
Podman/docker works fine and doesn’t need the entire gpu like a vm. Hermes has a supported method for just that.