Comment on My self hosted badges of honor
zeezee@slrpnk.net 2 days ago
you self host your own claude llm? damn and here i thought a 14B deepseek ollama instance was good shit - how did you get access to their proprietary weights?
Comment on My self hosted badges of honor
zeezee@slrpnk.net 2 days ago
you self host your own claude llm? damn and here i thought a 14B deepseek ollama instance was good shit - how did you get access to their proprietary weights?
johnnixon@lemmy.world 2 days ago
No, but I refuse to pay my VPS for GPU time so I self host Gemma3:27B with RAG on Ollama over tailnet to make a choose your own adventure medical protocol simulator. I’m sure Claude could give me some context breathing room but not at those token prices. I did see something on pointing Claude Code to your own Ollama server and that would maybe justify the self hosted butthole.
3abas@lemmy.world 1 day ago
But you don’t currently? So it doesn’t.
lemonySplit@lemmy.ca 17 hours ago
Exactly, so… why the Claude sticker? Seemed like a cool concept to me tbh; till I read the comments and realized multiple things up there aren’t actually being selfhosted 🤷♂️