I’m interested in hosting something like this, and I’d like to know experiences regarding this topic.
The main reason to host this for privacy reasons and also to integrate my own PKM data (markdown files, mainly).
Feel free to recommend me videos, articles, other Lemmy communities, etc.
woodgen@lemm.ee 10 months ago
github.com/oobabooga/text-generation-webui github.com/KoboldAI/KoboldAI-Client
CumBroth@discuss.tchncs.de 10 months ago
I’ve tried both this and github.com/jmorganca/ollama. I liked the latter a lot more; just can’t remember why.
GUI for ollama is a separate project: github.com/ollama-webui/ollama-webui