Comment on Selfhost an LLM
muntedcrocodile@hilariouschaos.com 2 weeks ago
Openwebui is awesome and allows u to use it as an api for all the models u have it hooked up to. Can point it at ollama or any openai api compatible api endpoint (like open routers)