Comment on Frustratingly bad at self hosting. Can someone help me access LLMs on my rig from my phone

MTK@lemmy.world ⁨5⁩ ⁨days⁩ ago

Ollama + open webui + tailscale/netbird

Open webui provides a fully functional docker with ollama, so just find the section that applies to you (amd, nvidia, etc) github.com/open-webui/open-webui?tab=readme-ov-fi…

And on that host install netbird or Tailscale, install the same on your phone, in tailscale you need to enable magicdns but in netbird I think it provides dns by default.

Once the docker is running and both your server and phone are connected to the vpn (netbird or tailscale) you just type the dns of your server in your phone’s browser (in netbird it would be “yourserver.netbird.cloud” and in tailscale it would be “yourserver.yourtsnet.ts.net”)

Checkout networkchuck on youtube as he has a lot of simple tutorials.

source
Sort:hotnewtop