Comment on Frustratingly bad at self hosting. Can someone help me access LLMs on my rig from my phone
MTK@lemmy.world 5 days ago
Ollama + open webui + tailscale/netbird
Open webui provides a fully functional docker with ollama, so just find the section that applies to you (amd, nvidia, etc) github.com/open-webui/open-webui?tab=readme-ov-fi…
And on that host install netbird or Tailscale, install the same on your phone, in tailscale you need to enable magicdns but in netbird I think it provides dns by default.
Once the docker is running and both your server and phone are connected to the vpn (netbird or tailscale) you just type the dns of your server in your phone’s browser (in netbird it would be “yourserver.netbird.cloud” and in tailscale it would be “yourserver.yourtsnet.ts.net”)
Checkout networkchuck on youtube as he has a lot of simple tutorials.
BlackSnack@lemmy.zip 5 days ago
Bet. I believe what you mentioned is best for accessing my LLM no matter where I am in the world, correct? If so I will try this one after I try what the other person suggested.
Thank you!