Comment on Frustratingly bad at self hosting. Can someone help me access LLMs on my rig from my phone

<- View Parent
BlackSnack@lemmy.zip ⁨2⁩ ⁨weeks⁩ ago

Hate to say it but it didn’t work. I listed below the things I double checked. I really appreciate you helping me troubleshoot this, but it seems like I may have bitten off more than I can chew. I choose Ollama because it was supposed to be one of the easier loca AIs to set up. Do you have any recommendations for alternatives? Or do you think I should incorporate a docker or open web ui as some others have said ?

-when I went to the ollama app and entered the http://10.#.#.#:11434 , it didn’t work. Also tried the enchanted app and that didn’t work as well.

-I double checked the rule I made to make sure that was inputted properly. The 10.0.0.0/24 for the local and remote ip addresses.

-the sanity check went well. The ipv4 said closed. The ipv6 said failed.

-I checked the netstat -abn thing and 0.0.0.0:11434 is still listening.

source
Sort:hotnewtop