Comment

Ollama and all that runs on it its just the firewall rules and opening it up to my network that’s the issue.

I cannot get ufw, iptables, or anything like that running on it. So I usually just ssh into the PC and do a CLI only interaction. Which is mostly fine.

I want to use OpenWebUI so I can feed it notes and books as context, but I need the API which isn’t open on my network.

source

Sort:hotnew top

hendrik@palaver.p3x.de ⁨6⁩ ⁨days⁩ ago
Thanks for the info. Some day I'll try the shiny modern domain specific distros and learn the little peculiarities. I use a weird mix of Debian, NixOS and LMDE and it's relatively straightforward to add firewall rules to those, both dynamically to nftables and to the config... And I believe Debian doesn't even come with firewalling out of the box...

source
- nagaram@startrek.website ⁨5⁩ ⁨days⁩ ago
  Honestly if you’re not gaming or playing with new hardware, there is absolutely no point.
  
  I’ve considered swapping this computer over to Fedora for a hot minute, but it really is a gaming PC and I should stop trying to break it.
  
  source