Comment on Local LLM for Server Setup Guidance?
cultist@feddit.dk 5 hours agoMaybe a easier place to start is a beginner friendly system? Lots of people like running Unraid for example, and they have lots of apps that will make it easier to get into (ca.unraid.net), that might help ease them into it. Being thrown into a Linux terminal might feel daunting, but also a great way to learn.
I think many just need to get hooked on it, then they more naturally feel like they want to customize and try out stuff.
I dont have any guide recommendations, since its been a while since I started. You can probably do some searching on the stuff you want them to setup.
Lumisal@lemmy.world 5 hours ago
I asked mostly because I haven’t seen any guides like that. The long video guides are also usually outdated or a very specific method that’s more advanced (like bare metal setup or using ignition)
My plan was to lead them through something like what I use which is base Debian using Dockge and a reverse proxy (though I’m looking into KDE Plasma BigScreen). I think they might be able to figure it out with help and some general written instructions and the AI for further questions.
cultist@feddit.dk 4 hours ago
For the arr stack the best resource I know is wiki.servarr.com which I referenced for my setup in Kubernetes.
Most projects have pretty good documentation on how to setup their services, in many cases its just the Docker config afterall.