Comment on What webapps do you selfhost that aren't media/game servers?
AtHeartEngineer@lemmy.world 3 days agoI think most people on here are reasonable, and I think local LLMs are reasonable.
The race to AGI and companies trying to shove “AI” into everything is kind of insane, but it’s hard to deny LLMs are useful and running them locally you dont have privacy concerns.
ifItWasUpToMe@lemmy.ca 3 days ago
Interesting, this has not been my experience. Most people on here seem to treat AI as completely black and white, with zero shades of grey.
AtHeartEngineer@lemmy.world 3 days ago
I see a mix, don’t get me wrong, Lemmy is definitely opinionated lol, but I don’t think it’s quite black and white.
Also, generally, I’m not going to not share my thoughts or opinions because I’m afraid of people that don’t understand nuance, sometimes I don’t feel like dealing with it, but I’m going to share my opinion most of the time.
OP asked what you self host that isn’t media, self hosted LLMs is something I find very useful and I didn’t see mentioned. Home assistant, pihole, etc, all great answers… But those were already mentioned.
I still have positive upvotes on that comment, and no one has flamed me yet, but we will see.
treyf711@lemm.ee 3 days ago
I’ll give my recommendation to local LLMs as well. I have a 1060 super that I bought years ago in 2019 and it’s just big enough to do some very basic auto completion within visual studio. I love it. I wouldn’t trust it to write an entire program on its own, but when I have hit a mental block and need a rough estimate of how to use a library or how I can arrange some code, it gives me enough inspiration to get through that hump.
AtHeartEngineer@lemmy.world 3 days ago
Ya exactly! Or just sanity checking if you understand how something works, I use it a lot for that, or trying to fill in knowledge gaps.
Also qwen3 is out, check that out, it might fit on a 1060.
iegod@lemm.ee 3 days ago
Concur. In particular models focused on image output.