Comment on Self-Host Weekly (30 January 2026)
SanPe_@lemmy.world 1 day ago
The “else-hosted” LLM AI is really not my thing, but selfhosted even less…
Comment on Self-Host Weekly (30 January 2026)
SanPe_@lemmy.world 1 day ago
The “else-hosted” LLM AI is really not my thing, but selfhosted even less…
irmadlad@lemmy.world 1 day ago
If I had the proper equipment, I’d run AI if it were self contained and not pinging out to another LLM.
meltedcheese@c.im 1 day ago
@irmadlad @selfhosted That is precisely the challenge. I’m not sure it is possible.
irmadlad@lemmy.world 1 day ago
I mean, I can run a few of the private AI stacks, but it is excruciatingly slow as to make it not worth the time. I would want something pretty responsive.
meltedcheese@c.im 1 day ago
@irmadlad This what I want too. It’s farther down my to-do list, but I’ll be sure to let you know if I discover anything. Good luck!
greybeard@feddit.online 1 day ago
The hardware requirements are quite steep, but I’ve got local AI running in my house. It’s mostly just there for when I want to screw around with it, but technically I could setup OpenClaw and point it to my AI server to use as its brain.
I’m not stupid enough to do that on any real computer I use, but it might be cool to do on a VM where I can tightly control what it can see and have access to. Of course, that limits its usefulness, but security has a cost.
At the same time, I can see the allure of a real digital assistant. I’m old enough to remember when professionals had personal assistants that not only helped them keep track of their work life, but also their personal life. Scheduling their personal life like doctors appointments or house repairs. Dealing with vendors to make sure stuff actually gets done, and making sure they are in the right place at the right time. That would be rad to have.