TMP_NKcYUEoM7kXg4qYe

@TMP_NKcYUEoM7kXg4qYe@lemmy.world

• ⁨Comment⁩ on ⁨What can I use for an offline, selfhosted LLM client, pref with images,charts, python code execution⁩ ⁨⁨2⁩ ⁨weeks⁩ ago⁩:

  You can tell Open Interpreter to run commands based on you human-language input. If you want local only LLM, you can pair it with Ollama. It works for “interactive” use where you’re asked for confirmation before a command is run.

  I set this up in a VM because I wanted a full automatic coding “agent” which can run commands without my intervention and I did not want it to blow up main system. It did not really work though because as far as I know Open Interpreter does not have a way to “pipe” a command’s output back into the LLM so that it could create feedback with linters and stuff.

  Another issue was that Starcoder2, which is the only LLM trained on permissive licensed code I could find, only has a 15B “human-like” model. The smaller models only speak code so I don’t know how that would work for agentic usage and the 15B is really slow running on DDR4 CPU. I think agents are cool though so I would like to try Aider which is a supposedly good open source agent and unlike Open Interpreter is not abandonware.

  Thanks for coming to my blabering talk, hope this might be useful for someone.

• ⁨Comment⁩ on ⁨C4illin/ConvertX: Self-hosted online file converter that supports 1000+ formats⁩ ⁨⁨1⁩ ⁨month⁩ ago⁩:

  Fair enough. I guess I imagined someone hosting all the selfhosted web apps that get posted to this forum, when most people likely just host only the few they need on the go, so it isn’t really that burdensome.

• ⁨Comment⁩ on ⁨What OS should I use for self-hosting that doesn't require extensive terminal knowledge?⁩ ⁨⁨1⁩ ⁨month⁩ ago⁩:

  Yep my thoughts. New selfhosters think the hard part of selfhosting is command line but that’s “kinda” like thinking that the hard part of math is writing numbers on paper. Terminal is just the medium, not the complex part. Navigating filesystem and editing files is easier on the desktop but changing permissions and managing services would be be extremely difficult for a newbie without using the terminal because (almost) every online tutorial uses terminal. OP would have to learn how to translate the terminal command to its desktop counterpart at which point they might as well use the terminal.

  OP also has an XY problem. They asked for a system which does not require terminal usage but they should have actually asked for an easy to set up system. People are recommending things like Yunohost though, so it’s fine in the end.

• ⁨Comment⁩ on ⁨C4illin/ConvertX: Self-hosted online file converter that supports 1000+ formats⁩ ⁨⁨1⁩ ⁨month⁩ ago⁩:

  It’s nice there’s a front end for all these tools but I kinda don’t get why is everything “hosted”. This could have just been a desktop app. I guess it can be useful when you want to convert something on your phone but to me it just seems like unnecessary server maintenance burden.