Selfhosted coding assistant?

Comments

• artwork@lemmy.world ⁨2⁩ ⁨days⁩ ago

  “Self-hosted mind atrophy with skills degradation running in parallel.”
  No. Absolutely no. You should code with your mind, and stay creative.

  source

  • IMALlama@lemmy.world ⁨2⁩ ⁨days⁩ ago

    Straight up vibe coding is a horrible idea, but I’ll happily take tools to reduce mundane tasks.

    The project I’m currently working on leans on Temporal for durable execution. We define the activities and workflows in protobufs and utilize codegen for all the boring boiler plate stuff. The project hasa number of http endpoints that are again defined in protos, along with their inputs and outputs. Again, lots of code gen. Is code gen making me less creative or degrading my skills? I don’t think so. It sure makes the output more consistent and reduces the opportunity for errors.

    If I engage gen AI during development, which isn’t very often, my prompts are very targeted and the scope is narrow. However, I’ve found that gen AI is great for writing and modifying tests and with a little prompting you can get pretty solid unit test coverage for a verity of different scenarios. In the case of the software I write at work the creativity is in the actual code and the unit tests are often pretty repetitive (happy path, bad input 1…n, no result, mock an error at this step, etc). Once you know how to do that there’s no reason not to offload it IMO.

    source

    • artwork@lemmy.world ⁨2⁩ ⁨days⁩ ago

      Thank you! You do you.

      source
  • MasterBlaster@lemmy.world ⁨1⁩ ⁨day⁩ ago

    We can’t ignore this. We need to know how it is done if we want to earn salaries. Reality rarely makes a dent in the corporate herd until years later.

    By then, careers are obliterated.

    There are ways to protect your mind in the meantime.

    source

    • sem@lemmy.blahaj.zone ⁨1⁩ ⁨day⁩ ago

      What is the way

      source
  • Shimitar@downonthestreet.eu ⁨2⁩ ⁨days⁩ ago

    While you are correct, as all tools AI is not bad per se.

    If you use ai to replace more lengthy documentation searches and write your own code that works out pretty well and speed up your work without degrading your coding. Granted, I got plainly incorrect answers as well, but at least I managed to be much more efficient.

    Treat LLMs/ai as a glorified documentation aggregator and that’s how you correctly use that tool.

    Like, use a knife to cut and cook meat, not to cut another person body, and that’s how you correctly use that tool too.

    source

    • artwork@lemmy.world ⁨2⁩ ⁨days⁩ ago

      No, thank you. Sorry, never. You do you.

      source

      • -> View More Comments
    • poVoq@slrpnk.net ⁨2⁩ ⁨days⁩ ago

      In my experience using AI for that replaces legthy documentation searches, with reading lengthy AI output that turns out to be full of halucinations. Net time saved usually negative.

      source

      • -> View More Comments
    • Appoxo@lemmy.dbzer0.com ⁨2⁩ ⁨days⁩ ago

      I like it to generate my git comments.
      Sometimes I just don’t know how to actually describe what I did.

      source
• Coolcoder360@lemmy.world ⁨2⁩ ⁨days⁩ ago

  I’ve not found them useful yet for more than basic things. I tried Ollama, it let’s you run locally, has simple setup, stays out of the way.

  source
• ryokimball@infosec.pub ⁨2⁩ ⁨days⁩ ago

  I have heard good things about LM Studio from several professional coders and tinkers alike. Not tried it myself yet though, but I might have to bite the bullet because I can’t seem to get ollama to perform how I want.

  TabbyML is another thing to try.

  source

  • wasp_eggs@midwest.social ⁨2⁩ ⁨days⁩ ago

    Thanks for the reply!

    I had noticed TabbyML but something about their wording made me rethink and then the next day I saw a post on here regarding the same phrasing, I decided to leave it alone after that

    source

    • scrubbles@poptalk.scrubbles.tech ⁨2⁩ ⁨days⁩ ago

      Yeah I tried tabby too and they had like a mandatory "we share your code " line and I hoped out. Like if you’re going to do that I might as well just use claude

      source
• hummingbird@lemmy.world ⁨2⁩ ⁨days⁩ ago

  LM Studio in combination with Kilo Code for IDE integration works pretty nicely locally. Here is a good video covering the basics to get you going: www.youtube.com/watch?v=rp5EwOogWEw

  source
• TomAwezome@lemmy.world ⁨2⁩ ⁨days⁩ ago

  I get good mileage out of the Jan client and Void editor, various models will work but Jan-4B tends to do OK, maybe a Meta-Llama model could do alright too. The Jan client has settings where you can start up a local OpenAI-compatible server, and Void can be configured to point to that localhost URL+port and specific models. If you want to go the extra mile for privacy and you’re on a Linux distro, install firejail from your package manager and run both Void and Jan inside the same namespace with outside networking disabled so it only can talk on localhost. E.g.: firejail --noprofile --net=none --name=nameGoesHere Jan and firejail --noprofile --net=none --join=nameGoesHere void, where one of them sets up the namespace (–name=) and the other one joins the namespace (–join=)

  source
• herseycokguzelolacak@lemmy.ml ⁨2⁩ ⁨days⁩ ago

  I recommend llama.cpp instead of LM Studio.

  source