Comment on AI is like an evil villain's henchman: "Yes sir, you're absolutely right, sir." "Great idea master!" "My apologies master, I should have known what you meant from the start. Forgive me master.”

• chicken@lemmy.dbzer0.com ⁨1⁩ ⁨day⁩ ago

  LM Studio is probably the easiest way

  source

  • Flagstaff@programming.dev ⁨1⁩ ⁨day⁩ ago

    No, promote open-source platforms; LMS is closed-source. Try jan.ai instead.

    source

    • chicken@lemmy.dbzer0.com ⁨1⁩ ⁨day⁩ ago

      Fair, I use Open WebUI + Ollama personally but it’s slightly tricky to set up, wasn’t aware there were open source options with a built in model browser and hardware compatibility estimates

      source

      • LanguageIsCool@lemmy.world ⁨14⁩ ⁨hours⁩ ago

        Thanks Ollama

        source
• Quazatron@lemmy.world ⁨21⁩ ⁨hours⁩ ago

  Lookup Alpaca and Ollama. If you are using Linux they are just a Flatpak away.

  If not, you can go with Ollama in docker format with a Open-WebUI frontend.

  The model I used was Llama3.2 and basically told it to simulate GlaDOS.

  source
• trolololol@lemmy.world ⁨1⁩ ⁨day⁩ ago

  You can also just tell your favorite one to do that, if that’s what you’re after or have a really bad GPU.

  LM studio is the most stable and user friendly that I’ve found by far, but try to download a model that fits inside your GPU or else the model will be super slow or crash.

  source