Comment on Want a more private ChatGPT alternative that runs offline? Check out Jan

tubbadu@lemmy.kde.social ⁨10⁩ ⁨months⁩ ago

• Infiltrated_ad8271@kbin.social ⁨10⁩ ⁨months⁩ ago

  The question is quickly answered as none is currently that good, open or not.

  Anyway it seems that this is just a manager. I see some competitors available that I have heard good things about, like mistral.

  source

  • Bipta@kbin.social ⁨10⁩ ⁨months⁩ ago

    Local LLMs can beat GPT 3.5 now.

    source

    • june@lemmy.world ⁨10⁩ ⁨months⁩ ago

      3.5 fuckin sucks though. That’s a pretty low bar to set imo.

      source
    • Speculater@lemmy.world ⁨10⁩ ⁨months⁩ ago

      I think a good 13B model running on 12GB of VRAM can do pretty well. But I’d be hard pressed to believe anything under 33B would beat 3.5.

      source