Comment on Seems legit

DarkCloud@lemmy.world ⁨1⁩ ⁨day⁩ ago

• criss_cross@lemmy.world ⁨1⁩ ⁨day⁩ ago

  And gpt-oss is an offline version of chatgpt

  source
• utopianfiat@lemmy.world ⁨1⁩ ⁨day⁩ ago

  Indeed huggingface.co/openai-community

  source
• linkinkampf19@lemmy.world ⁨1⁩ ⁨day⁩ ago

  First thing that came to mind: GPT4All

  source
• sp3ctr4l@lemmy.dbzer0.com ⁨1⁩ ⁨day⁩ ago

  I’ve been toying with Qwen3.

  Opensource too!

  source
• Ghostalmedia@lemmy.world ⁨1⁩ ⁨day⁩ ago

  I mean, most people have a local LLM in their pocket right now.

  source

  • sp3ctr4l@lemmy.dbzer0.com ⁨4⁩ ⁨hours⁩ ago

    Unless I am missing something:

    Most people do not have a local LLM in their pocket right now.

    Most people have a client app that talks to a remote LLM, which ‘lives’ in an ecologically and economically dubious mega-datacenter, in their pocket right now.

    source

    • GamingChairModel@lemmy.world ⁨3⁩ ⁨hours⁩ ago

      Plenty of the AI functions on phones are on-device. I know the iPhone is capable of several text-based processing (summarizing, translating) offline, and they have an API for third party developers to use on-device models. And the Pixels have Gemini Nano on-device for certain offline functions.

      source

      • tetris11@feddit.uk ⁨3⁩ ⁨hours⁩ ago

        My phone does speech-to-text flawlessly offline, it’s a crazy useful little LLM tool

        source
      • sp3ctr4l@lemmy.dbzer0.com ⁨3⁩ ⁨hours⁩ ago

        Oh!

        Well, I didn’t know that.

        I’m too poor to be able to afford such fancy phones.

        source
    • Ghostalmedia@lemmy.world ⁨3⁩ ⁨hours⁩ ago

      Gemini nano, Apple Intelligence On-device, etc.

      source
• SubArcticTundra@lemmy.ml ⁨23⁩ ⁨hours⁩ ago

  ollama.org

  source