Comment on Seems legit

• sp3ctr4l@lemmy.dbzer0.com ⁨3⁩ ⁨hours⁩ ago

  Unless I am missing something:

  Most people do not have a local LLM in their pocket right now.

  Most people have a client app that talks to a remote LLM, which ‘lives’ in an ecologically and economically dubious mega-datacenter, in their pocket right now.

  source

  • GamingChairModel@lemmy.world ⁨3⁩ ⁨hours⁩ ago

    Plenty of the AI functions on phones are on-device. I know the iPhone is capable of several text-based processing (summarizing, translating) offline, and they have an API for third party developers to use on-device models. And the Pixels have Gemini Nano on-device for certain offline functions.

    source

    • tetris11@feddit.uk ⁨3⁩ ⁨hours⁩ ago

      My phone does speech-to-text flawlessly offline, it’s a crazy useful little LLM tool

      source
    • sp3ctr4l@lemmy.dbzer0.com ⁨3⁩ ⁨hours⁩ ago

      Oh!

      Well, I didn’t know that.

      I’m too poor to be able to afford such fancy phones.

      source
  • Ghostalmedia@lemmy.world ⁨3⁩ ⁨hours⁩ ago

    Gemini nano, Apple Intelligence On-device, etc.

    source