Gemini nano, Apple Intelligence On-device, etc.
Comment on Seems legit
sp3ctr4l@lemmy.dbzer0.com 3 hours agoUnless I am missing something:
Most people do not have a local LLM in their pocket right now.
Most people have a client app that talks to a remote LLM, which ‘lives’ in an ecologically and economically dubious mega-datacenter, in their pocket right now.
Ghostalmedia@lemmy.world 3 hours ago
GamingChairModel@lemmy.world 3 hours ago
Plenty of the AI functions on phones are on-device. I know the iPhone is capable of several text-based processing (summarizing, translating) offline, and they have an API for third party developers to use on-device models. And the Pixels have Gemini Nano on-device for certain offline functions.
tetris11@feddit.uk 3 hours ago
My phone does speech-to-text flawlessly offline, it’s a crazy useful little LLM tool
sp3ctr4l@lemmy.dbzer0.com 3 hours ago
Oh!
Well, I didn’t know that.
I’m too poor to be able to afford such fancy phones.