Comment on If so-called AI is basically just Large Language Models, how come predictive text on my phone is bollock-useless?

<- View Parent
bassomitron@lemmy.world ⁨11⁩ ⁨months⁩ ago

The kind of local/offline LLMs that would work on your phone would not be very good quality. There’s been amazing progress of quantization of LLMs to get them working on weaker GPUs with lower VRAM and CPUs, so maybe it’ll occur, but I’m not an expert.

I also don’t foresee them linking it up to a cloud-based LLM as that’d be a shit load of queries and extremely expensive.

source
Sort:hotnewtop