Comment on AI boom could falter without wider adoption, Microsoft chief Satya Nadella warns
makyo@lemmy.world 16 hours agoIs that true? I haven’t heard MS say anything about enabling local LLMs. Genuinely curious and would like to know more.
Comment on AI boom could falter without wider adoption, Microsoft chief Satya Nadella warns
makyo@lemmy.world 16 hours agoIs that true? I haven’t heard MS say anything about enabling local LLMs. Genuinely curious and would like to know more.
tal@lemmy.today 16 hours ago
That’s why they have the “Copilot PC” hardware requirement, because they’re using an NPU on the local machine.
searches
learn.microsoft.com/en-us/windows/…/npu-devices/
It’s not…terribly beefy. Like, I have a Framework Desktop with an APU and 128GB of memory that schlorps down 120W or something, kind of out of what you’re going to do on a laptop. And that in turn is weaker computationally than something like the big Nvidia hardware going into datacenters.
But it is doing local computation.