Comment on Apple wants AI to run directly on its hardware instead of in the cloud
exu@feditown.com 1 year agoI’ve been playing with llama.cpp a bit for the last week and it’s surprisingly workable on a recent laptop just using the CPU. It’s not really hard to imagine Apple and others adding (more) AI accelerators on mobile.
Apollo2323@lemmy.dbzer0.com 1 year ago
Oh yes and the CPUs on phones have being getting more powerful every year and there was nothing that could take advantage of their full potential now with a local AI will be great for privacy and response.