Comment on Apple wants AI to run directly on its hardware instead of in the cloud
exu@feditown.com 10 months agoI’ve been playing with llama.cpp a bit for the last week and it’s surprisingly workable on a recent laptop just using the CPU. It’s not really hard to imagine Apple and others adding (more) AI accelerators on mobile.
Apollo2323@lemmy.dbzer0.com 10 months ago
Oh yes and the CPUs on phones have being getting more powerful every year and there was nothing that could take advantage of their full potential now with a local AI will be great for privacy and response.