Comment on Meta is Adding AI-Powered Summaries to WhatsApp
chaospatterns@lemmy.world 15 hours agoFascinating. Just based on your comment and nothing else, sounds like it could be something like a CPU Enclave like Intel SGX. Basically a remote client can validate that an application runs in a secure part of a remote cloud computer. The stated goal of SGX is that you only have to trust Intel and if you trust Intel and say run program X in the enclave, then only that part of the CPU can access the data, not the applications running in the non-secure enclave.
Now that brushes over some things like you still need to trust the client and IIRC in a WhatsApp situation, you don’t really know what enclave does, but the communications between the enclave and the host OS are heavily restricted. LLMs also require lots of CPU and are usually run on GPUs, so not sure how that works yet.
teolan@lemmy.world 15 hours ago
They use GPU based enclaves. They have a white paper available. I just seemed it but they mention AMD and NVIDIA enclaves.