Based on their presentations yesterday and accompanying written materials they have a pretty capable ~3B parameter Foundational LLM running fully locally on the devices which is the first line. https://machinelearning.apple.com/research/introducing-apple...

Good news then that you’re explicitly asked for permission each time any query would by shared with ChatGPT.

You can read what they have shared about the security aspects of the cloud portion of their AI offering here: https://security.apple.com/blog/private-cloud-compute/

Can’t find a link right now (search terms are pretty crowded atm!) but I saw they just recently shared an llm they’ve been working on that is designed to answer questions about how a give screen of an app functions. (Identifying buttons, core functionality, etc.)

I actually liked that they didn’t show any of the AI writing capabilities being used in iMessage but rather in email client for more professional contexts. I’m really curious to see if they make it available in iMessage…

You can only go into so much detail in that format for that audience. I was happy that they simultaneously posted a much more technical deep dive: https://security.apple.com/blog/private-cloud-compute/

The details of their approach: https://security.apple.com/blog/private-cloud-compute/

Word on the street (someone who was talking to Apple employees at WWDC) is that the Vision Pro doesn’t have enough headroom on the processor for it. It’s driving that sucker really hard just doing its “regular” thing.

If you want the details: https://security.apple.com/blog/private-cloud-compute/

Before you write off their claims I encourage you to read more about the detailed specifics (if you have the technical footing and inclination to do so). While the approaches should certainly be probed and audited, it’s clearly more than performative. https://security.apple.com/blog/private-cloud-compute/

Also a good thread from Matthew Green, a privacy/cryptography wonk, on the subject: https://x.com/matthew_d_green/status/1800291897245835616?s=4...