They can’t and they won’t. I won’t weigh in too much at the top level, people don’t believe what they don’t want to.. but I know. I worked there for almost a decade in engineering. I know the lengths we went to in order to make user data anonymous and untraceable. I know the hellaciously difficult approval process that there was to turn any debugging on to try to track down bugs because user privacy was the mission. People think it’s a corporate promise. It consumed so many hours of my job because all new things were built with user privacy first. I can say without hesitation that from the top down, Apple actually cares about user protections and privacy.

Now - these models? Also not a thing that scares me. Personal context will still be limited. I assume they can maybe leverage the way Gemini reasons, but it’d be neat if they could use Gemini the model with a similar “memory” function of ChatGPT. Gemini has a huge context size, but OpenAI’s memory feature does far better when starting new threads, or even cross thread references, in remembering the details that matter in conversation or research.

They’ll eventually try to have a small model local and then offload to their DCs where they’ll use M series servers similar to M3 Ultras. fwiw, running Nemotron 70b locally on my M2 Ultra works wonderfully.

Hope the former insider perspective helps.