Siri AI at WWDC 2026
Apple announced new Siri AI features using screen-aware vision models and a custom Gemini-derived model for Private Cloud Compute.
Excerpt
<p>Given how badly burned anyone who took Apple's <a href="https://simonwillison.net/2024/Jun/10/apple-intelligence/">2024 WWDC Apple Intelligence announcements</a> at face value was, I'm holding to a strict "I'll believe it when I see it" policy for everything <a href="https://www.apple.com/newsroom/2026/06/apple-unveils-next-generation-of-apple-intelligence-siri-ai-and-more/">they announced today</a>. </p>
<p>The new Siri AI features do at least look feasible with today's technology, especially since Apple are licensing a custom Gemini-derived model that they can run on their own Private Cloud Compute.</p>
<p>It sounds like they'll be taking advantage of vision LLMs to extract information from the user's screen, which neatly sidesteps the need for every existing application to ship custom code in order to integrate with Apple Intelligence. Vision LLMs were a much less mature category in June 2024.</p>
<p>The new Core AI library looks like a good step in enabling developers to finally take full advantage of Apple's hardware for running their own models. It integrates with Meta's open source PyTorch ecosystem, based on these <a href="https://apple.github.io/coreai-torch/main/">Core AI PyTorch extensions</a>:</p>
<blockquote>
<p>Core AI PyTorch Extensions (<code>coreai-torch</code>) is a Python package that bridges PyTorch and Core AI. You can use it to bring up an existing PyTorch model — exported as a <code>torch.export.ExportedProgram</code> — into a Core AI <code>AIProgram</code> ready to run on Apple hardware, traversing the FX graph node-by-node and mapping ATen operators to Core AI operations.</p>
</blockquote>
<p>You can install an iOS 27 Developer Beta today, which supposedly has the new features - but you then have to make it through a waiting list for access to the new Siri AI. Aaron Perris from MacRumors reports having <a href="https://twitter.com/aaronp613/status/2064078063814471977">made it off the waitlist</a> so we may start seeing credible reports on
Read at source: https://simonwillison.net/2026/Jun/8/wwdc/#atom-everything