On-device AI agents hit a hard memory limit. Apple's new architecture routes around it.
Source:
ventureBeat
June 9, 2026 · 10:49
On-device AI models have stayed small because the entire weight set has to live in DRAM, capping practical parameter counts well below what server-side deployments use. Enterprise architects evaluating agentic workloads have had to choose between capable cloud-dependent models and limited on-device ones. Apple's third-generation foundation models, announced at WWDC26, break that constraint by moving the weight set off DRAM entirely.The AFM 3 family was developed in collaboration with Google and spans five models: two on-device and three server-based, all running within Apple's Private Cloud Compute boundary. The server-side models, including AFM 3 Cloud Pro for agentic tool use and complex reasoning, run on Nvidia GPUs in Google Cloud. The on-device architecture is Apple's own. AFM 3 Core …
The original article opens on the publisher's website.
More from Mobile
View topic →Android stuck in Safe Mode? Here's how to turn it off
engadget
Sep 1, 2026 · 16:00
How to change the background on iPhone Messages
engadget
Sep 1, 2026 · 15:30
Google’s Android update tackles motion sickness, accessibility, and more
techcrunch
Sep 1, 2026 · 13:53
US defends Venezuela deal as Chevron prepares to expand operations
financialTimes
Sep 1, 2026 · 13:48
John Ternus hypes ‘huge launch next week’ in first memo as Apple CEO
techcrunch
Sep 1, 2026 · 12:45