Dynamic profile switching

When using Dynamic Profiles to switch between the on-device model and Private Cloud Compute mid-session, how is the context window reconciled — if I build up context on PCC (larger window) and then route a turn back to the on-device model, what happens to the entries that exceed the on-device window? — Divya Ravi, Senior iOS Engineer

Answered by Frameworks Engineer in 892949022

By default, the same transcript is shared between each Profile. So if you move from a Profile using PrivateCloudComputeLanguageModel to one using SystemLanguageModel and the transcript is over SystemLanguageModel's context size limit, you'll hit a context limit exceeded error.

The recommended approach here is to apply the historyTransform modifier to your SystemLanguageModel Profile. There are also some other common strategies like using the "phone-a-friend" pattern or session properties as well. You can learn more in the agentic app experiences session: https://developer.apple.com/videos/play/wwdc2026/242

Accepted Answer

By default, the same transcript is shared between each Profile. So if you move from a Profile using PrivateCloudComputeLanguageModel to one using SystemLanguageModel and the transcript is over SystemLanguageModel's context size limit, you'll hit a context limit exceeded error.

The recommended approach here is to apply the historyTransform modifier to your SystemLanguageModel Profile. There are also some other common strategies like using the "phone-a-friend" pattern or session properties as well. You can learn more in the agentic app experiences session: https://developer.apple.com/videos/play/wwdc2026/242

Dynamic profile switching
 
 
Q