I really love the Foundation Models framework. I've been building with it every day since the beginning, and it's been genuinely useful. I'm curious why the on-device model didn't get a larger context window this year. I'd love to work with bigger documents, and I know I could chunk or compact them, but I'd rather not lose context that way. Is a larger window something you're considering?
Context window for Foundation Models
Apple doesn't typically make any statements about future plans.
I recommend you file feedback explaining your use case so the appropriate team can take it into consideration.
I can't comment on future plans or limitations of the on device models. As @lazyvar suggests please file some feedback and explain your use case.
In the meantime, it might be worth having a look at this article to see if any of the suggestions would help: https://developer.apple.com/documentation/foundationmodels/managing-the-context-window