Adopting AppIntents and AppEntities for Apple Intelligence

In my app, I adopt ‘App Intents’ and ‘App Entities’ for various items and actions in my app. These work in the Shortcuts app, and users can use Find Intents to lookup information or use the intents to act up on them, even though they don’t map on to any of the specific App ‘Schemes’ and ‘Domains’ that are listed. If I'm using just App Entities and Intents on their own, would these participate with the new Siri AI, without any additional work? For example, in my app, I have entities like Contacts, Tags, and ‘Visit Logs’. I have intents for 'create tag’, ‘add tags to a contact’, add a ‘Log’ to a 'contact' etc. These are specified in the AppShortcutsProvider list, but I have more than 10 intents. How would these work with the new Apple Intelligence and Siri? Or does Siri integration require AppSchema adoption?

Answered by Frameworks Engineer in 891809022

If I'm using just App Entities and Intents on their own, would these participate with the new Siri AI, without any additional work?... These are specified in the AppShortcutsProvider list, but I have more than 10 intents.

You are on the right track here. AppShortcutsProvider will allow you to specify up to 10 intents to be automatically available to Siri. This is the best way to integrate your app with Siri when your intents do not overlap with an App schema domain.

For the full list of App schema domains, please refer to the documentation.

— james 

I have the exact same question for my app which allows users to create charts and add series to them from Shortcuts. I couldn't find any AppSchemas that would match my entities.

  1. Will Siri AI only access app intents through AppSchemas?
  2. Does this limitation also apply to the "vibe coded" shortcuts Siri AI is now able to build?

Existing intents will keep working, but App Schema adoption is what unlocks the full Siri AI experience.

Your AppShortcutsProvider intents still work as they do today — phrase-based, usable in Shortcuts. But the new Siri AI capabilities (natural language without memorized phrases, on-screen awareness, personal context) flow through the schema-based intents and IndexedEntity content in the semantic index.

For your case: Contacts probably maps to an existing schema. Tags and Visit Logs likely don't — so adopt IndexedEntity to get them into the semantic index even without a matching schema.

On the 10-intent limit: that applies to AppShortcutsProvider phrases, not schema-based intents. Schema intents are discovered semantically, so they're not subject to that cap.

— Divya Ravi, Senior iOS Engineer

So if I understand this correctly, adopting IndexedEntity on its own (without schema-based entities) should be enough to get semantic understanding from Siri for the 'data'. For eg. "which contact has the next birthday in <myapp>" should work? But to get actionable 'intents', the intents would have to conform to one of the fixed schemas?

Also, is there a way to request an expansion of the set of schemas and domains? It seems a little limited at this point.

If I'm using just App Entities and Intents on their own, would these participate with the new Siri AI, without any additional work?... These are specified in the AppShortcutsProvider list, but I have more than 10 intents.

You are on the right track here. AppShortcutsProvider will allow you to specify up to 10 intents to be automatically available to Siri. This is the best way to integrate your app with Siri when your intents do not overlap with an App schema domain.

For the full list of App schema domains, please refer to the documentation.

— james 

For your case: Contacts probably maps to an existing schema

What kind of schema would this map to? I haven't found a suitable candidate.

Same question from myself as above. As it stands it seems like this is a serious limitation for apps that have actions not suitable for any schema/domain. In my app the entities have frequently changing properties, ie. treble and bass settings of a speaker my app can control. What would be the best approach to make that work with Siri when the user says ”set the bass on the bedroom speaker to 4”?

Adopting AppIntents and AppEntities for Apple Intelligence
 
 
Q