Meal nutrition data/Siri AI and iOS27 vision framework

Question

Created 8h

Replies 3

Boosts 0

Participants 2

This post is from the WWDC26 App Intents & Siri Q&A.

I'm an app developer with an interest in nutrition data. While watching the Keynote segment on Monday, there was a brief section about Siri AI and iOS 27 Vision framework being used to scan a meal with an iPhone camera and display the meal nutritional content. I have two questions:

Do the displayed data include GI (glycemic index) and/or GL (glycemic load)?

and

Are these nutrition data surfaced anywhere, especially in HealthKit, or — if not — will Apple make a public API available so developers can use these data directly in iOS27 apps?

Answered by Frameworks Engineer in 891938022

The displayed data does not include glycemic index or glycemic load. And there is API to receive the visually extracted meal nutritional content in your app, and it is not stored in HealthKit. There do exist HealthKit APIs for your app to read and write nutritional data.

Answer 1

Frameworks Engineer OP

Apple

6h

Accepted Answer

Recommended

The displayed data does not include glycemic index or glycemic load. And there is API to receive the visually extracted meal nutritional content in your app, and it is not stored in HealthKit. There do exist HealthKit APIs for your app to read and write nutritional data.

Answer 2

nekton34 OP

6h

Thank you for the encouraging answer. Is there any public documentation about this API to receive the visually extracted meal nutritional content? Is there a WWDC session on the vision framework related to extracted male nutritional content?

Answer 3

nekton34 OP

6h

Sorry, as added questions: Does the API return structured data per identified food item, or a single aggregate for the whole plate? What is the confidence/accuracy model — does it return uncertainty ranges? Is there a session number or a framework name I can search in the Developer documentation?