Summarization that must not hallucinate numbers

Question

Created 1d

Replies 1

Boosts 0

Participants 2

This post is from the WWDC26 Foundation Models Q&A.

What’s Apple’s guidance for using on-device models to turn structured JSON (time series, metrics, units) into a one-line natural-language summary without inventing values?

Answered by Frameworks Engineer in 893006022

I would look at the Guided Generation talk in "Meet Foundation Models" from last year.

Additionally, adding tools that can do calculations for the model (i.e. average, sum, etc) instead of the model trying to do them can help as well.

Answer 1

Frameworks Engineer OP

Apple

1d

Recommended

I would look at the Guided Generation talk in "Meet Foundation Models" from last year.

Additionally, adding tools that can do calculations for the model (i.e. average, sum, etc) instead of the model trying to do them can help as well.