<!--
{
  "availability" : [
    "iOS: 27.3.0 -",
    "iPadOS: 27.3.0 -",
    "macOS: 27.3.0 -",
    "visionOS: 27.3.0 -"
  ],
  "documentType" : "symbol",
  "framework" : "SiriEvaluations",
  "identifier" : "/documentation/SiriEvaluations/SiriExpectationEvaluator",
  "metadataVersion" : "0.1.0",
  "role" : "Structure",
  "symbol" : {
    "kind" : "Structure",
    "modules" : [
      "Siri Evaluations"
    ],
    "preciseIdentifier" : "s:15SiriEvaluations0A20ExpectationEvaluatorV"
  },
  "title" : "SiriExpectationEvaluator"
}
-->

# SiriExpectationEvaluator

An evaluator that grades a scenario against its expectations.

```
struct SiriExpectationEvaluator
```

## Overview

It reports the metrics of each kind of expectation — [`Calls`](/documentation/SiriEvaluations/Calls), [`Finds`](/documentation/SiriEvaluations/Finds), [`OnScreen`](/documentation/SiriEvaluations/OnScreen),
[`SiriResponse`](/documentation/SiriEvaluations/SiriResponse) and [`Loads`](/documentation/SiriEvaluations/Loads); a `Loads(.preferred)` is shown in the report but never graded.
Return it from your evaluation’s `evaluators`, alone or with graders of your own, and call
`computeSiriMetrics(into:)` from `aggregateMetrics(using:)` to show its metrics as the report’s
summary cards.

## Topics

### Creating an evaluator

[`init()`](/documentation/SiriEvaluations/SiriExpectationEvaluator/init())

Creates an evaluator that grades a scenario against its expectations.

### Grading a scenario

[`func metrics(subject: SiriScenarioSubject, input: SiriScenario) async throws -> [Metric]`](/documentation/SiriEvaluations/SiriExpectationEvaluator/metrics(subject:input:))

Returns the metrics from grading the scenario’s expectations against its transcript.

## Relationships

### Conforms To

[`EvaluatorProtocol`](/documentation/Evaluations/EvaluatorProtocol)

[`Sendable`](/documentation/Swift/Sendable)

[`SendableMetatype`](/documentation/Swift/SendableMetatype)

---

Copyright &copy; 2026 Apple Inc. All rights reserved. | [Terms of Use](https://www.apple.com/legal/internet-services/terms/site.html) | [Privacy Policy](https://www.apple.com/privacy/privacy-policy)