Scenario definition · S103

The learner answers correctly in their own words

A response is judged by the meaning it conveys, not by matching the reference wording exactly.

What this scenario means

This situation tests whether a written response is accepted when it contains all required meaning in different words. A good system compares the response with the reference idea, not the exact phrasing, and treats equivalent wording as correct while still recognising responses that leave out required meaning.

What we evaluate

  • Whether the response is accepted when it expresses all required meaning in different wording.
  • Whether wording differences alone do not change a correct response into an incorrect one.
  • Whether a response that omits required meaning is not treated as correct.
◌Test-case detail. Exact wording, inputs, fixture state, expected output and detailed grading remain at the test-case level and may be withheld while the benchmark version is active. The scenario and its evaluation intent are public.

Capabilities this scenario exercises

A scenario may exercise one or more capabilities.

Capability

Grading

Determines how correctly a learner answered, including fixed-answer scoring, semantically equivalent wording, and partial understanding

Benchmarks that use this scenario

A scenario has global identity and may be reused across benchmarks.

The learner answers correctly in their own words — Scenario definition | AI Demos