Scenario definition · S109

The teacher checks what the class struggled with

A teacher reviews class performance to see which topic or question area the learners struggled with.

What this scenario means

This scenario checks whether a class report reflects how multiple learners actually performed on the same quiz. A good system keeps the weaker area visible, shows it as worse than the stronger area, and stays aligned with the recorded attempts and completion data. It should not flatten the result into one overall impression or reverse the pattern of strengths and weaknesses.

What we evaluate

  • Whether the report matches the underlying learner attempts and completion records.
  • Whether the weaker topic or question area is shown as performing worse than the stronger area.
  • Whether the performance difference stays visible instead of being erased or inverted.
◌Test-case detail. Exact wording, inputs, fixture state, expected output and detailed grading remain at the test-case level and may be withheld while the benchmark version is active. The scenario and its evaluation intent are public.

Capabilities this scenario exercises

A scenario may exercise one or more capabilities.

Capability

Class Reports

Shows teachers how learners performed and which questions or topics the class struggled with

Benchmarks that use this scenario

A scenario has global identity and may be reused across benchmarks.

The teacher checks what the class struggled with — Scenario definition | AI Demos