Scenario definition · S97

Important information appears in both text and a diagram

The material contains essential information in written text and a diagram, and both parts matter.

What this scenario means

This scenario checks whether a quiz covers information that is split across two representations. A good system must use both the text and the diagram, because each carries part of the core content needed for a valid assessment. The challenge is to keep the quiz answerable while not dropping or misreading information shown only in one form.

What we evaluate

  • Whether the quiz assesses core information from the written text and the diagram.
  • Whether the questions stay supported when the needed content is split across both forms.
  • Whether essential information shown only in one form is not omitted from coverage.
  • Whether the answer or evaluation information aligns with both parts of the material.
◌Test-case detail. Exact wording, inputs, fixture state, expected output and detailed grading remain at the test-case level and may be withheld while the benchmark version is active. The scenario and its evaluation intent are public.

Capabilities this scenario exercises

A scenario may exercise one or more capabilities.

Capability

Quiz Generation

Creates valid quizzes from supplied material that test the intended knowledge and include sufficient information for answers to be evaluated

Benchmarks that use this scenario

A scenario has global identity and may be reused across benchmarks.

Important information appears in both text and a diagram — Scenario definition | AI Demos