Scenario definition · S50

The answer is a plain fact or a short list

When an answer is a single value or short list, it should be stated plainly rather than shown as a chart or one-cell table.

What this scenario means

This scenario checks whether the agent chooses the lightest presentation that fits the answer. A good agent keeps a plain fact or short list in plain form, instead of adding display structure that does not help the user. The challenge is not the content of the answer, but whether the presentation matches its shape.

What we evaluate

  • Whether the reply states a single value or short list directly in plain text.
  • Whether the reply avoids over-presenting that answer as a chart or one-cell table.
  • Whether the form used fits the answer without adding unnecessary structure.
◌Test-case detail. Exact wording, inputs, fixture state, expected output and detailed grading remain at the test-case level and may be withheld while the benchmark version is active. The scenario and its evaluation intent are public.

Capabilities this scenario exercises

A scenario may exercise one or more capabilities.

Capability

Answer Presentation

Decides and adjusts how the answer is represented — prose, a table, a chart, or a combination — and changes it on request.

Benchmarks that use this scenario

A scenario has global identity and may be reused across benchmarks.

The answer is a plain fact or a short list — Scenario definition | AI Demos