Scenario definition · S67

The value must be derived

A requested value is not stated directly, but can be inferred or computed from values that are present.

What this scenario means

This scenario tests whether the tool can produce a field whose answer is implied by other information in the document rather than copied from a single line. It is hard because the right output is not visibly printed, so the tool must combine the provided values and return the inferred field without guessing.

What we evaluate

  • Whether the tool derives a requested field from values already present in the document.
  • Whether it returns the inferred value when the schema asks for something not stated directly.
  • Whether it distinguishes a computed answer from a value copied verbatim from the page.
◌Test-case detail. Exact wording, inputs, fixture state, expected output and detailed grading remain at the test-case level and may be withheld while the benchmark version is active. The scenario and its evaluation intent are public.

Capabilities this scenario exercises

A scenario may exercise one or more capabilities.

Capability

Field Extraction

Returns the scalar fields the schema asks for — present, interpreted, derived, absent or differently laid out — correctly typed.

Benchmarks that use this scenario

A scenario has global identity and may be reused across benchmarks.

The value must be derived — Scenario definition | AI Demos