Scenario definition · S38

A document containing a code block

A document contains a code block.

What this scenario means

Code is layout-sensitive, so a conversion can keep the words but still break them by stripping indentation, line breaks, or block structure. This scenario checks that code stays a distinct preformatted block, so it remains readable and usable after conversion.

What we evaluate

  • Whether the code remains a distinct preformatted or fenced block.
  • Whether line breaks and indentation are preserved.
  • Whether the code is not reflowed into ordinary prose.
  • Whether the code block is still recognisable as code rather than flattened text.
◌Test-case detail. Exact wording, inputs, fixture state, expected output and detailed grading remain at the test-case level and may be withheld while the benchmark version is active. The scenario and its evaluation intent are public.

Capabilities this scenario exercises

A scenario may exercise one or more capabilities.

Capability

Code Extraction

Preformatted code, whose whitespace and line structure ARE meaning; a fenced code block, not LaTeX — code reflowed into prose is broken for every downstream use

Benchmarks that use this scenario

A scenario has global identity and may be reused across benchmarks.

A document containing a code block — Scenario definition | AI Demos