Scenario definition · S37

A document containing mathematical equations

A document containing mathematical equations is handled as mathematics, not flattened into ordinary prose.

What this scenario means

This scenario checks whether equation structure survives in a usable mathematical form. Equations are meaning-bearing, so turning them into plain prose can change or lose their content. A good system keeps the equations recognisably mathematical, either as LaTeX or MathML, or else says honestly that it cannot preserve them fully.

What we evaluate

  • Whether the equations remain represented as math rather than being flattened into ordinary prose.
  • Whether the mathematical structure is preserved well enough to stay readable and recoverable.
  • Whether any limitation is stated honestly through a clear fallback instead of silent corruption.
◌Test-case detail. Exact wording, inputs, fixture state, expected output and detailed grading remain at the test-case level and may be withheld while the benchmark version is active. The scenario and its evaluation intent are public.

Capabilities this scenario exercises

A scenario may exercise one or more capabilities.

Capability

Equations & Mathematical Notation

Formal notation whose structure is its meaning; degraded math is misstated math — output contract: LaTeX/MathML or an honest fallback

Benchmarks that use this scenario

A scenario has global identity and may be reused across benchmarks.

A document containing mathematical equations — Scenario definition | AI Demos