Scenario definition · S68
The same field across layouts
The same requested field appears in documents laid out differently.
What this scenario means
This scenario checks whether field extraction stays correct when layout changes. A good system finds the same field, keeps its identity and value stable, and does not confuse spacing, label position, or formatting changes with a different answer.
What we evaluate
- Whether the same field is extracted correctly from documents with different layouts.
- Whether layout changes do not change the field’s identity or the value returned.
- Whether the returned value remains correctly typed across layouts.
- Whether the tool avoids treating a layout change as a missing or different field.
◌Test-case detail. Exact wording, inputs, fixture state, expected output and detailed grading remain at the test-case level and may be withheld while the benchmark version is active. The scenario and its evaluation intent are public.
Capabilities this scenario exercises
A scenario may exercise one or more capabilities.
Field Extraction
Returns the scalar fields the schema asks for — present, interpreted, derived, absent or differently laid out — correctly typed.
Benchmarks that use this scenario
A scenario has global identity and may be reused across benchmarks.
Structured Document Extraction
Which document extraction platform turns a user-defined schema into correct structured records — across layouts, scans and repeated sets — and is honest about what it could not find?