The field is absent
The requested fact is absent and not implied by the document.
What this scenario means
This is the one run graded twice: Field Extraction checks for an honest null or absence response when the requested fact is absent and not implied, and Source Grounding checks that no pointer or evidence is attached to anything invented.
What we evaluate
- Whether the output gives an honest null or absence response for the missing fact.
- Whether the output avoids inventing a value for the absent fact.
- Whether any invented value is left without a pointer or other grounding evidence.
Capabilities this scenario exercises
A scenario may exercise one or more capabilities.
Field Extraction
Returns the scalar fields the schema asks for — present, interpreted, derived, absent or differently laid out — correctly typed.
Source Grounding
Points to where a returned value came from — and attaches NO pointer to a value that wasn't there.
Benchmarks that use this scenario
A scenario has global identity and may be reused across benchmarks.
Structured Document Extraction
Which document extraction platform turns a user-defined schema into correct structured records — across layouts, scans and repeated sets — and is honest about what it could not find?