The value is directly available
A document contains one plainly labelled scalar field, and the task is to extract and return that value.
What this scenario means
This scenario tests direct extraction when the answer is already stated in the document. It checks whether the tool can identify the labelled field, ignore surrounding noise, and return the requested value without guessing or adding extra interpretation. A good agent treats this as the baseline case for field extraction and answers from the document itself.
What we evaluate
- Whether the tool returns the value attached to the plainly labelled field.
- Whether it ignores unrelated text and does not invent a different answer.
- Whether it treats the task as direct extraction rather than inference or correction.
Capabilities this scenario exercises
A scenario may exercise one or more capabilities.
Field Extraction
Returns the scalar fields the schema asks for — present, interpreted, derived, absent or differently laid out — correctly typed.
Benchmarks that use this scenario
A scenario has global identity and may be reused across benchmarks.
Structured Document Extraction
Which document extraction platform turns a user-defined schema into correct structured records — across layouts, scans and repeated sets — and is honest about what it could not find?