Trace a value to its location
A returned value must be linked to the place in the document where it came from.
What this scenario means
This tests whether a system can ground an extracted value in the source document. It is hard because the tool must point to the actual origin of the returned value, not just repeat the value or name the document. A good agent gives a location that matches what it returned and keeps that link clear.
What we evaluate
- Whether the tool points to the document location that matches the returned value.
- Whether the location is attached to the value it actually returned, not to a different one.
- Whether the tool gives a source location rather than only repeating the value or naming the document.
Capabilities this scenario exercises
A scenario may exercise one or more capabilities.
Source Grounding
Points to where a returned value came from — and attaches NO pointer to a value that wasn't there.
Benchmarks that use this scenario
A scenario has global identity and may be reused across benchmarks.
Structured Document Extraction
Which document extraction platform turns a user-defined schema into correct structured records — across layouts, scans and repeated sets — and is honest about what it could not find?