The set is legitimately empty
A document explicitly indicates that a repeated set contains no items.
What this scenario means
This tests whether the tool treats an explicit no-items signal as a valid empty result rather than a missing record. A good agent returns an empty set for the repeated field, preserves the schema shape, and does not invent a row to fill the gap.
What we evaluate
- Whether it returns an empty set or empty array for the repeated field.
- Whether it avoids inventing any member when the document says there are none.
- Whether it preserves the schema-required shape for the field.
Capabilities this scenario exercises
A scenario may exercise one or more capabilities.
Nested & Repeated Fields
Returns repeated sets of records completely, with each value under the right record: none dropped, none invented, none cross-bound. ON TRIAL: merges back into Field Extraction if precision and recall do not actually diverge on repeated sets.
Benchmarks that use this scenario
A scenario has global identity and may be reused across benchmarks.
Structured Document Extraction
Which document extraction platform turns a user-defined schema into correct structured records — across layouts, scans and repeated sets — and is honest about what it could not find?