Repair a record
A correction workflow repairs an extracted record by adding a needed member and removing an unwanted one.
What this scenario means
This tests whether a tool can edit structured extraction output without breaking the rest of the record. The hard part is that the repair changes membership in the set, not just a field value, and the corrected result must remain the stored version. A good tool applies the intended addition, removes the wrong member, and leaves the other extracted data untouched.
What we evaluate
- Whether the repaired set includes the intended member.
- Whether the repaired set no longer includes the unintended member.
- Whether the remaining members stay unchanged.
- Whether the corrected record persists after the repair is saved or passed on.
Capabilities this scenario exercises
A scenario may exercise one or more capabilities.
Review and Correction
A human fix reaches the stored record and the systems downstream of it.
Benchmarks that use this scenario
A scenario has global identity and may be reused across benchmarks.
Structured Document Extraction
Which document extraction platform turns a user-defined schema into correct structured records — across layouts, scans and repeated sets — and is honest about what it could not find?