Scenario definition · S77
Corrected data goes downstream
After a record is corrected, a later downstream read shows the corrected value.
What this scenario means
This tests whether a tool carries a human correction through to what it returns later, instead of falling back to the original extraction. A good tool reflects the updated record in the later read, so the fix is visible beyond the moment it was entered.
What we evaluate
- Whether a later read returns the corrected value rather than the original extraction.
- Whether the downstream read reflects the updated record after correction.
- Whether the tool continues to show the correction when the record is read again later.
◌Test-case detail. Exact wording, inputs, fixture state, expected output and detailed grading remain at the test-case level and may be withheld while the benchmark version is active. The scenario and its evaluation intent are public.
Capabilities this scenario exercises
A scenario may exercise one or more capabilities.
Review and Correction
A human fix reaches the stored record and the systems downstream of it.
Benchmarks that use this scenario
A scenario has global identity and may be reused across benchmarks.
Structured Document Extraction
Which document extraction platform turns a user-defined schema into correct structured records — across layouts, scans and repeated sets — and is honest about what it could not find?