Scenario in benchmark · Version 1
The field is absent
The requested fact is absent and not implied by the document.
Capability: Field Extraction, Source Grounding1 pinned test caseRead the neutral global definition →
How the tools performed
Every in-scope tool is visible. Outcomes come from current published Results for this scenario and benchmark version.
Publication availability: 4 tools have a current published Result.
No published result does not tell you whether a tool has been tested. Test coverage is shown only for comparable published Results.
| Tool | Published outcomes | Test coverage | Result |
|---|---|---|---|
| Published Results · alphabetical, not ranked | |||
| Docsumo | 1 Pass0 Fail0 Not gradable 1 of 1 test case passed | 1 of 1 assessed1 of 1 gradable | View Result → |
| FutureSmart Document Intelligence | 1 Pass0 Fail0 Not gradable 1 of 1 test case passed | 1 of 1 assessed1 of 1 gradable | View Result → |
| Landing AI | 1 Pass0 Fail0 Not gradable 1 of 1 test case passed | 1 of 1 assessed1 of 1 gradable | View Result → |
| LlamaParse | 1 Pass0 Fail0 Not gradable 1 of 1 test case passed | 1 of 1 assessed1 of 1 gradable | View Result → |
| No published result · alphabetical | |||
| Datalab | — | — | No published result |
| Extend AI | — | — | No published result |
| Nanonets | — | — | No published result |
| Reducto | — | — | No published result |
| Retab | — | — | No published result |
| Unstract | — | — | No published result |
Assessed = Pass + Fail + Not gradable. Gradable = Pass + Fail. Both use the published Result’s pinned-test denominator. — means not publicly available.
Test design
- Pinned test cases
- 1
- Disclosure
- 0 public · 1 withheld
- Capabilities exercised here
- Field Extraction, Source Grounding
What this scenario evaluates
- Whether the output gives an honest null or absence response for the missing fact.
- Whether the output avoids inventing a value for the absent fact.
- Whether any invented value is left without a pointer or other grounding evidence.
Specific test-case inputs and grading live on the related test-case pages.
How the results are graded
- Pass: the test-case expectations hold.
- Fail: an expectation demonstrably does not hold.
- Not gradable: the evidence cannot establish the outcome.
Version 1 uses test-case expectations; no scenario rubric is pinned.
Benchmark methodology →