Landing AI in Structured Document Extraction
Scenario-level performance from current published Results.
12 scenarios with published Results · 19 scenarios in the benchmark
How Landing AI performed
Open a capability to explore its scenarios. Each row reports the test set in its published Result; counts are not combined into an overall score.
Field Extraction5 scenarios · 4 with published Results
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| The field is absent | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedLanding AI passed this scenario by returning an honest null for the absent field. The metadata showed no source range for that field. The receipt number was returned as RHS-70234, with a source range shown in the metadata. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The same field across layouts | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedLanding AI passed this scenario. It returned the correct owed amount from three documents with different layouts: $90.10 from the receipt, $227.33 from the invoice, and USD 157.50 from the other receipt. The screenshots show each value highlighted in the viewer and the same single String field in the schema. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The value is directly available | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedLanding AI passed this plain-field extraction case. It returned the receipt number as a string, and the source span was highlighted on the page; the input showed one receipt number and no competing same-type value nearby. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The value must be derived | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedLanding AI derived the requested value in this scenario. The invoice shows DISTANCE 450 miles and FUEL RATE £0.18 per mile; the JSON returns fuel_cost as GBP 81.00, and the document text does not contain 81.00. The playground screen shows the same result beside a one-field schema. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The value needs a supplied definition | No published result | ||
Nested & Repeated Fields4 scenarios · 4 with published Results
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| A repeated set of records | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedLanding AI extracted the repeated set of records in this run. The invoice table on page 3 returned three line items with the correct values and pairing; the delivery note says there were three lines and six units, and the schema asked for description and amount only. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The set contains a non-record | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedLanding AI left the non-record out of the extracted set in the tested invoice. The output contained five members, matching the five numbered rows, and it did not include the separate Total row or its 1,982.00 amount. The schema description shown in the capture was neutral. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The set continues across a page break | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedLanding AI kept the repeated set in one array when the data crossed a page break. In the checked case, ten line items appeared in document order with no duplicate at the boundary, and the results panel showed the array opening once and closing once. No other case is reported here. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The set is legitimately empty | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedLanding AI returned an empty set when the document said there were none this period. In the checked PDF page, the source text said no damage or exceptions were reported, and the export showed an empty array. The schema pane showed the field as a required array, and the output did not turn the marker text into a member. | 1/1 assessed1/1 gradablePublished test set | View Result → |
OCR2 scenarios · 1 with published Results
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| A document mixing digital and scanned pages | 0 Pass1 Fail0 Not gradable 1 of 1 test case failedWhat happenedLanding AI failed this mixed digital-and-scanned PDF case. All four fields came back, and the scanned-page values were exact, but the total due returned as "#1,246.80" even though the page text and rendering show "£1,246.80"; the run also carried both parse and extract ids. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| A cleanly scanned document | No published result | ||
Querying3 scenarios · 3 with published Results
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| Aggregate across documents | 0 Pass1 Fail0 Not gradable 1 of 1 test case failedWhat happenedLanding AI fails to total across uploaded documents. Chat answered with one file’s own amount or refused, and Extract returned each invoice’s own total in the cross-document field instead of one combined sum. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| Filter records across documents | 0 Pass1 Fail0 Not gradable 1 of 1 test case failedWhat happenedLanding AI failed to filter records across extracted documents. Chat refused the request, and the interface only showed one document at a time with no filter or query control; the receipts themselves were extracted correctly, including two above 150 and one below. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The answer was never in the schema | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedLanding AI passed this scenario. It answered the technician question with Renata Kowalski and showed clickable references to the receipt’s page text, while the receipt itself prints that name. Chat is experimental, works on one file at a time, and has no API, so the result is scoped to the web app. | 1/1 assessed1/1 gradablePublished test set | View Result → |
Source Grounding2 scenarios · 1 with published Results
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| The field is absent | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedLanding AI passed this scenario by returning an honest null for the absent field. The metadata showed no source range for that field. The receipt number was returned as RHS-70234, with a source range shown in the metadata. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| Trace a value to its location | No published result | ||
Review and Correction3 scenarios · 0 with published Results
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| Correct a field value | No published result | ||
| Corrected data goes downstream | No published result | ||
| Repair a record | No published result | ||
Training1 scenario · 0 with published Results
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| A field the tool can only get right from examples | No published result | ||
Reading these Results
Published evidence and test coverage answer different questions.
Which scenarios have a Result?
A published Result is public evidence for this tool on one scenario. “No published result” does not say whether testing has taken place.
What does each Result cover?
Assessed includes Pass, Fail and Not gradable. Gradable includes Pass and Fail. Both use the pinned test count in that published Result.
Inventory is not testing progress
The 19 scenarios describe this benchmark’s scope. They are not an assumed applicability or test-coverage denominator for Landing AI.