Tool in benchmark · Version 1

Landing AI in Structured Document Extraction

Scenario-level performance from current published Results.

12 scenarios with published Results · 19 scenarios in the benchmark

How Landing AI performed

Open a capability to explore its scenarios. Each row reports the test set in its published Result; counts are not combined into an overall score.

Field Extraction5 scenarios · 4 with published Results
ScenarioPublished outcomesTest coverageResult
The field is absent
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

Landing AI passed this scenario by returning an honest null for the absent field. The metadata showed no source range for that field. The receipt number was returned as RHS-70234, with a source range shown in the metadata.

1/1 assessed1/1 gradablePublished test setView Result →
The same field across layouts
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

Landing AI passed this scenario. It returned the correct owed amount from three documents with different layouts: $90.10 from the receipt, $227.33 from the invoice, and USD 157.50 from the other receipt. The screenshots show each value highlighted in the viewer and the same single String field in the schema.

1/1 assessed1/1 gradablePublished test setView Result →
The value is directly available
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

Landing AI passed this plain-field extraction case. It returned the receipt number as a string, and the source span was highlighted on the page; the input showed one receipt number and no competing same-type value nearby.

1/1 assessed1/1 gradablePublished test setView Result →
The value must be derived
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

Landing AI derived the requested value in this scenario. The invoice shows DISTANCE 450 miles and FUEL RATE £0.18 per mile; the JSON returns fuel_cost as GBP 81.00, and the document text does not contain 81.00. The playground screen shows the same result beside a one-field schema.

1/1 assessed1/1 gradablePublished test setView Result →
The value needs a supplied definitionNo published result
Nested & Repeated Fields4 scenarios · 4 with published Results
ScenarioPublished outcomesTest coverageResult
A repeated set of records
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

Landing AI extracted the repeated set of records in this run. The invoice table on page 3 returned three line items with the correct values and pairing; the delivery note says there were three lines and six units, and the schema asked for description and amount only.

1/1 assessed1/1 gradablePublished test setView Result →
The set contains a non-record
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

Landing AI left the non-record out of the extracted set in the tested invoice. The output contained five members, matching the five numbered rows, and it did not include the separate Total row or its 1,982.00 amount. The schema description shown in the capture was neutral.

1/1 assessed1/1 gradablePublished test setView Result →
The set continues across a page break
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

Landing AI kept the repeated set in one array when the data crossed a page break. In the checked case, ten line items appeared in document order with no duplicate at the boundary, and the results panel showed the array opening once and closing once. No other case is reported here.

1/1 assessed1/1 gradablePublished test setView Result →
The set is legitimately empty
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

Landing AI returned an empty set when the document said there were none this period. In the checked PDF page, the source text said no damage or exceptions were reported, and the export showed an empty array. The schema pane showed the field as a required array, and the output did not turn the marker text into a member.

1/1 assessed1/1 gradablePublished test setView Result →
OCR2 scenarios · 1 with published Results
ScenarioPublished outcomesTest coverageResult
A document mixing digital and scanned pages
0 Pass1 Fail0 Not gradable
1 of 1 test case failed
What happened

Landing AI failed this mixed digital-and-scanned PDF case. All four fields came back, and the scanned-page values were exact, but the total due returned as "#1,246.80" even though the page text and rendering show "£1,246.80"; the run also carried both parse and extract ids.

1/1 assessed1/1 gradablePublished test setView Result →
A cleanly scanned documentNo published result
Querying3 scenarios · 3 with published Results
ScenarioPublished outcomesTest coverageResult
Aggregate across documents
0 Pass1 Fail0 Not gradable
1 of 1 test case failed
What happened

Landing AI fails to total across uploaded documents. Chat answered with one file’s own amount or refused, and Extract returned each invoice’s own total in the cross-document field instead of one combined sum.

1/1 assessed1/1 gradablePublished test setView Result →
Filter records across documents
0 Pass1 Fail0 Not gradable
1 of 1 test case failed
What happened

Landing AI failed to filter records across extracted documents. Chat refused the request, and the interface only showed one document at a time with no filter or query control; the receipts themselves were extracted correctly, including two above 150 and one below.

1/1 assessed1/1 gradablePublished test setView Result →
The answer was never in the schema
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

Landing AI passed this scenario. It answered the technician question with Renata Kowalski and showed clickable references to the receipt’s page text, while the receipt itself prints that name. Chat is experimental, works on one file at a time, and has no API, so the result is scoped to the web app.

1/1 assessed1/1 gradablePublished test setView Result →
Source Grounding2 scenarios · 1 with published Results
ScenarioPublished outcomesTest coverageResult
The field is absent
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

Landing AI passed this scenario by returning an honest null for the absent field. The metadata showed no source range for that field. The receipt number was returned as RHS-70234, with a source range shown in the metadata.

1/1 assessed1/1 gradablePublished test setView Result →
Trace a value to its locationNo published result
Review and Correction3 scenarios · 0 with published Results
ScenarioPublished outcomesTest coverageResult
Correct a field valueNo published result
Corrected data goes downstreamNo published result
Repair a recordNo published result
Training1 scenario · 0 with published Results
ScenarioPublished outcomesTest coverageResult
A field the tool can only get right from examplesNo published result

Reading these Results

Published evidence and test coverage answer different questions.

Publication availability

Which scenarios have a Result?

A published Result is public evidence for this tool on one scenario. “No published result” does not say whether testing has taken place.

Test coverage

What does each Result cover?

Assessed includes Pass, Fail and Not gradable. Gradable includes Pass and Fail. Both use the pinned test count in that published Result.

Scenario scope

Inventory is not testing progress

The 19 scenarios describe this benchmark’s scope. They are not an assumed applicability or test-coverage denominator for Landing AI.

Landing AI in Structured Document Extraction | AI Demos