Tool in benchmark · Version 1

Adobe PDF Extract API in Converting a complex PDF into clean Markdown with a hosted API

Scenario-level performance from current published Results.

6Passed
2Failed
4No published Result yet

8 of 12 scenarios published

CapabilityScenariosResult
Code Extraction0 pass · 1 fail · 1 of 1 published
Equations & Mathematical Notation1 pass · 0 fail · 1 of 1 published
Figures & Charts1 pass · 0 fail · 1 of 2 published
Heading & Section Structure2 pass · 0 fail · 2 of 2 published
Reading Order & Layout1 pass · 0 fail · 1 of 1 published
Table Extraction1 pass · 0 fail · 1 of 2 published
Text Fidelity0 pass · 1 fail · 1 of 1 published
Scanned Document OCR0 of 2 published
PassedFailedPublished, different test setNo published Result yet

Where Adobe PDF Extract API failed

2 of 8 graded scenarios. Open a Result to see the conversation and the evidence.

Code Extraction

A document containing a code block

Adobe PDF Extract API did not preserve the code block as a preformatted or fenced block. The nine-line Python block was collapsed into five ordinary paragraphs, the shell block into two lines, and no output line carried leading whitespace. The whitespace-insensitive character content still matched the source, but the block structure was lost.

View Result →
Text Fidelity

An ordinary digital text document

Adobe PDF Extract API did not keep the document text unchanged. Its Extract output joined the running header to the document title and to a sentence continuing onto page 2; no words were missing or invented.

View Result →

How Adobe PDF Extract API performed

Open a capability to explore its scenarios. Each row reports the test set in its published Result.

Code Extraction1 fail
ScenarioPublished outcomesTest coverageResult
A document containing a code block
0 Pass1 Fail0 Not gradable
1 of 1 test case failed
What happened

Adobe PDF Extract API did not preserve the code block as a preformatted or fenced block. The nine-line Python block was collapsed into five ordinary paragraphs, the shell block into two lines, and no output line carried leading whitespace. The whitespace-insensitive character content still matched the source, but the block structure was lost.

1/1 assessed1/1 gradablePublished test setView Result →
Equations & Mathematical Notation1 pass
ScenarioPublished outcomesTest coverageResult
A document containing mathematical equations
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

Adobe PDF Extract API preserved the equations in the three-page PDF as linked figure images in the generated Markdown. The page shows each equation in place with its number beneath it, and the figure images keep fractions, superscripts, subscripts, and absolute-value bars intact; there are no LaTeX, MathML, or $ delimiters.

1/1 assessed1/1 gradablePublished test setView Result →
Figures & Charts1 pass1 no Result yet
ScenarioPublished outcomesTest coverageResult
A document with a data chart
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

Adobe PDF Extract API preserved the chart as an image with its title. It did not add the chart's data as text.

1/1 assessed1/1 gradablePublished test setView Result →
A document with figures and captionsNo published result
Heading & Section Structure2 pass
ScenarioPublished outcomesTest coverageResult
A document with styled headings and subheadings
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

Adobe PDF Extract API preserved the styled heading hierarchy in the Markdown produced for this test. Its structured output supplied three heading levels, retaining the source’s order and nesting.

1/1 assessed1/1 gradablePublished test setView Result →
Footnotes at the bottom of the page
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

Adobe PDF Extract API preserved the footnotes and their links to the text they annotate. The structured output kept all 13 numbered notes outside the body flow, with their associations retained by number.

1/1 assessed1/1 gradablePublished test setView Result →
Reading Order & Layout1 pass
ScenarioPublished outcomesTest coverageResult
A page laid out in multiple columns
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

Adobe PDF Extract API preserved the natural reading order of the two-column pages. In the Markdown assembled from its response, sections followed the source columns and sentences continued across the column breaks on pages 1 and 2.

1/1 assessed1/1 gradablePublished test setView Result →
Table Extraction1 pass1 no Result yet
ScenarioPublished outcomesTest coverageResult
A simple, clearly formatted table
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

Adobe PDF Extract API preserved the simple table’s structure and values in the Markdown produced for this test. All four headings and 32 data cells matched the source.

1/1 assessed1/1 gradablePublished test setView Result →
A table that continues across a page breakNo published result
Text Fidelity1 fail
ScenarioPublished outcomesTest coverageResult
An ordinary digital text document
0 Pass1 Fail0 Not gradable
1 of 1 test case failed
What happened

Adobe PDF Extract API did not keep the document text unchanged. Its Extract output joined the running header to the document title and to a sentence continuing onto page 2; no words were missing or invented.

1/1 assessed1/1 gradablePublished test setView Result →
Scanned Document OCR2 no Result yet
ScenarioPublished outcomesTest coverageResult
A cleanly scanned documentNo published result
A document mixing digital and scanned pagesNo published result

Reading these Results

Published evidence and test coverage answer different questions.

Publication availability

Which scenarios have a Result?

A published Result is public evidence for this tool on one scenario. “No published result” does not say whether testing has taken place.

Test coverage

What does each Result cover?

Assessed includes Pass, Fail and Not gradable. Gradable includes Pass and Fail. Both use the pinned test count in that published Result.

Scenario scope

Out of 12 scenarios

The summary counts each of the 12 scenarios once. A scenario fails when any of its published test cases failed. “No published Result yet” means nothing is public for that scenario; it does not say whether Adobe PDF Extract API was tested on it.

Adobe PDF Extract API in Converting a complex PDF into clean Markdown with a hosted API | AI Demos