MarkItDown in Converting a complex PDF into clean Markdown with an open-source library
Scenario-level performance from current published Results.
3 of 12 scenarios published
Where MarkItDown failed
2 of 3 graded scenarios. Open a Result to see the conversation and the evidence.
A document containing mathematical equations
MarkItDown corrupted all six equations rather than preserving them as math or providing an honest fallback. Fractions, exponents and subscripts became disordered fragments, while the surrounding prose remained accurate.
View Result →A cleanly scanned document
MarkItDown fails to recover text from the clean scanned document. It returned an empty Markdown file and exited successfully, while the input is a legible image-only scan with no text layer.
View Result →How MarkItDown performed
Open a capability to explore its scenarios. Each row reports the test set in its published Result.
Equations & Mathematical Notation1 fail
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| A document containing mathematical equations | 0 Pass1 Fail0 Not gradable 1 of 1 test case failedWhat happenedMarkItDown corrupted all six equations rather than preserving them as math or providing an honest fallback. Fractions, exponents and subscripts became disordered fragments, while the surrounding prose remained accurate. | 1/1 assessed1/1 gradablePublished test set | View Result → |
Heading & Section Structure1 pass1 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| Footnotes at the bottom of the page | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedMarkItDown kept all 13 footnotes separate from the body text and associated with their in-text references. The notes followed their pages’ body text, with all 13 reference numbers preserved. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| A document with styled headings and subheadings | No published result | ||
Scanned Document OCR1 fail1 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| A cleanly scanned document | 0 Pass1 Fail0 Not gradable 1 of 1 test case failedWhat happenedMarkItDown fails to recover text from the clean scanned document. It returned an empty Markdown file and exited successfully, while the input is a legible image-only scan with no text layer. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| A document mixing digital and scanned pages | No published result | ||
Code Extraction1 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| A document containing a code block | No published result | ||
Figures & Charts2 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| A document with a data chart | No published result | ||
| A document with figures and captions | No published result | ||
Reading Order & Layout1 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| A page laid out in multiple columns | No published result | ||
Table Extraction2 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| A simple, clearly formatted table | No published result | ||
| A table that continues across a page break | No published result | ||
Text Fidelity1 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| An ordinary digital text document | No published result | ||
Reading these Results
Published evidence and test coverage answer different questions.
Which scenarios have a Result?
A published Result is public evidence for this tool on one scenario. “No published result” does not say whether testing has taken place.
What does each Result cover?
Assessed includes Pass, Fail and Not gradable. Gradable includes Pass and Fail. Both use the pinned test count in that published Result.
Out of 12 scenarios
The summary counts each of the 12 scenarios once. A scenario fails when any of its published test cases failed. “No published Result yet” means nothing is public for that scenario; it does not say whether MarkItDown was tested on it.