Section hierarchy and reading flow are preserved in the scanned paper, keeping headings and supporting paragraphs correctly connected despite the multi-column layout.
What was measured
Reading Order & Structure
Maintains headings, sections, column order, document hierarchy, and overall flow.
decisive for this rankingtransformation
Clean Markdown requires the original reading order, headings, sections, and hierarchy to be maintained correctly. (3 of 3 judges)
What was given, what came back
Test input: Scanned Research Paper · pdf · group: scanned-research-paper
Input — what we sent
An image-only scanned research paper used to stress OCR and layout recovery in a multi-column academic document with figures, charts, tables, captions, and references.
Why this input is hard
- · OCR on scanned pages
- · Multi-column reading order
- · Figure and chart handling
- · Table reconstruction from scans
- · Caption association
- · Reference extraction
- · Overall document structure retention
Output — unretouched
Also checked on this input — same tool, 6 other criteria
Complex Document Handling✓ WorkedThe tool processes a scanned multi-column research paper end-to-end and returns OCR text, tables, and embedded chart assets in page-wise markdown output.Markdown Quality✓ WorkedThe export is packaged as usable markdown files in a ZIP, with both overall and page-wise outputs available for inspection.Table Preservation✓ WorkedThe multicolumn table is reconstructed without losing its overall layout logic, so the table structure remains readable in the parsed output.Table Preservation✗ FailedBroken column boundaries and disrupted value alignment make the reconstructed table significantly less faithful to the source.Text & OCR Completeness◐ MixedThe report says the parser recovers much of the underlying text from the scanned paper, but it does not present a measured completeness rate and the first-page hierarchy is still lossy.Visual Content Retention✓ WorkedCharts are exposed through both page-wise markdown files and the extracted visual assets, keeping the visual content linked to its original document location.
Provenance
- Observation
- a70898cf-5c39-40b0-a6b8-0f49144c92b1
- Evidence run
- 6e3160de-fe46-4b45-b071-72560b5c5d0e
- Study
- Convert a Complex PDF into Clean Markdown with an API
- Research task
- 86b9h7t37
- Tested at
- not recorded
- Source
- first-party
- Evidence state
- verified
- Proof shown
- input + output shown
- Cost / latency
- not captured
- Repeat run
- not captured
- Tester
- not captured
The last three rows are honest blanks, not placeholders — our capture has no field for them yet.
Query this
get_evidence({
tool: "mistral-ai",
scenario: "scanned-research-paper"
})MCP · mcp.aidemos.com/api/mcp
Free with attribution.
Same input, same check — 8 other tools
measured on Reading Order & Structure
Adobe API✗ FailedDumps the scanned title page as a dense OCR block without section boundaries or other structural cues, so the document hierarchy is lost.Extend AI✓ WorkedReconstructs a multi-column research page so the 'STUDY AREA' heading, its paragraphs, and the following 'STAND PRESCRIPTIONS' section stay in order.Landing AI✗ FailedMisinterprets the opening page's structure, breaking the relationship between the title and surrounding content on the scanned paper.LlamaParse✓ WorkedReflows a two-column scanned page into a single coherent reading order while preserving section-to-body flow.Nutrient.io✓ WorkedThe tool preserves section hierarchy and column order in a dense multi-column scanned section, keeping headings aligned with the correct body text.Reducto⚠ StruggledDisplaces the byline by a full column: the author line that sits above the two-column split in the source is emitted only after the entire left column, and its footnote markers are rendered inconsistently.Tensorlake✓ WorkedRetains section-level reading order in a scanned multi-column paper, with headings continuing to guide the flow across columns and into the next section.Upstage AI✗ FailedBreaks paragraph-level segmentation in the scanned two-column page, so the extracted text no longer follows the source column order cleanly.
This evidence is published in
Real inputs and real outputs, no retouching · every cell queryable via API & MCP · aidemos.com