Does not retain handwritten signature content as visual output on the signatures page, leaving only partial surrounding legal text and no clearly identifiable signatures.
What was measured
Visual Content Retention
Retains charts, figures, diagrams, and images in the output and places them in the correct reading position.
decisive for this rankingtransformation
For complex PDFs, figures, charts, and images are part of the document content, so preserving them in the right place is part of the core job. (3 of 3 judges)
What was given, what came back
Test input: Hybrid Earnings Report · pdf · group: hybrid-earnings-report
Input — what we sent

Hybrid Earnings Report
A long, real-world hybrid annual report used to benchmark end-to-end PDF-to-markdown conversion. It combines native text, financial tables, charts/graphics, and scanned signature/stamp regions, stressing preservation of document structure, reading order, and embedded visual content across a multi-section report.
Why this input is hard
- · Native digital text extraction
- · Complex financial table preservation
- · Chart and graphic retention
- · Image-based signatures and stamps
- · Reading order across a long multi-section report
- · Markdown quality and consistency
Output — unretouched

Also checked on this input — same tool, 4 other criteria
Advanced Features✓ WorkedSeparately extracts chart content into textual summaries and value tables, including a waterfall chart and bar charts with year/value pairs and growth statistics.Complex Document Handling◐ MixedHandles an 84-page hybrid report end to end, but quality degrades on signatures and multicolumn pages rather than staying uniform across the document.Reading Order & Structure✗ FailedBreaks the two-column reading order on the annual-report page, so headings and body text no longer follow the source navigation cleanly.Table Preservation◐ MixedReconstructs the 2011–2015 financial summary table with rows and columns intact, but misses a small number of currency symbols in the extracted values.
Provenance
- Observation
- 417a2325-3f7b-4e6f-a06f-e7653967e43e
- Evidence run
- 6e3160de-fe46-4b45-b071-72560b5c5d0e
- Study
- Convert a Complex PDF into Clean Markdown with an API
- Research task
- 86b9h7t37
- Tested at
- not recorded
- Source
- first-party
- Evidence state
- verified
- Proof shown
- input + output shown
- Cost / latency
- not captured
- Repeat run
- not captured
- Tester
- not captured
The last three rows are honest blanks, not placeholders — our capture has no field for them yet.
Query this
get_evidence({
tool: "upstage-ai",
scenario: "hybrid-earnings-report"
})MCP · mcp.aidemos.com/api/mcp
Free with attribution.
Same input, same check — 8 other tools
measured on Visual Content Retention
Adobe API✓ WorkedKeeps embedded charts and segment graphics inside the report page rather than dropping them, so the extracted page still shows the financial-highlights block and segment-sales graphics.Extend AI◐ MixedRetains charts and logos as standalone figure blocks with captions, but they are extracted out of page position rather than embedded inline.Landing AI✗ FailedReplaces a waterfall chart with text, preserving the SG&A rate values and year-to-year change labels but not the chart as a visual asset in the output.LlamaParse◐ MixedRepresents logos and signatures as textual placeholders or descriptions rather than retaining them as image assets in the output.Mistral AI✓ WorkedVisual assets are extracted into page-specific folders, keeping charts, signatures, and other document elements tied to their source pages instead of collapsing them into one consolidated output.Nutrient.io◐ MixedKeeps the surrounding 3-signatory signature-page text, but does not extract the handwritten signatures themselves.Reducto✗ FailedDoes not retain handwritten signature graphics as images: a signature crop returns only the <signature> placeholder plus the printed name/title, omitting the cursive mark itself.Tensorlake✓ WorkedRetains scanned signature-page visuals as figure blocks plus signer text, including named executives and dates, rather than dropping the signature regions from the output.
This evidence is published in
Real inputs and real outputs, no retouching · every cell queryable via API & MCP · aidemos.com