Scenario in benchmark · Converting a complex PDF into clean Markdown with an open-source library · Version 1

A table that continues across a page break

A table continues across a page break and is still treated as one table.

Capability: Table Extraction2 pinned test cases per toolNeutral global definition →

What we check

  1. Whether the table is recognised as one continuous table rather than split into separate tables.
  2. Whether the continuation keeps the table header context intact across the page break.
  3. Whether rows and columns remain aligned as a single structure across both pages.

Exact wording, inputs, fixture state, expected output and detailed grading remain at the test-case level and may be withheld while the benchmark version is active. The scenario and its evaluation intent are public.

How the tools performed

One row per tool, from its current published Result for this scenario and benchmark version. Open a row for the full summary and the exact counts.

Different test set · 1
PyMuPDF4LLMDifferent test setProduced two Markdown tables for each document, preserving the repeated-header version but mishandling the headerless continuation.View Result →

It kept 22 of 22 data rows in the first; in the second, a data row became headings, leaving 25 of 26 data rows and incorrect continuation column names.

Published on a different test set, so its counts are not compared here.

Failures first, then A–Z within each group. Not a ranking. Assessed = Pass + Fail + Not gradable; Gradable = Pass + Fail, both out of the Result’s pinned test cases.

No published Result yet (9): doc2mark, Docling, GPT-5.6 terra, LiteParse, Marker, MarkItDown, MinerU, olmOCR, PaddleOCR-VL.

No published Result does not tell you whether a tool has been tested.

Test design

Pinned test cases
2
Disclosure
1 public · 1 withheld
Capabilities exercised here
Table Extraction

How the results are graded

  • Pass the test-case expectations hold.
  • Fail an expectation demonstrably does not hold.
  • Not gradable the evidence cannot establish the outcome.

Version 1 pins a scenario rubric for this scenario. Benchmark methodology →

A table that continues across a page break in Converting a complex PDF into clean Markdown with an open-source library | AI Demos