AI Demos Research — the structured-intelligence platform. Every verdict on these pages opens to the execution behind it.
Graded 18 October 2026

Does Nutrient.io read multi-column pages in the right order?

Nutrient.io did not consistently preserve natural reading order for a two-column PDF in its default Build pipeline. It placed a masthead line in the middle of a body sentence, although the body columns themselves were read in order on all three pages.

1 of 1 test case failed

Every test case in this scenario has a result.

Pass rate0%0 of 1 gradable
Coverage1 of 1test case with a result
0PassNo test case passed.
1FailMissed at least one thing it was expected to do; the reason and proof are with each test case below.
0Not gradableEvery result here could be graded.
0UntestedEvery test case in this scenario has a result.
The pass rate is a summary. The evidence is the test case below: what we sent, what we checked, what the tool returned, and the proof.

The test case

Each test case is judged on its own: Pass, Fail, Not gradable, or Untested. The scenario result above is based on this test case.

Two-column page — natural reading orderFailEvidence
What we sent

We sent the complete three-page PDF to the API in one request.

InputDocument (PDF)
Input PDF: three-page bulletin with two columns
Open the PDF ↗
What the tool returned
Markdown
over rough ground and is not suitable for anyone who
cannot manage a stile. The coach leaves the Assembly


Founded 1898


Rooms at half past nine and is back by six. The cost,
including the coach and the entry to the harbour office,

Returned Markdown: column order and the misplaced masthead

Copied from Output file (Markdown), lines 69–77

Open the Markdown file ↗
Markdown
## Reviews


A History of the Marnhead Salt Trade , by J. Cavenshaw
(Vardenne, 2025, 214 pp). This is a careful book and a
slightly frustrating one. Cavenshaw has worked through
the harbour board's papers properly and his chapter on
the tramway is the best account we have. But he is not
much interested in the pans themselves, and a reader
who wants to know how salt was actually made at
Marnhead will have to go back to Sandiman.
Recommended, with that reservation.


## Letters


Sir - your correspondent's note in the autumn bulletin
on the naming of Croyde Gut may interest members
who know the Ordnance sheets of 1897 and 1923. The
name appears on neither, and the reach is called
Crowder's Gut on both. Whether Croyde is a correction
or a corruption I cannot say, but the older form is at
least the surveyed one. - R. Vale, Thrimby.


## Wanted: the Vardenne ferry


The Society is trying to establish when the Vardenne
ferry stopped running. The date usually given is 1961,
which is the year the ferry office was pulled down, but
the office may well have stood empty for some time
before that. A member recalls being taken across as a
child in the summer of 1958 and is sure the boat was
still working then; another remembers it ending just
after the war. A timetable, a ticket, or a photograph with
a date on the back would settle it.


The same member has given the Society a copy of the
1957 timetable for the Marnhead bus, which connected
with the ferry and may therefore date its last summer
more exactly than anything else we hold. It is on the
notice board at the Assembly Rooms for anyone who
wants to look at it.


## The chapels survey


The survey of the town's chapels, begun in 2019 and
interrupted twice, is now complete for the four
buildings still standing and for two of the three that are
not. What remains is the Bethel on Kellow Lane, of
which no plan and only one photograph have been
found. The survey will be printed as an occasional paper
in the autumn, and the members who took part are


asked to check their entries before then.
The Society is grateful to the trustees of two of the
chapels for access to their records, and to the county
archivist for the loan of a plan that had been catalogued
under the wrong parish for sixty years.


## Membership


Membership stood at two hundred and six at the end of
January, four more than a year ago and the first increase
since 2019. Twenty-two members live outside the
county and six outside the country; the Society posts the
bulletin to all of them and would rather do that than
lose them. Anyone who would prefer it by e-mail
should tell the secretary, who keeps a list and is happy
for it to grow.


## Notices

Copied from Output file (Markdown), lines 293–373

JSON
{
  "status_code": 200,
  "headers": {
    "date": "Wed, 09 Sep 2026 08:51:54 GMT",
    "content-type": "text/markdown",
    "content-length": "12576",
    "content-disposition": "attachment; filename=\"result.md\"",
    "server": "Cowboy",
    "x-pspdfkit-remaining-credits": "48",
    "x-pspdfkit-request-cost": "1",
    "x-request-id": "GNObAiHiKsHF9GIAAPHR"
  },
  "content_type": "text/markdown",
  "body_bytes": 12576,
  "delivery": "raw markdown body (content-type text/markdown)",
  "markdown_chars": 12568,
  "zip_members": null,
  "asset_names": null
}

API exchange: Markdown conversion request and response

Copied from Output file (JSON), response

Open the whole JSON file ↗
Expected vs. Found
✗Expected: Text follows natural reading order without interleaving the columns.Found: The body columns stayed in order, but the masthead line “Founded 1898” appeared between the halves of a sentence about the coach.
Supporting proof
Proof 1Screenshot
Run card: input, configuration and conversion result
Open original ↗
Why this result

Natural reading order required more than keeping the body columns in sequence. Although the columns were ordered correctly, the misplaced masthead interrupted a sentence, so the result is a fail.

Also observed in this test case

Other page furniture. The running head, correspondence footer and page numbers appeared on their own lines rather than merging into body text.

Tested by Chandresh Bisht · evidence dated 9 September 2026

Configuration and setup

How this tool was set up for the run and what the test needed in place. Each row is a fact from the run's records; a fact the records do not hold is left out, not guessed.

Software that produced the output
Nutrient.io
Build or version
Not exposed by the hosted product
Plan or tier
free tier
Surface
API
Set up before the run
A short two-column PDF had to be converted as a complete file with the default Build pipeline, no actions, one pass, and no flag tuning.
Pipeline
Markdown output · no extra processing steps · default pipeline · single pass, complete PDF
Tested
9 September 2026 · Chandresh Bisht

How this scenario is graded

How we decide Pass, Fail and Not gradable. The same rules apply to every tool tested on this scenario.

How results are decided

Each test case gets one result per tool: Pass, Fail or Not gradable. A test case we haven't run yet shows Untested. There are no partial results.

The rules
  • Pass: the tool did everything the test expected, and nothing it said contradicts the correct answer.
  • Fail: at least one expected behaviour clearly didn't happen; the test case's result says which one and quotes the tool.
  • Not gradable: our evidence couldn't settle the outcome (for example a record we needed is missing). It is never counted as a fail, and the test case's result says what's missing.

Where this sits in the benchmark

This page is one cell of a larger study: one tool, one scenario. Only this benchmark's frame appears here.

History of this result

What has happened to this result since it was first published. Runs and grades are never overwritten: a retest or a re-grade publishes a new result and keeps the earlier one readable.

from the publication record
11 November 2026First publishedConverting a complex PDF into clean Markdown with a hosted API v1

Act on this result

Nothing filed here edits the run or the grade. A challenge opens a review, and a review can produce a new run or a re-grade — which becomes the current result and leaves this one in the history.

This matches what I see

You run the same kind of test against your own setup and get the same behaviour.

Agree →
This does not match

Yours behaves differently. Tell us what you got, with a screenshot if you have one.

Disagree →
Point out an issue

Something here is wrong — a reference value, a transcription, a grade.

Report an issue →
Request a retest

On a newer build, a larger dataset, or your own setup.

Request a retest →
We have fixed this

Tell us what changed and we schedule a rerun of the failing test case. The old result stays as history.

Vendor notice →
Filed against this evidenceNothing yet. Challenges, counter-evidence and fix notices appear here with their outcome, and stay on the page after they are resolved.
Cite this result
aidemos.com/benchmarks/pdf-to-markdown-apis/results/nutrient-io/a-page-laid-out-in-multiple-columns · 0 pass · 1 fail · coverage 1/1 · graded 2026-10-18

The same record is available as structured data through the AI Demos MCP server, with the counts, the coverage and every per-test-case reason carried as fields.

Verify the proof files

These files support this result. Open a file to inspect the original evidence.

Input · Document (PDF) ↗application/pdf · 143 KB
Proof 1 · Screenshot ↗image/png · 89 KB
Output file (JSON) ↗application/json · 1 KB
Output file (Markdown) ↗text/markdown · 12 KB
File fingerprints (SHA-256)

A fingerprint identifies the exact file used for this result.

Input · Document (PDF)4c7e1f83e8fd4525a7a1c935526668f603a51bacf08202074cfa68c76f4afa69
Proof 1 · Screenshotb86661952e931ec5fe94b93c2d16894728cb1e75be6b960e2f3dc5a238769f8c
Output file (JSON)24f5e28546908bd48d2de501a5707877b481929e077c68acd3e390d59e7dfd44
Output file (Markdown)4e94bf7555fe1161d8be3b8c64a6ba08ff8cd39efba9dfec8e8d4c7000a6c158