Certifications were extracted, but the issuer field was dropped entirely on the multi-column resume, so only name and year remained.
What was measured
Accuracy
Are extracted values correct and complete?
decisive for this rankingtransformation
Correct and complete values are the essence of resume parsing, so this directly determines whether the tool succeeds. (3 of 3 judges)
What was given, what came back
Test input: Multi-column sidebar resume — Priya Sharma · pdf · group: resume-parsing
Input — what we sent
Multi-column sidebar resume — Priya Sharma
A two-column sidebar resume for Priya Sharma, used to test whether parsers can preserve reading order and correctly extract content split across columns.
Why this input is hard
- · multi-column layout handling
- · sidebar content extraction
- · reading-order robustness
- · projects extraction
- · languages and certifications extraction
Also checked on this input — same tool, 3 other criteria
Field coverage✓ WorkedThe multi-column output included the core resume fields and the sidebar-specific sections, including name, email, phone, experience, education, skills, certifications, languages, and projects.Multi-column handling✓ WorkedThe parser handled the two-column sidebar layout correctly and preserved content from both columns rather than dropping the right sidebar.Output quality✓ WorkedThe multi-column output was clean and complete overall, with fully extracted work histories, projects, certifications, and languages.
Provenance
- Observation
- a90c31b5-b17f-409b-9b4c-ec89a653ac9b
- Evidence run
- cbbef4db-964c-49fa-a57f-a2977822bdfc
- Study
- Parse resumes into structured data using an API
- Research task
- 86b9jm30n
- Tested at
- not recorded
- Source
- first-party
- Evidence state
- verified
- Proof shown
- input + output shown
- Cost / latency
- not captured
- Repeat run
- not captured
- Tester
- not captured
The last three rows are honest blanks, not placeholders — our capture has no field for them yet.
Query this
get_evidence({
tool: "llamaparse",
scenario: "resume-parsing"
})MCP · mcp.aidemos.com/api/mcp
Free with attribution.
Same input, same check — 7 other tools
measured on Accuracy
Affinda◐ MixedIt again left the CGPA numeric score empty on the multi-column resume, capturing only the CGPA unit and missing the visible 8.7 value.Airparser✓ WorkedKeeps the extracted values correct and complete on the two-column resume, including contact details, CGPA 8.7/10, project metrics, and language proficiency.CVParserPro✗ FailedThe experience calculation undercounted the candidate badly, showing 2 years even though the report says the resume reflects about 6.5 years of experience.Extracta.ai◐ MixedLeaves the CGPA embedded in the education description string instead of surfacing it as a dedicated numeric field.HrFlow◐ MixedOn the two-column resume, it truncates the job title, dropping the '— ML' suffix from 'Software Engineer — ML'.OpenResume◐ MixedLeaves GPA blank and places 'Graduated: May 2019 | CGPA: 8.7/10' into Date.Skima AI✗ FailedThe parser truncated responsibility text mid-sentence on the multi-column resume, cutting off the quantified detail after 'cutting costs by.'
This evidence is published in
Real inputs and real outputs, no retouching · every cell queryable via API & MCP · aidemos.com