Puts four programming languages — Python, JavaScript, SQL, and Bash — into the Languages field even though the resume does not contain a spoken-languages section.
What was measured
Noise in output
Does it add incorrect or hallucinated fields?
decisive for this rankingtransformation
Incorrect or hallucinated fields mean the resume parser is not producing reliable structured data, which is central to the job. (3 of 3 judges)
What was given, what came back
Test input: Clean single-column resume — Rugved Nichite · pdf · group: resume-parsing
Input — what we sent
Research media screenshot 202026 05 05 20124028.png
Clean single-column resume — Rugved Nichite
A professionally structured single-column resume for Rugved Nichite, used as the baseline input for parser accuracy across standard resume fields.
Why this input is hard
- · baseline field extraction
- · contact info accuracy
- · work experience parsing
- · education and CGPA extraction
- · skills and certifications extraction
Output — unretouched
Also checked on this input — same tool, 4 other criteria
Accuracy✓ WorkedCorrectly extracts the core personal and work-history values from the clean resume, including both jobs, the education entry, two certifications, and the full 15-skill list.Accuracy◐ MixedKeeps the CGPA as embedded text inside the education description string rather than extracting it as a standalone numeric field.Field coverage✓ WorkedCovers the standard resume fields needed for the baseline test: name, email, phone, experience, education, and skills are all present.Output quality✓ WorkedReturns a clean, minimal JSON payload with the core resume sections extracted and no extra metadata noise.
Provenance
- Observation
- f89caf00-224f-4aa6-8199-1b2b68ea6d2f
- Evidence run
- cbbef4db-964c-49fa-a57f-a2977822bdfc
- Study
- Parse resumes into structured data using an API
- Research task
- 86b9jm30n
- Tested at
- not recorded
- Source
- first-party
- Evidence state
- verified
- Proof shown
- input + output shown
- Cost / latency
- not captured
- Repeat run
- not captured
- Tester
- not captured
The last three rows are honest blanks, not placeholders — our capture has no field for them yet.
Query this
get_evidence({
tool: "extracta-labs",
scenario: "resume-parsing"
})MCP · mcp.aidemos.com/api/mcp
Free with attribution.
Same input, same check — 4 other tools
measured on Noise in output
Affinda✗ FailedThe parser injects non-skill noise into the skills list, including certification-derived items such as AWS Certified Cloud Practitioner and IBM Mainframe.Hireability✗ FailedThe competency extractor introduced noise by labeling all 29 competencies as beginner and including non-skill terms such as Intern, Science, and Framework as competencies.HrFlow✗ FailedIt injects non-skill fragments into the skills list, including 'ml apis', 'lambda', 's3', 'ml', and 'rest apis'.Skima AI✗ FailedThe parser preserved raw bullet/number formatting in responsibilities, leaking duplicated bullet characters into the extracted text.
This evidence is published in
Real inputs and real outputs, no retouching · every cell queryable via API & MCP · aidemos.com