AI Demos Research — the structured-intelligence platform. Every verdict on these pages opens to the execution behind it.
structured intelligence

What we have actually tested

Every entity below is backed by executions in the archive. A ranking is a computation over them, not a document — change a finding and the answer above it changes with it.

Benchmarks

AI Customer Support Chatbots

Automate customer support using an AI chatbot / AI customer support agent — which agents handle real customer support conversations for a business best?

v1 · draft

AI Database Agents

Which AI database agent answers business questions about a live relational database correctly — in the company's own terms, and honestly when the data cannot answer?

v1 · draft

Managed RAG

Which managed RAG service turns a folder of private documents into a query API that finds the right passage, answers only from what it retrieved, cites the source that actually supports the claim — and keeps up when the source changes?

v1 · draft

Converting a complex PDF into clean Markdown with a hosted API

Which hosted API converts a complex, real-world PDF into faithful, usable Markdown?

v1 · draft

Converting a complex PDF into clean Markdown with an open-source library

Which self-hostable open-source library converts a complex, real-world PDF — native text, dense tables, charts, images and scanned pages — into Markdown a reader can trust without opening the original?

v1 · draft

Quiz Generation

Which AI quiz tool turns study material into valid quizzes, and then grades, explains and tracks what the learner actually understood?

v1 · draft

Structured Document Extraction

Which document extraction platform turns a user-defined schema into correct structured records — across layouts, scans and repeated sets — and is honest about what it could not find?

v1 · draft

Web Search for AI

Which web search or answer API finds the live-web material that actually supports an answer, keeps up when that material changes, and -- where it writes the answer itself -- says only what its own sources support?

v1 · draft

Capabilities

Authored by hand. Never derived from similarity.

Action execution
5 scenarios
Agent configuration and control
2 scenarios
Analytics and observability
3 scenarios
Answer Feedback
2 scenarios
Answer Presentation
4 scenarios
Citations
1 scenario
Class Reports
1 scenario
Code Extraction
1 scenario
Question Answering
4 scenarios
Conversational Interaction
6 scenarios
Conversation continuity
3 scenarios
Data Access Control
3 scenarios
Data Ingestion
4 scenarios
Retrieval
4 scenarios
Equations & Mathematical Notation
1 scenario
Escalation and human handoff
3 scenarios
Training
1 scenario
Feedback and learning
2 scenarios
Field Extraction
5 scenarios
Figures & Charts
2 scenarios
Freshness
3 scenarios
Grading
3 scenarios
Grounded Generation
3 scenarios
Heading & Section Structure
2 scenarios
Intent understanding
3 scenarios
Knowledge-grounded answering
3 scenarios
Knowledge Sync
3 scenarios
Learner Progress
1 scenario
Multilingual support
2 scenarios
Nested & Repeated Fields
4 scenarios
OCR
2 scenarios
Personalized Practice
2 scenarios
Quiz Delivery
2 scenarios
Quiz Generation
5 scenarios
Reading Order & Layout
1 scenario
Querying
3 scenarios
Reporting
3 scenarios
Review and Correction
3 scenarios
Scanned Document OCR
2 scenarios
Answer Generation
3 scenarios
Source Grounding
2 scenarios
Table Extraction
2 scenarios
Text Fidelity
1 scenario
Analytics & Observability
4 scenarios
Training
4 scenarios
Web Retrieval
4 scenarios

Scenarios

The questions. Reusable across studies, inputs and tools.

ScenarioQuestionGrades
a-bad-file-in-the-uploadA bad file in the upload0
a-claim-in-the-answer-traced-back-to-its-sourceA claim in the answer traced back to its source0
a-cleanly-scanned-documentA cleanly scanned document0
a-configured-rule-requires-escalationA configured rule requires escalation0
action-failureRequested action cannot be completed0
action-requires-confirmationAction requires confirmation2
a-document-containing-a-code-blockA document containing a code block0
a-document-containing-mathematical-equationsA document containing mathematical equations0
a-document-mixing-digital-and-scanned-pagesA document mixing digital and scanned pages0
a-document-with-a-data-chartA document with a data chart0
a-document-with-figures-and-captionsA document with figures and captions0
a-document-with-styled-headings-and-subheadingsA document with styled headings and subheadings0
a-field-the-tool-can-only-get-right-from-examplesA field the tool can only get right from examples0
agent-actions-tool-calls-can-be-inspectedAgent actions/tool calls can be inspected0
agent-cannot-resolve-the-requestAgent cannot resolve the request0
aggregate-across-documentsAggregate across documents0
a-learner-takes-a-quiz-on-their-ownA learner takes a quiz on their own0
allowlisted-web-searchSearch only these websites0
ambiguous-requestRequest is unclear and needs clarification0
analytics-accuracyReported analytics match what actually happened0
a-new-page-has-just-gone-liveA new page has just gone live0
an-excluded-column-is-asked-for-directlyAn excluded column is asked for directly0
an-excluded-table-is-needed-to-answer-the-questionAn excluded table is needed to answer the question0
an-ordinary-digital-text-documentAn ordinary digital text document0
answer-is-available-in-the-knowledge-baseAnswer is available in the knowledge base0
answer-is-not-available-in-the-knowledge-baseAnswer is not available in the knowledge base0
a-page-laid-out-in-multiple-columnsA page laid out in multiple columns0
a-page-on-the-web-answers-the-questionA page on the web answers the question0
a-repeated-set-of-recordsA repeated set of records0
a-simple-clearly-formatted-tableA simple, clearly formatted table0
a-table-that-continues-across-a-page-breakA table that continues across a page break0
a-teacher-gives-the-quiz-to-a-classA teacher gives the quiz to a class0
business-defined-termThe question uses a term the company defines itself0
class-struggle-reportThe teacher checks what the class struggled with0
configured-instruction-changes-agent-behaviorConfigured instruction changes agent behavior0
configured-restriction-is-respectedConfigured restriction is respected0
conflicting-sourcesThe retrieved sources disagree with each other0
content-is-removed-from-the-sourceContent is removed from the source0
conversation-activity-can-be-inspectedConversation activity can be inspected0
conversation-context-retentionInformation from earlier in the conversation is needed later0
correct-a-field-valueCorrect a field value0
corrected-data-goes-downstreamCorrected data goes downstream0
customer-communicates-in-another-supported-languageCustomer communicates in another supported language0
customer-corrects-information-given-earlierCustomer corrects information given earlier0
customer-switches-languages-during-the-conversationCustomer switches languages during the conversation0
definition-correctionThe agent used the wrong definition and the user corrects it0
document-scoped-retrievalRetrieval is scoped to part of the documents0
existing-content-is-changedExisting content is changed0
external-system-retrievalRetrieve information from an external system0
failed-question-surfacingThe operator needs to find the questions the agent is failing on0
feedback-can-be-submittedFeedback can be submitted0
few-shot-generalizationThe user supplies example questions and the queries they trust0
filter-records-across-documentsFilter records across documents0
find-reported-bad-answerA user reports a bad answer and the operator has to find it0
follow-up-suggestionsThe agent offers what to ask next0
footnotes-at-the-bottom-of-the-pageFootnotes at the bottom of the page0
learning-from-correctionCorrection changes future behavior where the product claims learning0
learning-goal-quizThe user asks the quiz to test a particular learning goal0
mixed-correct-incorrect-responsesThe learner answers some fixed-answer questions correctly and others incorrectly0
name-disambiguationSomething more famous has the same name0
new-content-is-added-to-the-sourceNew content is added to the source0
one-message-contains-multiple-requestsOne message contains multiple requests0
one-topic-is-weaker-than-the-othersOne topic is weaker than the others0
paraphrased-requestThe request uses different wording than the source0
plain-fact-or-short-listThe answer is a plain fact or a short list0
relative-date-reportThe report is run again after the data has changed0
repair-a-recordRepair a record0
resume-earlier-conversationEarlier conversation/session needs to be continued0
same-answer-different-formatThe user asks to see the same answer a different way0
source-action-disambiguationRequest requires choosing the correct source or action0
split-across-text-and-diagramImportant information appears in both text and a diagram0
standing-rule-persistenceThe user sets a standing rule for all future answers0
supported-answerThe retrieved material supports an answer0
the-answer-is-available-in-the-connected-dataThe answer is available in the connected data0
the-answer-needs-a-summary-and-its-detail-togetherThe answer needs a summary and its detail together0
the-answer-was-never-in-the-schemaThe answer was never in the schema0
the-connected-data-cannot-answer-the-questionThe connected data cannot answer the question0
the-databases-names-are-cryptic-and-the-user-documents-themThe database's names are cryptic and the user documents them0
the-field-is-absentThe field is absent0
the-follow-up-is-ambiguousThe follow-up is ambiguous0
the-learner-answers-correctly-in-their-own-wordsThe learner answers correctly in their own words0
the-learner-checks-whether-they-are-improvingThe learner checks whether they are improving0
the-learner-gives-a-clearly-wrong-answerThe learner gives a clearly wrong answer0
the-learner-returns-to-the-material-laterThe learner returns to the material later0
the-learners-answer-is-partly-correctThe learner's answer is partly correct0
the-next-question-refers-to-the-previous-answerThe next question refers to the previous answer0
the-same-field-across-layoutsThe same field across layouts0
the-set-contains-a-non-recordThe set contains a non-record0
the-set-continues-across-a-page-breakThe set continues across a page break0
the-set-is-legitimately-emptyThe set is legitimately empty0
the-user-changes-direction-mid-conversationThe user changes direction mid-conversation0
the-user-narrows-what-they-just-askedThe user narrows what they just asked0
the-users-wording-doesnt-match-how-the-values-are-storedThe user's wording doesn't match how the values are stored0
the-user-turns-a-recorded-lecture-into-a-quizThe user turns a recorded lecture into a quiz0
the-user-turns-study-material-into-a-quizThe user turns study material into a quiz0
the-user-wants-several-findings-in-one-placeThe user wants several findings in one place0
the-user-wants-to-keep-an-answer-they-just-gotThe user wants to keep an answer they just got0
the-value-is-directly-availableThe value is directly available0
the-value-must-be-derivedThe value must be derived0
the-value-needs-a-supplied-definitionThe value needs a supplied definition0
trace-a-value-to-its-locationTrace a value to its location0
trend-or-comparison-formThe answer is a trend or a comparison0
two-users-are-given-different-data-scopeTwo users are given different data scope0
unsupported-answerThe retrieved material doesn't support an answer0
updated-known-pageA page the tool already finds has changed0
update-something-in-an-external-systemUpdate something in an external system0
user-explicitly-asks-for-a-humanUser explicitly asks for a human0
user-is-not-authorized-to-perform-the-actionUser is not authorized to perform the action0
user-question-auditSomeone needs to see what people have been asking0

Tools

ToolRuns 
Academa AI0never executed
Ada0never executed
Adobe API0never executed
Adobe PDF Extract API9
Adobe Podcast Enhance0never executed
Affinda0never executed
AICloneVoiceFree.com0never executed
AI for Database0never executed
Airparser0never executed
AKOOL0never executed
Amazon Transcribe0never executed
AnimG0never executed
Anomaly AI0never executed
Antigravity0never executed
Apollo0never executed
AskYourDatabase0never executed
AssemblyAI0never executed
Audo Studio0never executed
Auphonic0never executed
AutoCaption.io0never executed
AWS Transcribe0never executed
Basedash0never executed
BlazeSQL5
Boords0never executed
Botpress0never executed
Botsonic0never executed
Brave Search API7
Bria.ai0never executed
Camb.AI0never executed
camelAI0never executed
CapCut0never executed
Captions0never executed
Careerflow AI0never executed
Cartesia.ai0never executed
Chatbase0never executed
ChatGPT0never executed
ChatGPT Canvas0never executed
Claude AI0never executed
Claude Artifacts0never executed
Claude AI0never executed
Clay0never executed
Cleanvoice0never executed
Cognee0never executed
CoSupport.ai0never executed
Creatify.ai0never executed
CustomGPT.ai0never executed
Cutout.Pro0never executed
CVParserPro0never executed
Dante AI0never executed
Datalab0never executed
Decagon0never executed
Deepgram0never executed
Definite0never executed
Denser AI0never executed
Descript0never executed
Descript Studio Sound0never executed
D-ID0never executed
Dify0never executed
doc2mark6
Docling0never executed
Docparser0never executed
Docsumo0never executed
DoctoQuiz0never executed
DocTR0never executed
Dolphin (ByteDance)0never executed
Dot0never executed
Drawstory0never executed
Draxlr0never executed
DreamFace0never executed
Dubverse0never executed
Dust0never executed
EasyMotion0never executed
Edcafe AI0never executed
ElevenLabs0never executed
ElevenLabs Scribe0never executed
ElevenLabs Voice Isolator0never executed
Epidemic Sound0never executed
Epidemic Sound Voices0never executed
Exa0never executed
Extend AI7
Extracta.ai0never executed
Fathom0never executed
Fellow0never executed
Intercom Fin0never executed
Fine Voice0never executed
Firecrawl9
Fireflies0never executed
Fireflies.ai0never executed
Fish Audio0never executed
FlexClip0never executed
Fotor0never executed
Framia0never executed
Framia.converge.ai0never executed
Freshdesk Freddy11
FS Agent (DIY control)0never executed
Futuresmart AI0never executed
FutureSmart AI Diagram Animator0never executed
FutureSmart Database Agent21
FutureSmart Document Intelligence24
FutureSmart NL2SQL Agent0never executed
Gemini0never executed
Gemini Canvas0never executed
Gladia0never executed
Gling AI0never executed
Google Cloud Speech-to-Text0never executed
Google Flow0never executed
Gorgias0never executed
GPAI0never executed
GPT-5.4 mini0never executed
GPT-5.4 nano0never executed
GPT-5.6 luna0never executed
GPT-5.6 terra0never executed
Granola0never executed
Grok0never executed
GroqCloud0never executed
Gumloop0never executed
Hailuo0never executed
HappyScribe0never executed
Help Scout0never executed
HeyGen0never executed
Hindsight0never executed
Hireability0never executed
HrFlow0never executed
Hunter0never executed
ImagineArt0never executed
InVideo AI0never executed
Inworld0never executed
Inworld.ai0never executed
Jina0never executed
Jina AI Reader0never executed
JoggAI0never executed
JotForm0never executed
Kapwing0never executed
Kling AI0never executed
Knowt0never executed
Kodisc0never executed
Kommunicate15
Landing AI0never executed
Leonardo AI0never executed
Linkup0never executed
LiteParse2
LlamaParse4
Luma AI Dream Machine0never executed
MarkItDown7
Media.io0never executed
MeetGeek0never executed
Mem00never executed
Microsoft Azure Speech Services0never executed
MinerU0never executed
Minimax0never executed
MiniMax Hailuo0never executed
MiniMax.io0never executed
Mirelo0never executed
Mistral AI10
Murf AI0never executed
Nanonets16
Noise Remover0never executed
Noiz AI0never executed
NotebookLM0never executed
NoteGPT0never executed
Notta0never executed
Nutrient.io0never executed
Olostep0never executed
OpenAI0never executed
OpenAI Speech-to-Text0never executed
OpenAI web search0never executed
OpenResume0never executed
Opus Clip0never executed
Otter0never executed
Otter.ai0never executed
PaddleOCR0never executed
PaddleOCR-VL0never executed
Parseur0never executed
PDF.ai0never executed
PDF to Quiz0never executed
PDFVector0never executed
PDF Vector0never executed
Perplexity Sonar0never executed
Pickaxe0never executed
Picsart0never executed
Pika Labs0never executed
PixVerse AI0never executed
Premiere Pro0never executed
PyMuPDF4LLM6
Querio0never executed
QuestionWell0never executed
Quizgecko0never executed
Quizizz0never executed
QuizRise0never executed
Rask AI0never executed
Reducto11
Relevance AI0never executed
RemotionAI0never executed
Remotion AI0never executed
RemotionVideo0never executed
Replit0never executed
Respond0never executed
Respond.io0never executed
ResumeParser0never executed
Retab0never executed
Rev AI0never executed
revid.ai0never executed
Rezi AI0never executed
Saleshandy0never executed
Scenario0never executed
SerpAPI0never executed
Serper0never executed
Skima AI0never executed
Skyvern0never executed
Snov.io0never executed
Speechify0never executed
Speechmatics0never executed
Spider0never executed
Steve AI0never executed
StudyFetch0never executed
Studyglen0never executed
StudyX AI0never executed
Summarize.tech0never executed
Supermemory0never executed
Sync Labs0never executed
Synthesia0never executed
Synthesia.io0never executed
Tavily8
Teal0never executed
Tensorlake0never executed
Tidio Lyro0never executed
TopMediai Voice Cloning0never executed
Topview AI0never executed
Uberduck0never executed
Unstract0never executed
Unstructured0never executed
Upstage AI0never executed
Valyu0never executed
Vectara10
Vectorize.io15
VEED0never executed
Vidnoz AI0never executed
Vidyo.ai0never executed
Vismo Studio0never executed
Vizard0never executed
Vizard.ai0never executed
VocalAI0never executed
Voiceflow0never executed
Wonderchat0never executed
Wonsulting AI0never executed
X-Pilot0never executed
You.com0never executed
YouLearn AI0never executed
Zapier AI Agents0never executed
Zendesk AI0never executed
Zep0never executed
Zubtitle0never executed
Every verdict on these pages is openable to the execution behind it. Where an execution was reconstructed rather than captured, the page says so — a finding and a measurement are not the same claim.