Can explain the search-engine pipeline accurately, but first-pass output is visually weak: a plain horizontal flowchart with overflowing node text, no icons, no visual hierarchy, and minimal differentiation between components.
What was measured
Output Quality
Conceptually matches the prompt and is visually usable.
decisive for this rankingtransformation
The tool is being chosen to produce usable code-based animations, so conceptual match to the prompt and visual usability are core success criteria. (3 of 3 judges)
What was given, what came back
Test input: Search engines basics explainer · text
Input — what we sent
The exact prompt
Create an animation video explaining how search engines work.
A vague, linear educational animation prompt asking the tool to explain how search engines work with minimal guidance. Designed to stress inference, scene structuring, pacing, and coherent visual flow from an underspecified request.
Output — unretouched
ChatGPT Canvas — chatgpt-search-engine-animation.mp4
Also checked on this input — same tool, 3 other criteria
Code Generation Quality✓ WorkedGenerated syntactically correct, runnable HTML/CSS/JavaScript on the first attempt for the search-engine explainer.Code Generation Quality✓ WorkedGenerates syntactically correct HTML/CSS/JavaScript on the first attempt and can produce an auto-playing, continuous-loop animation without user interaction.In-Platform Preview✓ WorkedCanvas showed the animation immediately on load, with live preview available and the motion running in a continuous loop.
Provenance
- Observation
- fe204dc8-c009-42bf-9962-1b563998736e
- Evidence run
- c751a76b-a105-4b3e-9ff3-6c4d6adc9f04
- Study
- Generate Code-based Animations from text inputs
- Research task
- 86b9nnzmy
- Tested at
- Jun 24, 2026
- Source
- first-party
- Evidence state
- verified
- Proof shown
- input + output shown
- Cost / latency
- not captured
- Repeat run
- not captured
- Tester
- not captured
The last three rows are honest blanks, not placeholders — our capture has no field for them yet.
Query this
get_evidence({
tool: "chatgpt-canvas"
})MCP · mcp.aidemos.com/api/mcp
Free with attribution.
Same input, same check — 7 other tools
measured on Output Quality
AnimG⚠ StruggledAt moderate diagram complexity, the tool still matches the concept, but overlapping labels, arrows, and components make the render hard to follow.Antigravity✓ WorkedProduces a visually readable 15-second explainer that presents crawling, indexing, ranking, and serving in sequence.Claude Artifacts✓ WorkedDelivered a polished animation with smooth motion, clean hierarchy, and a recognizable search-engine workflow.Gemini Canvas✓ WorkedIt can cover the full search-engine workflow—crawling, indexing, and ranking—without overlap or visual clutter.Grok✗ FailedProduces a cluttered, webpage-like result with overlapping elements, cramped spacing, and no clear motion-graphics hierarchy.RemotionVideo✓ WorkedProduces a clean, polished explainer that visually communicates a 3-step crawl → index → rank flow with no overlap or layout clutter.Replit✓ WorkedDelivers clean motion graphics with clear sequencing and visual hierarchy, making the explanation immediately understandable.
Real inputs and real outputs, no retouching · every cell queryable via API & MCP · aidemos.com