The animation works, but timing and pacing still often need manual refinement.
What was measured
Reliability
Consistent results across inputs.
decisive for this rankingtransformation
Consistent results across inputs is essential here; a tool that works only sometimes is not dependable for animation generation. (3 of 3 judges)
What was given, what came back
Test input: Search engines basics explainer · text
Input — what we sent
The exact prompt
Create an animation video explaining how search engines work.
A vague, linear educational animation prompt asking the tool to explain how search engines work with minimal guidance. Designed to stress inference, scene structuring, pacing, and coherent visual flow from an underspecified request.
Output — unretouched
Claude Artifacts — Screen Recording 2026-04-30 141425.mp4
Also checked on this input — same tool, 4 other criteria
Code Generation Quality✓ WorkedIt generated a runnable webpage on the first attempt, with autoplay working on load.Export Experience⚠ StruggledGetting an MP4 was not native; the report says a browser-capture/render workflow was still required.In-Platform Preview✓ WorkedThe preview was available immediately in-platform, so the animation could be inspected before any external capture step.Output Quality✓ WorkedDelivered a polished animation with smooth motion, clean hierarchy, and a recognizable search-engine workflow.
Provenance
- Observation
- 0675da71-4772-4c4e-a2a8-bb2b660f1cb2
- Evidence run
- c751a76b-a105-4b3e-9ff3-6c4d6adc9f04
- Study
- Generate Code-based Animations from text inputs
- Research task
- 86b9nnzmy
- Tested at
- Jun 24, 2026
- Source
- first-party
- Evidence state
- verified
- Proof shown
- input + output shown
- Cost / latency
- not captured
- Repeat run
- not captured
- Tester
- not captured
The last three rows are honest blanks, not placeholders — our capture has no field for them yet.
Query this
get_evidence({
tool: "claude-artifacts"
})MCP · mcp.aidemos.com/api/mcp
Free with attribution.
Same input, same check — 0 other tools
measured on Reliability
No other tool was measured on this criterion for this input.
Real inputs and real outputs, no retouching · every cell queryable via API & MCP · aidemos.com