The tool left the banana-ripeness labels untranslated; "Unripe," "Ripe," "Overripe," and "Rotten" remained in English in the output.
What was measured
Translation Accuracy
Is the translated output semantically correct, and does it preserve technical terms, tone, and meaning?
decisive for this rankingtransformation
If the translation changes meaning, tone, or technical terms, the tool fails the core job of translating the video. (3 of 3 judges)
What was given, what came back
Test input: Educational airport conversation short (English → Spanish) · video · group: video-translation-voice-clone-lip-sync
Input — what we sent
Input not captured
This run recorded no prompt or input file for the test, so we cannot show you what produced the result below. Capture gaps are tracked, not hidden.
A structured educational/conversation-style English short video used to test translation into Spanish with clear narration, steadier pacing, and easier lip-sync alignment than the other scenarios.
Why this input is hard
- · Structured speech translation accuracy
- · English-to-Spanish narration quality
- · Longer-phrase lip-sync consistency
- · Clear voice rendering for informational content
- · Export/download reliability in a simple speaking scenario
Output — unretouched
Also checked on this input — same tool, 1 other criterion
Provenance
- Observation
- e3538651-7821-4212-b184-b67802cab5d5
- Evidence run
- ec1dd100-6af8-4f49-8f19-b78492702b14
- Study
- Translate Videos with Voice Cloning and Lip Sync Using AI
- Research task
- 86b96dfpf
- Tested at
- not recorded
- Source
- first-party
- Evidence state
- verified
- Proof shown
- output only
- Cost / latency
- not captured
- Repeat run
- not captured
- Tester
- not captured
The last three rows are honest blanks, not placeholders — our capture has no field for them yet.
Query this
get_evidence({
tool: "heygen",
scenario: "video-translation-voice-clone-lip-sync"
})MCP · mcp.aidemos.com/api/mcp
Free with attribution.
Same input, same check — 8 other tools
measured on Translation Accuracy
Akool✗ FailedThe banana-ripeness labels stayed in English ('Unripe,' 'Ripe,' 'Overripe,' 'Rotten') instead of being localized to Spanish.Camb AI✗ FailedOn the educational banana-ripeness clip, the diagram labels stayed in English—'Unripe', 'Ripe', 'Overripe', and 'Rotten'—so graphic text was not translated into Spanish.D-ID✓ WorkedIt produces an accurate Spanish translation.Dubverse✓ WorkedIt produces highly accurate English-to-Spanish translation, preserving technical and educational content well.Rask AI✗ FailedThe English→Spanish banana-ripeness export leaves the diagram labels in English — 'Unripe', 'Ripe', 'Overripe', and 'Rotten' — instead of translating the on-screen text.Sync Labs✓ WorkedThe Spanish translation is accurate and clear, especially for structured educational speech.Synthesia✗ FailedOn-screen graphic translation is skipped: the banana-stage labels "Unripe", "Ripe", "Overripe", and "Rotten" stay in English throughout the Spanish output.VEED✓ WorkedSpoken dialogue captions translate correctly into Spanish and preserve accents, with proper accented forms visible in the output.
This evidence is published in
From the same study (page rebuilt from a later run)
Real inputs and real outputs, no retouching · every cell queryable via API & MCP · aidemos.com