The English→Spanish banana-ripeness export leaves the diagram labels in English — 'Unripe', 'Ripe', 'Overripe', and 'Rotten' — instead of translating the on-screen text.
What was measured
Translation Accuracy
Is the translated output semantically correct, and does it preserve technical terms, tone, and meaning?
decisive for this rankingtransformation
If the translation changes meaning, tone, or technical terms, the tool fails the core job of translating the video. (3 of 3 judges)
What was given, what came back
Test input: Educational airport conversation short (English → Spanish) · video · group: video-translation-voice-clone-lip-sync
Input — what we sent
Input not captured
This run recorded no prompt or input file for the test, so we cannot show you what produced the result below. Capture gaps are tracked, not hidden.
A structured educational/conversation-style English short video used to test translation into Spanish with clear narration, steadier pacing, and easier lip-sync alignment than the other scenarios.
Why this input is hard
- · Structured speech translation accuracy
- · English-to-Spanish narration quality
- · Longer-phrase lip-sync consistency
- · Clear voice rendering for informational content
- · Export/download reliability in a simple speaking scenario
Output — unretouched
Also checked on this input — same tool, 2 other criteria
Lip Sync Accuracy✗ FailedAt t=4.0s the input and output are frame-for-frame identical, with the same mouth shape, so no lip sync or face regeneration is visible on the free tier.Output Quality & Export◐ MixedThe educational export stays intact and legible, but it is vertically letterboxed with black side bars, carries a 'TRANSLATED BY RASK' watermark, and the free tier does not provide native downloads.
Provenance
- Observation
- b5ce2194-4698-44d9-93a8-634d5755b4b7
- Evidence run
- ec1dd100-6af8-4f49-8f19-b78492702b14
- Study
- Translate Videos with Voice Cloning and Lip Sync Using AI
- Research task
- 86b96dfpf
- Tested at
- not recorded
- Source
- first-party
- Evidence state
- verified
- Proof shown
- output only
- Cost / latency
- not captured
- Repeat run
- not captured
- Tester
- not captured
The last three rows are honest blanks, not placeholders — our capture has no field for them yet.
Query this
get_evidence({
tool: "rask-ai",
scenario: "video-translation-voice-clone-lip-sync"
})MCP · mcp.aidemos.com/api/mcp
Free with attribution.
Same input, same check — 8 other tools
measured on Translation Accuracy
Akool✗ FailedThe banana-ripeness labels stayed in English ('Unripe,' 'Ripe,' 'Overripe,' 'Rotten') instead of being localized to Spanish.Camb AI✗ FailedOn the educational banana-ripeness clip, the diagram labels stayed in English—'Unripe', 'Ripe', 'Overripe', and 'Rotten'—so graphic text was not translated into Spanish.D-ID✓ WorkedIt produces an accurate Spanish translation.Dubverse✓ WorkedIt produces highly accurate English-to-Spanish translation, preserving technical and educational content well.HeyGen✗ FailedThe tool left the banana-ripeness labels untranslated; "Unripe," "Ripe," "Overripe," and "Rotten" remained in English in the output.Sync Labs✓ WorkedThe Spanish translation is accurate and clear, especially for structured educational speech.Synthesia✗ FailedOn-screen graphic translation is skipped: the banana-stage labels "Unripe", "Ripe", "Overripe", and "Rotten" stay in English throughout the Spanish output.VEED✓ WorkedSpoken dialogue captions translate correctly into Spanish and preserve accents, with proper accented forms visible in the output.
This evidence is published in
From the same study (page rebuilt from a later run)
Real inputs and real outputs, no retouching · every cell queryable via API & MCP · aidemos.com