Lip sync is the weakest of the tested inputs, with noticeable audio-video mismatch in fast speech parts.
What was measured
Lip Sync Accuracy
Does the dubbed audio visually match lip movements in the original video?
decisive for this rankingtransformation
If the dubbed audio does not match the on-screen mouth movements, the core purpose of video translation with lip sync has failed. (3 of 3 judges)
What was given, what came back
Test input: Hindi vlog-style talking head (Hindi → English) · video · group: video-translation-voice-clone-lip-sync
Input — what we sent
Input not captured
This run recorded no prompt or input file for the test, so we cannot show you what produced the result below. Capture gaps are tracked, not hidden.
A casual Hindi/Hinglish talking-head or vlog-style creator video translated into English to stress informal language handling, slang, and natural-sounding voice cloning on real creator content.
Output — unretouched
Dubverse — English-syncvideo 1.mp4.mp4
Also checked on this input — same tool, 11 other criteria
Input Handling✓ WorkedAccepts direct MP4 video upload, auto-detects clear English speech accurately, and handles single-speaker footage reliably.Input Handling✓ WorkedHandles structured educational speech very well, with high transcription accuracy on clear narration and no duration-related issues.Input Handling◐ MixedAccepts casual Hindi speech, but transcription degrades on slang, mixed-language speech, background noise, and weak speaker separation.Translation Accuracy◐ MixedSome fitness-specific terms are not localized naturally, so terminology quality is not fully consistent.Translation Accuracy✓ WorkedProduces highly accurate English-to-Spanish translation that preserves technical and educational meaning.Translation Accuracy◐ MixedBasic Hindi-to-English translation remains understandable and preserves overall meaning, but struggles with slang and informal tone.Translation Accuracy✓ WorkedPreserves common fitness terminology accurately when dubbing English to Hindi.Voice Cloning Quality◐ MixedThe generated voice becomes slightly robotic in longer explanations.Voice Cloning Quality◐ MixedGenerates a clean voice with minimal distortion, but the voice lacks the high-energy intensity needed to match an energetic fitness instructor.Voice Cloning Quality✓ WorkedProduces a natural, professional-sounding voice that fits neutral educational narration.Voice Cloning Quality⚠ StruggledThe dubbed voice sounds less natural and slightly robotic, and it does not preserve the speaker's emotion or personality well.
Provenance
- Observation
- 94c02683-3cce-4dc6-be59-1c5eff13ba42
- Evidence run
- 9feca581-b454-4bda-a610-a646cd0092f0
- Study
- Translate Videos with Voice Cloning and Lip Sync Using AI
- Research task
- 86b96dfpf
- Tested at
- Jun 24, 2026
- Source
- first-party
- Evidence state
- verified
- Proof shown
- output only
- Cost / latency
- not captured
- Repeat run
- not captured
- Tester
- not captured
The last three rows are honest blanks, not placeholders — our capture has no field for them yet.
Query this
get_evidence({
tool: "dubverse",
scenario: "video-translation-voice-clone-lip-sync"
})MCP · mcp.aidemos.com/api/mcp
Free with attribution.
Same input, same check — 5 other tools
measured on Lip Sync Accuracy
D-ID✗ FailedLip sync only matched the generated AI avatar; the tool does not lip-sync the original fitness footage.ElevenLabs✗ FailedNo lip-sync feature was provided, so the dubbing could not automatically match the original Hindi mouth movements.Heygen◐ MixedLip sync is acceptable, but it weakens on longer sentences.Rask AI◐ MixedMaintains usable lip sync, but expressive moments can introduce minor inconsistencies and slight breaks in alignment.Sync Labs◐ MixedLip sync worked overall, but it struggled during expressive facial movements and fast speech.
This evidence is published in
Real inputs and real outputs, no retouching · every cell queryable via API & MCP · aidemos.com