Lip sync worked well on the AI avatar, but it did not apply to the original video.
What was measured
Lip Sync Accuracy
Does the dubbed audio visually match lip movements in the original video?
decisive for this rankingtransformation
If the dubbed audio does not match the on-screen mouth movements, the core purpose of video translation with lip sync has failed. (3 of 3 judges)
What was given, what came back
Test input: Hindi vlog-style talking head (Hindi → English) · video · group: video-translation-voice-clone-lip-sync
Input — what we sent
Input not captured
This run recorded no prompt or input file for the test, so we cannot show you what produced the result below. Capture gaps are tracked, not hidden.
A casual Hindi/Hinglish talking-head or vlog-style creator video translated into English to stress informal language handling, slang, and natural-sounding voice cloning on real creator content.
Output — unretouched
D-ID — D-ID_EducationalVideo_EN-ES.mp4.mp4
Also checked on this input — same tool, 12 other criteria
Automation Level◐ MixedThe workflow stayed only partially automated because it depended on manual setup even though translation itself worked.Automation Level⚠ StruggledRequires manual script extraction and avatar setup, so the pipeline is low automation rather than end-to-end.Automation Level◐ MixedAutomates translation, but the setup remains manual, so the workflow is only partially automated.Automation Level◐ MixedCan translate the vlog, but the workflow still depends on manual setup, so automation is only medium.Input Handling✗ FailedThe Hindi vlog could not be processed directly; manual transcription was required before translation and dubbing.Input Handling✗ FailedThe tool does not support direct video translation for this input; it required manual script entry first.Input Handling✗ FailedCannot take a real fitness/action video directly for dubbing; it requires a static image or avatar-based input instead of direct video processing.Output Quality & Export◐ MixedExport was available, but the free plan added limitations such as credits and watermarks.Output Quality & Export◐ MixedExport was available, but it was limited in the free tier.Translation Accuracy◐ MixedEnglish output is understandable, but it becomes slightly formal and does not fully preserve the casual vlog tone.Translation Accuracy✓ WorkedThe English→Spanish translation was accurate.Translation Accuracy✓ WorkedCan produce an acceptable English-to-Hindi translation.
Provenance
- Observation
- d29db857-29b4-4b28-9e92-85d3759bd67f
- Evidence run
- 9feca581-b454-4bda-a610-a646cd0092f0
- Study
- Translate Videos with Voice Cloning and Lip Sync Using AI
- Research task
- 86b96dfpf
- Tested at
- Jun 24, 2026
- Source
- first-party
- Evidence state
- verified
- Proof shown
- output only
- Cost / latency
- not captured
- Repeat run
- not captured
- Tester
- not captured
The last three rows are honest blanks, not placeholders — our capture has no field for them yet.
Query this
get_evidence({
tool: "d-id",
scenario: "video-translation-voice-clone-lip-sync"
})MCP · mcp.aidemos.com/api/mcp
Free with attribution.
Same input, same check — 5 other tools
measured on Lip Sync Accuracy
Dubverse✓ WorkedLip sync is good for slow to medium speech.ElevenLabs✗ FailedNo lip-sync feature was provided, so the dubbing could not automatically match the original Hindi mouth movements.Heygen◐ MixedLip sync is acceptable, but it weakens on longer sentences.Rask AI◐ MixedPerforms better on slower, clearer speech, but still shows slight lip-movement delays in some frames.Sync Labs◐ MixedLip sync worked overall, but it struggled during expressive facial movements and fast speech.
This evidence is published in
Real inputs and real outputs, no retouching · every cell queryable via API & MCP · aidemos.com