The tool can produce a single static shot with no cutaways and no product visuals, so the app never gets any supporting footage.
What was measured
B-roll / product integration
Relevant supporting footage or product shots, when the tool offers them.
decisive for this rankingtransformation
Relevant product shots and supporting footage help determine whether the ad feels complete and convincing. (3 of 3 judges)
What was given, what came back
Test input: Duolingo – Mobile App · mixed · group: ugc-style-video-ads
Input — what we sent
Input, verbatim
Product URL: https://www.duolingo.com/ Exact script: Hook: Learning a new language has never been this easy. Script: I've been using Duolingo for a few minutes every day, and it's made language learning simple and fun. The short lessons are easy to follow, and the daily practice keeps me motivated. If you're planning to learn a new language, give Duolingo a try. Output requirements: - Vertical (9:16) - 20–30 seconds - UGC-style AI presenter - Natural AI voice - Captions enabled
A short-form UGC promo prompt for a consumer mobile app, designed to test whether the tool can explain app benefits simply and persuasively while generating a realistic AI-presenter video.
Why this input is hard
- · Mobile app understanding
- · Consumer app promotion
- · Script quality
- · Avatar realism
- · Voice quality
- · Caption quality
- · Overall ad readiness
Output — unretouched
Also checked on this input — same tool, 4 other criteria
Avatar realism✓ WorkedGenerates a strong-looking photorealistic avatar with no visible artifacts; the report says the face, hair, and teeth look natural even in a wide smile.Caption quality✗ FailedThe tool can export a clip with zero on-screen captions for the full 13.5 seconds, so subtitles are absent even on a mobile-app promo.Platform formats◐ MixedThe export format is correct at full-bleed vertical 9:16 (1080×1920), but the clip is only 13.5 seconds long, below the requested 20–30 second range.Product understanding✗ FailedFor an app prompt, the tool can leave out the app completely and produce only an avatar talking to camera, with no screenshot, graphic, or in-video product reference.
Provenance
- Observation
- 55217f13-202c-4c01-bdf0-0029a47654a7
- Evidence run
- 9fdbb84b-4aa0-484d-8f89-5c46608019a5
- Study
- Generate UGC-Style Video Ads With AI Avatars
- Research task
- 86baxegpg
- Tested at
- not recorded
- Source
- first-party
- Evidence state
- verified
- Proof shown
- input + output shown
- Cost / latency
- not captured
- Repeat run
- not captured
- Tester
- not captured
The last three rows are honest blanks, not placeholders — our capture has no field for them yet.
Query this
get_evidence({
tool: "joggai",
scenario: "ugc-style-video-ads"
})MCP · mcp.aidemos.com/api/mcp
Free with attribution.
Same input, same check — 6 other tools
measured on B-roll / product integration
AKOOL✗ FailedAdds no app UI or other product footage at all.HeyGen✗ FailedThe supporting footage is not product-integrated because the cutaway uses the wrong app entirely, so the B-roll does not match the Duolingo testimonial being spoken.Invideo AI◐ MixedThe clip adds a timed phone-and-coffee cutaway, but the screen content is blurred and generic instead of product-specific, so the supporting footage does not fully reinforce the app.Topview AI⚠ StruggledThe podcast-style output does not show the Duolingo app UI, so the ad lacks contextual app integration.VEED⚠ StruggledThe Duolingo output is a talking-head clip, and the report says the Duolingo UI was not automatically included, so contextual app visuals were not supplied by default.Vidnoz AI✗ FailedDoes not add app UI or other contextual footage; the output remains a generic talking-head video with a plain background.
This evidence is published in
Real inputs and real outputs, no retouching · every cell queryable via API & MCP · aidemos.com