The script is delivered verbatim from start to finish and lands on a natural CTA, ending correctly on 'give Duolingo a try.'
What was measured
Script quality & persuasiveness
Strong hook, clear value proposition, and natural CTA that sounds like UGC rather than a brochure.
decisive for this rankingtransformation
The whole point is to produce ads that hook viewers and persuade them, so script quality directly determines success. (3 of 3 judges)
What was given, what came back
Test input: Duolingo – Mobile App · mixed · group: ugc-style-video-ads
Input — what we sent
Input, verbatim
Product URL: https://www.duolingo.com/ Exact script: Hook: Learning a new language has never been this easy. Script: I've been using Duolingo for a few minutes every day, and it's made language learning simple and fun. The short lessons are easy to follow, and the daily practice keeps me motivated. If you're planning to learn a new language, give Duolingo a try. Output requirements: - Vertical (9:16) - 20–30 seconds - UGC-style AI presenter - Natural AI voice - Captions enabled
A short-form UGC promo prompt for a consumer mobile app, designed to test whether the tool can explain app benefits simply and persuasively while generating a realistic AI-presenter video.
Why this input is hard
- · Mobile app understanding
- · Consumer app promotion
- · Script quality
- · Avatar realism
- · Voice quality
- · Caption quality
- · Overall ad readiness
Output — unretouched
Also checked on this input — same tool, 5 other criteria
Avatar realism✓ WorkedThe Duolingo output reads as a casual creator-style presenter rather than an AI-obvious stock avatar, with the report calling the setting genuinely UGC-authentic.B-roll / product integration✗ FailedThe supporting footage is not product-integrated because the cutaway uses the wrong app entirely, so the B-roll does not match the Duolingo testimonial being spoken.Caption quality◐ MixedCaptions are present, but around 0:04-0:05 they overlap with a leftover badge graphic and become garbled, creating hard-to-read double-exposed text.Platform formats✓ WorkedThis is the only run that delivers the requested full-bleed vertical 9:16 frame with no letterboxing.Product understanding✗ FailedProduct understanding breaks in the B-roll cutaway: the phone screen shows a shopping app ('NEW YORK BAG $219, ADD TO CART') instead of Duolingo or any language-learning interface.
Provenance
- Observation
- 64e1c84b-48cc-4206-a23d-413108d746c3
- Evidence run
- 9fdbb84b-4aa0-484d-8f89-5c46608019a5
- Study
- Generate UGC-Style Video Ads With AI Avatars
- Research task
- 86baxegpg
- Tested at
- not recorded
- Source
- first-party
- Evidence state
- verified
- Proof shown
- input + output shown
- Cost / latency
- not captured
- Repeat run
- not captured
- Tester
- not captured
The last three rows are honest blanks, not placeholders — our capture has no field for them yet.
Query this
get_evidence({
tool: "heygen",
scenario: "ugc-style-video-ads"
})MCP · mcp.aidemos.com/api/mcp
Free with attribution.
Same input, same check — 5 other tools
measured on Script quality & persuasiveness
AKOOL◐ MixedCommunicates the app benefits clearly, but the tone is flat and less engaging, so the UGC pitch is only mildly persuasive.Invideo AI✓ WorkedThe script is reproduced verbatim and reaches the closing CTA line without truncation, so the testimonial structure and call-to-action remain intact.Synthesia◐ MixedThe Duolingo script explained the app benefits clearly, but the report says the presentation felt less engaging for UGC ads and had limited emotional expressiveness.Topview AI◐ MixedThe app promo is clear, but the tone is flat and less engaging for a language-learning ad.Vidnoz AI◐ MixedKeeps the script simple and clear, but the emotional tone stays neutral, so the promo is serviceable rather than especially compelling.
This evidence is published in
Real inputs and real outputs, no retouching · every cell queryable via API & MCP · aidemos.com