The initial generated clip did not render captions automatically, so caption support was not built into the first output.
What was measured
Caption quality
Whether captions are accurate, readable, well-timed, and styled in a way that fits short-form social ads.
decisive for this rankingtransformation
Captions are part of the ad experience in short-form video and affect clarity, pacing, and perceived polish, so poor captions hurt the actual output. (3 of 3 judges)
What was given, what came back
Test input: FutureSmart AI – SaaS · text
Input — what we sent
The exact prompt
Product URL: https://aidemos.com/ Exact Script Hook: Finding the right AI tools shouldn't take hours. Script: I've been using FutureSmart AI to discover and compare AI tools in one place. It helps me find the right tool faster with real use cases, rankings, and detailed comparisons. If you regularly use AI tools for work, it's definitely worth checking out. Output Requirements - Vertical (9:16) - 20–30 seconds - UGC-style AI presenter - Natural AI voice - Captions enabled
A short-form UGC-style video ad prompt for a SaaS product, designed to test whether a tool can understand a software offering and turn a concise testimonial script into a believable ad.
Why this input is hard
- · SaaS product understanding
- · script quality
- · avatar realism
- · voice quality
- · caption quality
- · overall ad readiness
Output — unretouched
Also checked on this input — same tool, 5 other criteria
Ad-readiness◐ MixedThe platform can complete the full export workflow, but the output still feels basic rather than fully polished UGC for paid use.Avatar realism◐ MixedThe presenter stays consistent, but still reads as somewhat AI-generated and less natural in some moments.Platform formats✓ WorkedProduced a vertical 9:16 short-form video export, matching the TikTok/Instagram Reels/YouTube Shorts format the report targets.Script quality & persuasiveness◐ MixedThe tool can deliver a supplied SaaS script in a clear, organized way, but the result is more structured than organic UGC.Voice quality✓ WorkedThe generated voice is understandable and suitable for informational or promotional narration, with stable delivery across the clip.
Provenance
- Observation
- 507d983e-3872-4daa-b63a-001e2edd8399
- Evidence run
- f91a51ec-b400-46fe-97f5-7e779fe17532
- Study
- Generate UGC-Style Video Ads With AI Avatars
- Research task
- 86baxegpg
- Tested at
- not recorded
- Source
- first-party
- Evidence state
- verified
- Proof shown
- input + output shown
- Cost / latency
- not captured
- Repeat run
- not captured
- Tester
- not captured
The last three rows are honest blanks, not placeholders — our capture has no field for them yet.
Query this
get_evidence({
tool: "akool"
})MCP · mcp.aidemos.com/api/mcp
Free with attribution.
Same input, same check — 3 other tools
measured on Caption quality
Creatify.ai✓ WorkedCaptions are generated correctly and stay synced with the speech, making the output readable and accessible.Topview AI◐ MixedCaptions are generated and generally aligned with the spoken line, but the report notes minor timing issues.Vidnoz AI◐ MixedCaptions are not included by default and are added after generation; the visible subtitle render begins with a duplicated phrase ('Welcome to FutureSmart AI AI to discover'), showing the caption output is not clean out of the box.
This evidence is published in
From the same study (page rebuilt from a later run)
Real inputs and real outputs, no retouching · every cell queryable via API & MCP · aidemos.com