Captions are generated correctly and stay synced with the speech, making the output readable and accessible.
What was measured
Caption quality
Whether captions are accurate, readable, well-timed, and styled in a way that fits short-form social ads.
decisive for this rankingtransformation
Captions are part of the ad experience in short-form video and affect clarity, pacing, and perceived polish, so poor captions hurt the actual output. (3 of 3 judges)
What was given, what came back
Test input: FutureSmart AI – SaaS · text
Input — what we sent
The exact prompt
Product URL: https://aidemos.com/ Exact Script Hook: Finding the right AI tools shouldn't take hours. Script: I've been using FutureSmart AI to discover and compare AI tools in one place. It helps me find the right tool faster with real use cases, rankings, and detailed comparisons. If you regularly use AI tools for work, it's definitely worth checking out. Output Requirements - Vertical (9:16) - 20–30 seconds - UGC-style AI presenter - Natural AI voice - Captions enabled
A short-form UGC-style video ad prompt for a SaaS product, designed to test whether a tool can understand a software offering and turn a concise testimonial script into a believable ad.
Why this input is hard
- · SaaS product understanding
- · script quality
- · avatar realism
- · voice quality
- · caption quality
- · overall ad readiness
Output — unretouched
Also checked on this input — same tool, 6 other criteria
Ad-readiness◐ MixedThe output is close to ready for social media use and required minimal to no editing, but the free-plan watermark and slight script drift reduce its polish as a paid ad without follow-up fixes.Avatar realism✓ WorkedThe avatar presentation is visually convincing and close to a real human, with accurate lip sync, smooth delivery, and natural gestures.Platform formats✓ WorkedThe generator outputs a short-form vertical video in 9:16 format suitable for TikTok, Reels, and Shorts.Product understanding✓ WorkedThe tool can preserve a SaaS product framing and generate a coherent ad from the provided product information instead of collapsing it into a generic software promo, though minor wording drift can occur.Script quality & persuasiveness◐ MixedThe script can carry a UGC-style product pitch, but the evaluation observed 2–3 words being modified, which can slightly weaken message precision and polish.Voice quality◐ MixedThe generated voice is clear and human-like and fits UGC-style ads, but the report also notes occasional phrasing and tone that did not sound perfectly natural/native English.
Provenance
- Observation
- 828b7576-595d-44e6-acb4-8b9e7a77acdf
- Evidence run
- f91a51ec-b400-46fe-97f5-7e779fe17532
- Study
- Generate UGC-Style Video Ads With AI Avatars
- Research task
- 86baxegpg
- Tested at
- not recorded
- Source
- first-party
- Evidence state
- verified
- Proof shown
- input + output shown
- Cost / latency
- not captured
- Repeat run
- not captured
- Tester
- not captured
The last three rows are honest blanks, not placeholders — our capture has no field for them yet.
Query this
get_evidence({
tool: "creatify-ai"
})MCP · mcp.aidemos.com/api/mcp
Free with attribution.
Same input, same check — 3 other tools
measured on Caption quality
AKOOL✗ FailedThe initial generated clip did not render captions automatically, so caption support was not built into the first output.Topview AI◐ MixedCaptions are generated and generally aligned with the spoken line, but the report notes minor timing issues.Vidnoz AI◐ MixedCaptions are not included by default and are added after generation; the visible subtitle render begins with a duplicated phrase ('Welcome to FutureSmart AI AI to discover'), showing the caption output is not clean out of the box.
This evidence is published in
From the same study (page rebuilt from a later run)
Real inputs and real outputs, no retouching · every cell queryable via API & MCP · aidemos.com