Captions were generated and generally aligned with speech, but the run had minor timing issues.
What was measured
Caption quality
Accurate, well-timed captions with appropriate, on-trend styling.
decisive for this rankingtransformation
Accurate, well-timed captions are part of the finished ad and affect clarity and performance on social platforms. (3 of 3 judges)
What was given, what came back
Test input: FutureSmart AI – SaaS · mixed · group: ugc-style-video-ads
Input — what we sent
Input, verbatim
Product URL: https://aidemos.com/ Exact script: Hook: Finding the right AI tools shouldn't take hours. Script: I've been using FutureSmart AI to discover and compare AI tools in one place. It helps me find the right tool faster with real use cases, rankings, and detailed comparisons. If you regularly use AI tools for work, it's definitely worth checking out. Output requirements: - Vertical (9:16) - 20–30 seconds - UGC-style AI presenter - Natural AI voice - Captions enabled
A short-form UGC ad prompt for a SaaS product discovery/comparison platform, designed to test whether the tool understands a software product, writes a believable testimonial-style script, and produces a realistic AI presenter video with captions.
Why this input is hard
- · SaaS product understanding
- · Script quality
- · Avatar realism
- · Voice quality
- · Caption quality
- · Overall ad readiness
Output — unretouched
Also checked on this input — same tool, 4 other criteria
Avatar realism◐ MixedThe tool can keep a vertical presenter visible throughout the clip, but the presenter still reads as AI-generated: the report says realism was lower than higher-end tools and expression/gesture range was minimal.B-roll / product integration⚠ StruggledThe output stays on a single talking-head studio shot with no product footage, screenshots, or other supporting visuals, so product integration is absent.Script quality & persuasiveness◐ MixedThe promo script is delivered, but the performance feels slightly robotic rather than like natural UGC, which weakens the testimonial feel.Voice quality✓ WorkedIt produced a clear, consistent voice that stayed understandable through the whole video and fit the informational/promotional script.
Provenance
- Observation
- f52e38cf-6d84-4ef5-a6e0-428548537f6a
- Evidence run
- 9fdbb84b-4aa0-484d-8f89-5c46608019a5
- Study
- Generate UGC-Style Video Ads With AI Avatars
- Research task
- 86baxegpg
- Tested at
- not recorded
- Source
- first-party
- Evidence state
- verified
- Proof shown
- input + output shown
- Cost / latency
- not captured
- Repeat run
- not captured
- Tester
- not captured
The last three rows are honest blanks, not placeholders — our capture has no field for them yet.
Query this
get_evidence({
tool: "topview-ai",
scenario: "ugc-style-video-ads"
})MCP · mcp.aidemos.com/api/mcp
Free with attribution.
Same input, same check — 5 other tools
measured on Caption quality
AKOOL✗ FailedDoes not automatically include captions in the initial output; the preview showed no captions during the tested workflow.HeyGen✗ FailedCaptioning is absent in the FutureSmart run: the researcher checked 8 timestamps from 0s through 14.9s and found zero burned-in text anywhere in the clip.Invideo AI✓ WorkedThe captions advance progressively and stay readable, and the report says they are well-timed to speech up to the cutoff.JoggAI✗ FailedThe tool can export a clip with zero on-screen captions for the full 18.4 seconds, so captioning is not baked into the output.Vidnoz AI◐ MixedCan generate burned-in subtitles and lets the user edit them after creation, but the caption text can be awkward—the preview shows a duplicated opening phrase, 'Welcome to FutureSmart AI AI to discover'.
This evidence is published in
Real inputs and real outputs, no retouching · every cell queryable via API & MCP · aidemos.com