For a physical-product prompt, the tool can omit the product entirely and keep the ad grounded only in a face-only testimonial shot, so the product itself is never actually integrated.
What was measured
Product understanding
Whether the tool gets the product right in features and positioning, rather than being generic or inaccurate.
decisive for this rankingtransformation
An ad has to describe the product accurately and position it correctly; generic or wrong messaging breaks the output. (3 of 3 judges)
What was given, what came back
Test input: Nike Pegasus 41 – Physical Product · mixed · group: ugc-style-video-ads
Input — what we sent
Input, verbatim
Product URL: https://www.nike.com/t/pegasus-41-mens-road-running-shoes-LMhrRG/FD2722-002 Exact script: Hook: These are my new favorite running shoes. Script: I've been wearing the Nike Pegasus 41 for my daily runs, and they've been incredibly comfortable from day one. They're lightweight, well-cushioned, and great for everyday training. If you're looking for dependable running shoes, they're definitely worth considering. Output requirements: - Vertical (9:16) - 20–30 seconds - UGC-style AI presenter - Natural AI voice - Captions enabled
A short-form UGC testimonial prompt for a physical consumer product, designed to test product comprehension, believable praise for a running shoe, and ad-style video generation quality.
Why this input is hard
- · Physical product understanding
- · UGC testimonial quality
- · Product presentation
- · Avatar realism
- · Voice quality
- · Commercial ad readiness
Output — unretouched
Also checked on this input — same tool, 4 other criteria
Avatar realism✓ WorkedGenerates a believable photorealistic presenter with convincing face detail and natural-looking motion; the report describes excellent skin texture, eyes, teeth, and close-up realism.B-roll / product integration✗ FailedThe tool can omit all product-supporting footage, producing a tight face-only crop with no held-up product, no B-roll, and no scene variety.Caption quality✗ FailedThe tool can export a clip with zero on-screen captions for the full 15.8 seconds, leaving the short-form ad uncaptioned.Platform formats◐ MixedThe export format is correct at full-bleed vertical 9:16 (1080×1920), but the clip is only 15.8 seconds long, below the requested 20–30 second range.
Provenance
- Observation
- ff954838-bdca-4954-ad0d-bc1db6a3cb88
- Evidence run
- 9fdbb84b-4aa0-484d-8f89-5c46608019a5
- Study
- Generate UGC-Style Video Ads With AI Avatars
- Research task
- 86baxegpg
- Tested at
- not recorded
- Source
- first-party
- Evidence state
- verified
- Proof shown
- input + output shown
- Cost / latency
- not captured
- Repeat run
- not captured
- Tester
- not captured
The last three rows are honest blanks, not placeholders — our capture has no field for them yet.
Query this
get_evidence({
tool: "joggai",
scenario: "ugc-style-video-ads"
})MCP · mcp.aidemos.com/api/mcp
Free with attribution.
Same input, same check — 5 other tools
measured on Product understanding
AKOOL✓ WorkedKeeps the running-shoe testimonial in the right product-review framing, so the product positioning is recognizable even though the visuals stay restrained.Creatify.ai✓ WorkedFor the shoe input, the tool kept the testimonial centered on running-shoe benefits such as comfort, lightweight feel, cushioning, and everyday training use.HeyGen✓ WorkedIt understands the product well enough to surface the correct Pegasus 41 branding and real Nike tech claims such as ReactX foam, +13% energy return, and Dual Zoom Air.Invideo AI✓ WorkedThe tool correctly renders a gray Nike Pegasus shoe with the swoosh, colorway, and AIR ZOOM sole detail, matching the product prompt instead of generic running shoes.Vidnoz AI✓ WorkedUnderstands a running-shoe product well enough to position it as comfortable, lightweight, well-cushioned, and suitable for everyday training.
This evidence is published in
Real inputs and real outputs, no retouching · every cell queryable via API & MCP · aidemos.com