The busy-street export runs as one continuous 20-second white-background result and matches the input duration/frame count exactly.
What was measured
Temporal consistency
Does the mask flicker or shift between frames, or stay stable across the clip?
decisive for this rankingtransformation
Stable masks across frames are essential in video; flicker or shifting means the background removal is visibly broken. (3 of 3 judges)
What was given, what came back
Test input: Busy Urban Street · video · group: remove-or-replace-video-backgrounds-using-ai
Input — what we sent
Busy Urban Street
A video of a person walking through a busy city street with multiple people, moving vehicles, and a visually complex urban background. It was used to stress segmentation and tracking under heavy background distraction and continuous motion.
Why this input is hard
- · Complex background segmentation
- · Handling background distractions
- · Subject tracking
- · Temporal consistency across frames
- · Edge accuracy during continuous movement
Output — unretouched
Also checked on this input — same tool, 2 other criteria
Motion handling✗ FailedOnce a second pedestrian walked close to the camera around 0:16–0:17, the matting broke down and large chunks of the original street scene bled through around her instead of being erased.Motion handling⚠ StruggledAt several other points in the busy-street clip, incompletely erased gray blobs and leftover pedestrian traces lingered on the white background instead of being fully removed.
Provenance
- Observation
- 7d430cbf-8489-4aca-a152-7480a37e9abc
- Evidence run
- 10155228-7ce8-438a-a210-547331ef080b
- Study
- Remove or Replace Video Backgrounds Using AI
- Research task
- 86ba42c2d
- Tested at
- not recorded
- Source
- first-party
- Evidence state
- verified
- Proof shown
- input + output shown
- Cost / latency
- not captured
- Repeat run
- not captured
- Tester
- not captured
The last three rows are honest blanks, not placeholders — our capture has no field for them yet.
Query this
get_evidence({
tool: "kapwing",
scenario: "remove-or-replace-video-backgrounds-using-ai"
})MCP · mcp.aidemos.com/api/mcp
Free with attribution.
Same input, same check — 4 other tools
measured on Temporal consistency
FlexClip◐ MixedThe snow-like speckle, head halo, and ground-shadow artifacts recur across sampled frames, so the defects are temporally persistent rather than flickering on and off.Fotor✓ WorkedThe matte boundary stayed stable across the full clip, with no jitter at the checked start, middle, and end timestamps.InVideo AI✓ WorkedThe replacement background stayed steady despite continuous camera motion, with no visible flicker or warping across the clip.Picsart✓ WorkedThe busy-street matte stayed stable across the full 292-frame, 9.73-second clip, with no flicker, dropout, truncation, or padding.
This evidence is published in
Real inputs and real outputs, no retouching · every cell queryable via API & MCP · aidemos.com