The matte showed no flicker or dropout from frame to frame across the full clip.
What was measured
Temporal consistency
Does the mask flicker or shift between frames, or stay stable across the clip?
decisive for this rankingtransformation
Stable masks across frames are essential in video; flicker or shifting means the background removal is visibly broken. (3 of 3 judges)
What was given, what came back
Test input: Indoor Talking Head · video · group: remove-or-replace-video-backgrounds-using-ai
Input — what we sent
Indoor Talking Head
An indoor talking-head video of a person speaking directly to the camera with a static background, natural hand gestures, and facial expressions. It was used to test how well tools preserve the subject while replacing an indoor background.
Why this input is hard
- · Static camera performance
- · Face and body segmentation
- · Facial expression preservation
- · Background replacement accuracy in an indoor environment
Output — unretouched

Also checked on this input — same tool, 3 other criteria
Edge quality✓ WorkedThe subject's outline is matted cleanly, with no obvious tearing or missing chunks around the silhouette.Hair and fine detail✓ WorkedGlasses and hair were preserved cleanly, with no visible tearing in the matting around those fine details.Output resolution✗ FailedA vertical 1080×1920 input was rendered as a 2462×1080 landscape canvas, instead of preserving the source orientation.
Provenance
- Observation
- 694f744e-7a96-4c65-a73c-bbbd9ad0b92e
- Evidence run
- 10155228-7ce8-438a-a210-547331ef080b
- Study
- Remove or Replace Video Backgrounds Using AI
- Research task
- 86ba42c2d
- Tested at
- not recorded
- Source
- first-party
- Evidence state
- verified
- Proof shown
- input + output shown
- Cost / latency
- not captured
- Repeat run
- not captured
- Tester
- not captured
The last three rows are honest blanks, not placeholders — our capture has no field for them yet.
Query this
get_evidence({
tool: "fotor",
scenario: "remove-or-replace-video-backgrounds-using-ai"
})MCP · mcp.aidemos.com/api/mcp
Free with attribution.
Same input, same check — 5 other tools
measured on Temporal consistency
Cutout.Pro⚠ StruggledThe crop window drifts between frames, with headroom changing from about 5px to 31px and side margins widening from 9/17px to 33/45px.FlexClip◐ MixedThe same softened hairline reappears at a third timestamp, so the fine-detail loss is persistent across frames rather than isolated to one pose.InVideo AI✓ WorkedThe generated studio background stayed stable across the clip, with identical shelf positions and colors at 0:03, 0:08, and 0:13 and no visible flicker or drift.Kapwing✓ WorkedThe full 15.35-second indoor output stays continuous and consistent from start to finish, with no hard cut back to source and no observed flicker or dropout.Picsart✓ WorkedThe talking-head export held a stable matte with exact 271/271 frame parity and a 9.03-second match, with no flicker or dropout.
This evidence is published in
Real inputs and real outputs, no retouching · every cell queryable via API & MCP · aidemos.com