Holds the near-profile angle closely and keeps the character recognizable, though the facial features are slightly refined and smoothed compared with the reference.
What was measured
Identity preservation
How closely the generated face matches the reference image across scenes.
decisive for this rankingtransformation
This is the core of the task: the tool must keep the same character looking like the reference image across scenes. (3 of 3 judges)
What was given, what came back
Test input: Near-profile occluded portrait stress test · image
Input — what we sent
Input not captured
This run recorded no prompt or input file for the test, so we cannot show you what produced the result below. Capture gaps are tracked, not hidden.
Near-profile portrait reference used as the maximum-difficulty stress test: face turned roughly 80–90 degrees, one eye partially occluded by fringe, short dark wavy hair, and natural outdoor lighting. Designed to probe whether tools can preserve identity under severe pose and occlusion.
Why this input is hard
- · Near-profile identity preservation
- · Occlusion handling
- · Extreme pose consistency
- · Lighting and hair-detail retention under stress
Output — unretouched
Also checked on this input — same tool, 2 other criteria
Accessory & detail retention✓ WorkedPreserves the short dark wavy hair’s volume and texture in the stress-test output, even though the face is lightly beautified.Scene compliance✓ WorkedMatches the rooftop prompt well: full-body framing, black turtleneck, beige wide-leg trousers, golden-hour amber lighting, city skyline, and rooftop railing are all present.
Provenance
- Observation
- 7813fc39-8282-479d-adb5-7b09e09a84cc
- Evidence run
- 1dfb8fa4-f7f0-47dc-911b-7db3af467e9a
- Study
- Generate Consistent AI Characters Across Different Scenes and Poses
- Research task
- 86b96df11
- Tested at
- not recorded
- Source
- first-party
- Evidence state
- verified
- Proof shown
- output only
- Cost / latency
- not captured
- Repeat run
- not captured
- Tester
- not captured
The last three rows are honest blanks, not placeholders — our capture has no field for them yet.
Query this
get_evidence({
tool: "chatgpt"
})MCP · mcp.aidemos.com/api/mcp
Free with attribution.
Same input, same check — 4 other tools
measured on Identity preservation
Gemini✗ FailedUnder the near-profile stress test, the tool produces a generic-looking face that no longer closely matches the reference.ImagineArt⚠ StruggledThe rooftop output does not maintain the near-profile stress condition, because the face is rendered more frontally visible than specified.Leonardo AI✗ FailedWhen the face is rotated past near-profile, the tool over-rotates into a near-back view and identity verification becomes impossible.Scenario✓ WorkedIt handles a near-profile reference cleanly, preserving the side-angle jawline, nose profile, and lip shape instead of reverting to a frontal face.
This evidence is published in
Real inputs and real outputs, no retouching · every cell queryable via API & MCP · aidemos.com