The tool can keep a subject recognisably the same person in an action scene, with face shape, eyes, and overall look staying close to the reference.
What was measured
Identity preservation
How closely the generated face matches the reference image across scenes.
decisive for this rankingtransformation
This is the core of the task: the tool must keep the same character looking like the reference image across scenes. (3 of 3 judges)
What was given, what came back
Test input: Full frontal portrait · image
Input — what we sent
Full frontal portrait
Full frontal portrait reference image with fair skin, curly dark hair, bindi, gold jhumka earrings, and a green stone necklace. All features are clearly visible in good natural lighting, making it the easiest identity anchor for the tools.
Why this input is hard
- · Baseline identity preservation
- · Accessory retention
- · Best-case frontal face matching
- · Consistent character reuse across varied scenes
Output — unretouched
Also checked on this input — same tool, 2 other criteria
Expression accuracy✗ FailedIt fails to map an angry or guarded prompt onto the face; the output stays neutral or calm and even reads with a slight smile.Scene compliance◐ MixedIt can reproduce the interrogation-room setup and wardrobe, but the requested harsh mood is softened because the lighting and facial affect stay gentle.
Provenance
- Observation
- ed66c473-a880-4d06-8d75-0990ec076849
- Evidence run
- 1dfb8fa4-f7f0-47dc-911b-7db3af467e9a
- Study
- Generate Consistent AI Characters Across Different Scenes and Poses
- Research task
- 86b96df11
- Tested at
- not recorded
- Source
- first-party
- Evidence state
- verified
- Proof shown
- input + output shown
- Cost / latency
- not captured
- Repeat run
- not captured
- Tester
- not captured
The last three rows are honest blanks, not placeholders — our capture has no field for them yet.
Query this
get_evidence({
tool: "scenario"
})MCP · mcp.aidemos.com/api/mcp
Free with attribution.
Same input, same check — 4 other tools
measured on Identity preservation
ChatGPT⚠ StruggledIdentity drops to only a 50–70% match in an action scene, with significant facial-structure drift away from the reference even though the body styling remains plausible.Gemini✗ FailedAgainst the full-frontal reference, the warm cafe output can drift into a different character: it was judged very weak and the report says multiple facial features changed.ImagineArt⚠ StruggledThe desert-horse output shows clear identity drift, with the eye shape, nose structure, jawline, and face proportions all differing from the reference.Leonardo AI⚠ StruggledThe tool can keep the café mood and pose while drifting the face enough that a frontal reference reads as a lookalike rather than the same person.
This evidence is published in
Real inputs and real outputs, no retouching · every cell queryable via API & MCP · aidemos.com