Scenario definition · S54

The user wants to keep an answer they just got

A person asks to save a just-produced answer so it can be reopened later without changing what it says.

What this scenario means

This scenario tests whether the system preserves an answer as a durable artifact rather than a one-off response. A good agent saves it in a way that can be reopened later and still reproduces the same answer. The hard part is keeping both the content and its identity stable over time.

What we evaluate

  • Whether a recently produced answer can be saved as a durable artifact.
  • Whether reopening the saved item later reproduces the same answer.
  • Whether the reopened item is still recognisably the same saved result.
◌Test-case detail. Exact wording, inputs, fixture state, expected output and detailed grading remain at the test-case level and may be withheld while the benchmark version is active. The scenario and its evaluation intent are public.

Capabilities this scenario exercises

A scenario may exercise one or more capabilities.

Capability

Reporting

Turning analysis the agent produced into a durable, re-runnable artifact that still means the same thing later.

Benchmarks that use this scenario

A scenario has global identity and may be reused across benchmarks.

The user wants to keep an answer they just got — Scenario definition | AI Demos