Scenario definition · S22
Conversation activity can be inspected
A prior conversation or activity must be available to locate and open for inspection.
What this scenario means
This tests whether the product exposes earlier conversation history clearly enough to be found and reviewed. A good product lets someone locate the prior activity, open it, and inspect what happened without losing the thread.
What we evaluate
- Whether earlier conversation activity can be located in the product interface.
- Whether the located conversation can be opened for review.
- Whether the inspection view exposes the prior activity clearly enough to inspect what happened.
◌Test-case detail. Exact wording, inputs, fixture state, expected output and detailed grading remain at the test-case level and may be withheld while the benchmark version is active. The scenario and its evaluation intent are public.
Capabilities this scenario exercises
A scenario may exercise one or more capabilities.
Analytics and observability
Lets the operator see what the agent did, inspect any conversation, and trust the reported numbers
Benchmarks that use this scenario
A scenario has global identity and may be reused across benchmarks.
AI Customer Support Chatbots
Automate customer support using an AI chatbot / AI customer support agent — which agents handle real customer support conversations for a business best?