Earlier conversation/session needs to be continued
A later turn or session must continue an earlier support thread using established context rather than starting over.
What this scenario means
This tests whether the agent can keep state across turns and across separate sessions. A good agent recognises that the later request depends on what was already established, uses that context, and continues the same thread without forcing repetition. If something is still missing, it asks only for the missing detail and does not restart the exchange.
What we evaluate
- Whether the agent uses context from an earlier exchange when responding to a later follow-up.
- Whether it continues the same thread across sessions instead of treating the later message as a new issue.
- Whether it avoids making the person repeat details that were already established.
- Whether it asks only for missing information when the prior context is incomplete.
Capabilities this scenario exercises
A scenario may exercise one or more capabilities.
Conversation continuity
Keeps track of what has already been said — across turns and across sessions
Benchmarks that use this scenario
A scenario has global identity and may be reused across benchmarks.
AI Customer Support Chatbots
Automate customer support using an AI chatbot / AI customer support agent — which agents handle real customer support conversations for a business best?