The next question refers to the previous answer
A follow-up question refers back to the immediately preceding answer and keeps that referent unchanged.
What this scenario means
This scenario tests whether the agent preserves conversational context across turns. A good agent resolves the follow-up from the prior answer, keeps the same referent in play, and does not silently substitute a new set or recompute the target from fresh assumptions.
What we evaluate
- Whether the agent resolves the follow-up from the immediately preceding answer.
- Whether the same referent stays in force across the turn instead of being silently replaced or recomputed.
- Whether the agent answers using the prior answer’s context without needing the original question repeated.
Capabilities this scenario exercises
A scenario may exercise one or more capabilities.
Conversational Interaction
Holds a working session rather than a series of isolated queries: context carried, questions refined, direction changed, ambiguity raised.
Benchmarks that use this scenario
A scenario has global identity and may be reused across benchmarks.
AI Database Agents
Which AI database agent answers business questions about a live relational database correctly — in the company's own terms, and honestly when the data cannot answer?