The answer is a trend or a comparison
The answer calls for a trend or comparison, so the product should present it in a form that makes the pattern visible.
What this scenario means
This scenario checks whether the product can choose a presentation that fits a multi-point answer. A trend or comparison should not be dumped as plain rows when the structure itself matters. A good agent makes the change, difference, or relationship easy to see, and keeps the underlying values aligned with the answer asked for.
What we evaluate
- Whether the response uses a form that makes change or comparison easy to see.
- Whether the product avoids presenting the answer as an undifferentiated row dump when a structured view is more suitable.
- Whether the chosen presentation matches the kind of answer being asked for, rather than staying in a default format.
Capabilities this scenario exercises
A scenario may exercise one or more capabilities.
Answer Presentation
Decides and adjusts how the answer is represented — prose, a table, a chart, or a combination — and changes it on request.
Benchmarks that use this scenario
A scenario has global identity and may be reused across benchmarks.
AI Database Agents
Which AI database agent answers business questions about a live relational database correctly — in the company's own terms, and honestly when the data cannot answer?