Scenario definition · S5
One message contains multiple requests
A single message contains multiple distinct requests.
What this scenario means
This scenario tests whether an agent can recognise that one turn asks for more than one thing and handle each request without dropping, merging, or misrouting any part. It matters because support messages often bundle related asks, and a good agent separates them cleanly before answering or acting.
What we evaluate
- Whether the agent recognises that more than one request is present in the same turn.
- Whether the agent addresses each request separately rather than treating the message as one task.
- Whether the agent avoids ignoring, merging, or substituting one request for another.
◌Test-case detail. Exact wording, inputs, fixture state, expected output and detailed grading remain at the test-case level and may be withheld while the benchmark version is active. The scenario and its evaluation intent are public.
Capabilities this scenario exercises
A scenario may exercise one or more capabilities.
Intent understanding
Works out what the customer actually wants before answering or acting
Benchmarks that use this scenario
A scenario has global identity and may be reused across benchmarks.
AI Customer Support Chatbots
Automate customer support using an AI chatbot / AI customer support agent — which agents handle real customer support conversations for a business best?