Scenario definition · S25
Feedback can be submitted
A user can submit feedback or a correction about a prior answer.
What this scenario means
This scenario tests whether the product accepts feedback about an earlier answer and records it as a valid user action. A good system lets the feedback be submitted clearly, keeps it tied to the answer it concerns, and does not reject it as ordinary conversation noise. It is a basic check that correction input is handled as feedback, not ignored or misread.
What we evaluate
- Whether feedback or a correction about a prior answer can be submitted successfully.
- Whether the submission is linked to the earlier answer it refers to.
- Whether the system accepts the feedback without treating it as an unrelated new request.
◌Test-case detail. Exact wording, inputs, fixture state, expected output and detailed grading remain at the test-case level and may be withheld while the benchmark version is active. The scenario and its evaluation intent are public.
Capabilities this scenario exercises
A scenario may exercise one or more capabilities.
Feedback and learning
Accepts corrections and improves future answers
Benchmarks that use this scenario
A scenario has global identity and may be reused across benchmarks.
AI Customer Support Chatbots
Automate customer support using an AI chatbot / AI customer support agent — which agents handle real customer support conversations for a business best?