Answer is available in the knowledge base
The source material contains the answer, and the system should surface it.
What this scenario means
This scenario checks the baseline case where relevant information is already present and should be found rather than guessed. It is a simple but important test because later scenarios separate this from absent, reworded, or harder-to-reach information. A good system returns the answer supported by the source material.
What we evaluate
- Whether the system surfaces the answer that is already present in the source material.
- Whether it stays grounded in that source material rather than inventing a different answer.
- Whether the case is handled as a straightforward success when the needed information exists.
Capabilities this scenario exercises
A scenario may exercise one or more capabilities.
Knowledge-grounded answering
Answers customer questions from the company's own knowledge base — not from what the model assumes
Retrieval
The passage that answers the question comes back when the documents hold it — and the absence is discoverable when they don't. Judged against the documents: did the supporting passage come back?
Benchmarks that use this scenario
A scenario has global identity and may be reused across benchmarks.
Managed RAG
Also uses this scenario.
AI Customer Support Chatbots
Automate customer support using an AI chatbot / AI customer support agent — which agents handle real customer support conversations for a business best?