Scenario definition · S84

The retrieved material supports an answer

The retrieved material contains support for the answer.

What this scenario means

This is the baseline grounding case: the needed support is already present in what the system retrieved. It tests whether the system can recognise supported evidence and use it, rather than inventing a claim or treating a supported case like an absent one.

What we evaluate

  • Whether the retrieved material contains enough support for the claim being made.
  • Whether the system can ground its response in the retrieved material rather than outside knowledge.
  • Whether the case is treated as a supported baseline, not as an unsupported or missing-answer case.
◌Test-case detail. Exact wording, inputs, fixture state, expected output and detailed grading remain at the test-case level and may be withheld while the benchmark version is active. The scenario and its evaluation intent are public.

Capabilities this scenario exercises

A scenario may exercise one or more capabilities.

Capability

Answer Generation

Where it writes the answer, does it say only what its own sources support -- declining when they don't, flagging when they disagree, and attributing what it does claim? Judged against what THAT TOOL retrieved, never against the web. Out of scope for search-only products, which is not a zero and never drags them down a ranking. A citation that correctly points at the source of a wrong answer is a CORRECT citation.

Capability · via another benchmark

Grounded Generation

The answer is faithful to the material the system itself retrieved, including declining when that material doesn't support one.

Benchmarks that use this scenario

A scenario has global identity and may be reused across benchmarks.

Benchmark

Managed RAG

Which managed RAG service turns a folder of private documents into a query API that finds the right passage, answers only from what it retrieved, cites the source that actually supports the claim — and keeps up when the source changes?

View tool results on this scenario →

The retrieved material supports an answer — Scenario definition | AI Demos