Scenario in benchmark · Web Search for AI · Version 1
Content is removed from the source
Content that was already returned successfully is removed from the source.
What we check
- Whether the content was returned successfully before it was removed from the source.
- Whether the removed content is still returned after the source no longer contains it.
- Whether the system stops surfacing the removed content once removal has taken effect.
Specific test-case inputs and grading live on the related test-case pages.
How the tools performed
One row per tool, from its current published Result for this scenario and benchmark version. Open a row for the full summary and the exact counts.
No published results for this scenario yet.
No published Result yet (12): Brave Search API, Exa, Firecrawl, GPT-5.6 terra, Linkup, OpenAI web search, Perplexity Sonar, SerpAPI, Serper, Tavily, Valyu, You.com.
No published Result does not tell you whether a tool has been tested.Test design
- Pinned test cases
- 1
- Disclosure
- 0 public · 1 withheld
- Capabilities exercised here
- Freshness
How the results are graded
- Pass the test-case expectations hold.
- Fail an expectation demonstrably does not hold.
- Not gradable the evidence cannot establish the outcome.
Version 1 uses test-case expectations; no scenario rubric is pinned. Benchmark methodology →