Linkup in Web Search for AI
Scenario-level performance from current published Results.
4 of 10 scenarios published
Where Linkup failed
1 of 4 graded scenarios. Open a Result to see the conversation and the evidence.
A new page has just gone live
Linkup did not find the Ostrell oak sideboard's $1,185.00 price after its page went live. After Google listed the page at 08:35 UTC on 23 October, Linkup's standard search (10:27 UTC) and sourced answer (10:28 UTC) still returned no store page.
View Result →How Linkup performed
Open a capability to explore its scenarios. Each row reports the test set in its published Result.
Freshness1 fail2 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| A new page has just gone live | 0 Pass1 Fail0 Not gradable 1 of 1 test case failedWhat happenedLinkup did not find the Ostrell oak sideboard's $1,185.00 price after its page went live. After Google listed the page at 08:35 UTC on 23 October, Linkup's standard search (10:27 UTC) and sourced answer (10:28 UTC) still returned no store page. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| A page the tool already finds has changed | No published result | ||
| Content is removed from the source | No published result | ||
Web Retrieval3 pass1 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| A page on the web answers the question | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedLinkup found a page answering the question: OpenAI’s Files API reference at rank 8 stated a maximum individual-file upload size of 512 MB. In all, seven of the ten standard-mode results contained that figure. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| Something more famous has the same name | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedLinkup kept the search focused on Grafana Loki rather than its Marvel namesake. All ten results covered log retention and named the compactor block. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The request uses different wording than the source | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedLinkup found pages answering the question despite the different wording. Both search depths returned text explaining that Netflix stock options remain with employees after they leave. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| Search only these websites | No published result | ||
Answer Generation3 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| The retrieved material doesn't support an answer | No published result | ||
| The retrieved material supports an answer | No published result | ||
| The retrieved sources disagree with each other | No published result | ||
Reading these Results
Published evidence and test coverage answer different questions.
Which scenarios have a Result?
A published Result is public evidence for this tool on one scenario. “No published result” does not say whether testing has taken place.
What does each Result cover?
Assessed includes Pass, Fail and Not gradable. Gradable includes Pass and Fail. Both use the pinned test count in that published Result.
Out of 10 scenarios
The summary counts each of the 10 scenarios once. A scenario fails when any of its published test cases failed. “No published Result yet” means nothing is public for that scenario; it does not say whether Linkup was tested on it.