Can Brave Search API find answering pages when a request uses different wording?
Brave Search API found pages answering the Netflix question despite different wording. The first two results said the stock options are fully vested and can be kept after leaving; Netflix’s own page also returned.
1 of 1 test case passed
Every test case in this scenario has a result.
The test case
Each test case is judged on its own: Pass, Fail, Not gradable, or Untested. The scenario result above is based on this test case.
The question uses different words than the pagePassEvidence
“If I quit Netflix, do I lose the shares I was granted while I was working there?”
[ { "rank": 1, "url": "https://www.falconwealthplanning.com/netflix-employees-and-executives/", "title": "Netflix employees and executives - Falcon Wealth Planning", "content": "# Financial Planning for Netflix Employees & Executives: Equity and Taxes\nNetflix compensation is structurally different from most Big Tech. Netflix’s philosophy is the opposite: employees are generally paid with cash and stock options, an … [1,941 characters in the file]", "content_chars": 1941, "published_date": "2026-01-03" }, { "rank": 2, "url": "https://www.evermont.com/blog/understanding-netflix-equity-compensation-stock-options-rsus-and-psus", "title": "Understanding Netflix Equity Compensation: Stock Options, RSUs, and PSUs", "content": "# Understanding Netflix Equity Compensation: Stock Options, RSUs, and PSUs\nIf you work at Netflix, your paycheck may be just one part of your overall compensation. Like many leading tech and entertainment companies, Netflix offers equity co … [1,895 characters in the file]", "content_chars": 1895, "published_date": "2025-11-20" }, { "rank": 3, "url": "https://graystoneadvisor.com/blog/netflix-supplemental-stock-options", "title": "Netflix Employee Stock Options — Fee-Only Financial Planner -RSUs & Stock Options", "content": "# How does the Netflix Supplemental Stock Option Plan work?\n## I can purchase options?\nMost publicly traded companies use company stock as a way to reward and incentivize employees; to align their personal interests with company leadership. … [1,972 characters in the file]", "content_chars": 1972, "published_date": "2021-12-07" }, { "rank": 4, "url": "https://www.reddit.com/r/legaladvicecanada/comments/1d0y62q/if_i_quit_my_job_do_i_get_to_keep_the_shares_they/", "title": "r/legaladvicecanada on Reddit: If I quit my job do I get to keep the shares they granted me?", "content": "# If I quit my job do I get to keep the shares they granted me?\n## bridgehockey\nYou'll need to look at the documents defining the grant. Usually, unvested shares are lost when you resign. That's the whole point of vesting, to keep you aroun … [1,267 characters in the file]", "content_chars": 1267, "published_date": "2024-05-26" }, { "rank": 5, "url": "https://blog.myrawealth.com/insights/a-guide-on-netflixs-benefits-program", "title": "A Guide on Netflix's Benefits Program —", "content": "If you work for Netflix, did you know that you have the opportunity to take part in their benefits program? Check out this article to learn what you need to know about your ESPP, 401(k), and stock options.\n# A Guide on Netflix's Benefits Pr … [1,490 characters in the file]", "content_chars": 1490, "published_date": null }, { "rank": 6, "url": "https://vipwealthadvisors.com/insights/netflix-stock-split-2025-what-it-means", "title": "Netflix 10-for-1 Stock Split Explained: Impact on Investors & Employees", "content": "# Netflix Stock Split 2025: What the 10-for-1 Move Really Means for Investors and Employees\n## Stock Splits Explained\nA stock split is purely a mechanical adjustment. It increases the number of shares outstanding while proportionally reduci … [1,492 characters in the file]", "content_chars": 1492, "published_date": "2025-11-05" }, { "rank": 7, "url": "https://carta.com/learn/equity/leaving-company/", "title": "What Happens to Vested Stock & Equity When You Leave", "content": "# What happens to equity when you leave a company?\nWhen you quit or leave your job, the type of stock, timing of your departure, and individual vesting schedules determine what happens to your vested stock.\n## What type of equity do you hav … [2,677 characters in the file]", "content_chars": 2677, "published_date": "2026-04-29" }, { "rank": 8, "url": "https://augustuswealth.com/blog/guide-what-netflix-10-for-1-stock-split-means-employees-investors/", "title": "Guide to Netflix’s 10-for-1 Split", "content": "# Netflix’s 10-for-1 Stock Split: What It Really Means for Employees and Investors\n## 5 Takeaways\n- **Netflix’s 10-for-1 split increases your share count but doesn’t change the total value of your equity.**\n\n- **Employees will receive more … [1,959 characters in the file]", "content_chars": 1959, "published_date": "2025-11-22" }, { "rank": 9, "url": "https://jobs.netflix.com/work-life-philosophy", "title": "Work Life Philosophy - Careers at Netflix", "content": "### Stock Option Program\nEmployees choose each year how much of their eligible compensation they want in salary versus stock options which provides the opportunity to benefit from Netflix’s long term success as our stock price appreciates. … [402 characters in the file]", "content_chars": 402, "published_date": "2023-02-08" }, { "rank": 10, "url": "https://www.schwab.com/learn/story/what-happens-to-equity-compensation-if-i-leave", "title": "What Happens to My Equity Award If I Quit?", "content": "# What Happens to My Equity Compensation If I Leave the Company?\nIf you're considering leaving your job, it's important to understand what will happen to your equity compensation upon your departure. Your company's equity plan will dictate … [1,751 characters in the file]", "content_chars": 1751, "published_date": "2026-04-21" } ]
Excerpt ends here. Open the source for the complete output.
API request and response: the question and 10 ranked pages with source excerpts
Copied from Captured file (JSON), results · an excerpt
Open the whole JSON file ↗### Stock Option Program Employees choose each year how much of their eligible compensation they want in salary versus stock options which provides the opportunity to benefit from Netflix’s long term success as our stock price appreciates. You can choose all cash, all options, or whatever combination suits you. These 10-year stock options are fully-vested and you keep them even if you leave Netflix.
Copied from Captured file (JSON), results 9 › content
| ✓ | Expected: A page that answers the question must still be retrieved when it uses different words.Found: Netflix’s page ranked 9th among 10 results and said its 10-year stock options are fully vested and kept after leaving. |
The retrieved Netflix page answered about leaving and stock options despite a question about quitting and shares. Generic guidance about losing unvested equity does not contradict keeping options fully vested at grant. Brave returned source excerpts, not a written answer.
Configuration and setup
How this tool was set up for the run and what the test needed in place. Each row is a fact from the run's records; a fact the records do not hold is left out, not guessed.
How this scenario is graded
How we decide Pass, Fail and Not gradable. The same rules apply to every tool tested on this scenario.
Each test case gets one result per tool: Pass, Fail or Not gradable. A test case we haven't run yet shows Untested. There are no partial results.
- Pass: the tool did everything the test expected, and nothing it said contradicts the correct answer.
- Fail: at least one expected behaviour clearly didn't happen; the test case's result says which one and quotes the tool.
- Not gradable: our evidence couldn't settle the outcome (for example a record we needed is missing). It is never counted as a fail, and the test case's result says what's missing.
Where this sits in the benchmark
This page is one cell of a larger study: one tool, one scenario. Only this benchmark's frame appears here.
| Level | Name | Scope |
|---|---|---|
| Benchmark | Web Search for AI → | 10 scenarios · 12 tools |
| Capability | Web Retrieval → | |
| Scenario | The request uses different wording than the source → | |
| Tool | Brave Search API → |
Global scenario definition → · Global capability definition → · Brave Search API product page →
History of this result
What has happened to this result since it was first published. Runs and grades are never overwritten: a retest or a re-grade publishes a new result and keeps the earlier one readable.
Act on this result
Nothing filed here edits the run or the grade. A challenge opens a review, and a review can produce a new run or a re-grade — which becomes the current result and leaves this one in the history.
You run the same kind of test against your own setup and get the same behaviour.
Agree →Yours behaves differently. Tell us what you got, with a screenshot if you have one.
Disagree →Something here is wrong — a reference value, a transcription, a grade.
Report an issue →Tell us what changed and we schedule a rerun of the failing test case. The old result stays as history.
Vendor notice →The same record is available as structured data through the AI Demos MCP server, with the counts, the coverage and every per-test-case reason carried as fields.
Verify the proof files
These files support this result. Open a file to inspect the original evidence.
File fingerprints (SHA-256)
A fingerprint identifies the exact file used for this result.