Does Perplexity Sonar return a page that answers an ordinary question?
Perplexity Sonar returned OpenAI's Files API reference page, which states that individual files can be up to 512 MB, and its answer gave the same figure. Most other sizes in the 14 results describe different limits, such as file inputs and storage. One community reply (rank 10) wrongly says files uploaded to OpenAI's API are limited to 5 MB, but the answer did not repeat it.
1 of 1 test case passed
Every test case in this scenario has a result.
The test case
Each test case is judged on its own: Pass, Fail, Not gradable, or Untested. The scenario result above is based on this test case.
A page on the web answers the questionPassEvidence
“What is the maximum size of an individual file I can upload through OpenAI's Files API?”
The maximum size for an individual file uploaded through OpenAI’s Files API is 512 MB.
Some features impose additional limits—for example, files used for retrieval may also be limited to 5 million tokens per file.
Show the reply as returned (Markdown)
The maximum size for an individual file uploaded through OpenAI’s **Files API is 512 MB**. Some features impose additional limits—for example, files used for retrieval may also be limited to **5 million tokens per file**.
Agent API response: 14 ranked search results and the answer about file uploads
Copied from Output file (JSON), answer_text
Open the whole JSON file ↗| ✓ | Expected: Return at least one page giving OpenAI's Files API per-file limit of 512 MB; any page answering the question counts.Found: It returned 14 results, led by OpenAI's Files API reference stating 512 MB per file, the required limit. |
- raw_response › usage › tool_calls_details
- { "search_web": { "cost_usd": 0.0025, "invocation": 1 } }
- results 1
- { "rank": 1, "url": "https://developers.openai.com/api/reference/resources/files/methods/create", "title": "Upload file | OpenAI API Reference", "content": "Upload a file that can be used across various endpoints.\nIndividual files\ncan be up to 512 MB, and each project can store up to 2.5 TB of files in\ntotal.\nThere is no organization-wide storage limit.\nUploads to this\nendpoint are rate-limited … [424 characters in the file]", "content_chars": 424, "published_date": null }
- results
- [ { "rank": 1, "url": "https://developers.openai.com/api/reference/resources/files/methods/create", "title": "Upload file | OpenAI API Reference", "content": "Upload a file that can be used across various endpoints.\nIndividual files\ncan be up to 512 MB, and each project can store up to 2.5 TB of files in\ntotal.\nThere is no organization-wide storage limit.\nUploads to this\nendpoint are rate-limited … [424 characters in the file]", "content_chars": 424, "published_date": null }, { "rank": 2, "url": "https://developers.openai.com/api/docs/guides/file-inputs", "title": "File inputs | OpenAI API", "content": "|Input method|Responses API|Chat Completions|\n...\nKeep these constraints in mind when you use file inputs:\n...\n- **File size limits:** A single request can include more than one file, but each file must be under 50 MB.\nThe combined limit across all files in the request is 50 MB.", "content_chars": 279, "published_date": null }, { "rank": 3, "url": "https://community.openai.com/t/questions-about-file-upload-limits-with-the-openai-file-api/1358472", "title": "Questions about File Upload Limits with the OpenAI File API", "content": "However, when I use the **OpenAI File API**, I don’t seem to run into this limitation.\n...\nFrom what I understand, the only clear limits are:\n- Maximum file size per upload: **512MB**\n- Maximum total storage per organization: **100GB**\n... … [451 characters in the file]", "content_chars": 451, "published_date": "2025-09-16" }, { "rank": 4, "url": "https://community.openai.com/t/400gb-to-vector-store-s-assistant/1363219", "title": "400GB to Vector Store(s) + Assistant - OpenAI Developer Community", "content": "This is different than the 512MB limit for “Files”.\n...\nFrom what I could find, the limit seems to be 5 million tokens per file.\n> ### Limits\n> The maximum file size is 512 MB.\nEach file should contain no more than 5,000,000 tokens per file … [769 characters in the file]", "content_chars": 769, "published_date": "2025-10-20" }, { "rank": 5, "url": "https://www.eesel.ai/blog/openai-files-api", "title": "OpenAI Files API: file inputs, search, and support knowledge - eesel AI", "content": "For files that will be passed as model inputs, OpenAI documents `user_data` as the appropriate upload purpose.\nA request can contain more than one file, but the current input-file limits are 50 MB per file and 50 MB in total.\nTreat those as product constraints to recheck before you ship, not as a reason to split confidential material into smaller unreviewed uploads.", "content_chars": 368, "published_date": "2025-10-12" }, { "rank": 6, "url": "https://fast.io/resources/openai-files-api-alternative/", "title": "OpenAI Files API Alternatives for AI Document Storage - Fastio", "content": "OpenAI's documentation shows the Files API supports individual files up to 512 MB, with a total storage quota of 2.5 TB per project.\nThis works fine for basic prototypes.\n...\n**Key limitations:**\n- 512MB maximum file size blocks large video … [861 characters in the file]", "content_chars": 861, "published_date": "2026-02-13" }, { "rank": 7, "url": "https://github.com/speakeasy-sdks/openai-go-sdk/blob/main/docs/sdks/files/README.md", "title": "openai-go-sdk/docs/sdks/files/README.md at main · speakeasy-sdks/openai-go-sdk", "content": "The size of all the files uploaded by one organization can be up to 100 GB.\nThe size of individual files can be a maximum of 512 MB or 2 million tokens for Assistants.\nSee the Assistants Tools guide to learn more about the types of files supported.\nThe Fine-tuning API only supports `.jsonl` files.\n...\nThe size of individual files can be a maximum of 512 MB or 2 million tokens for Assistants.", "content_chars": 394, "published_date": "2023-02-21" }, { "rank": 8, "url": "https://help.openai.com/en/articles/8555545-file-uploads-faq", "title": "File Uploads FAQ - OpenAI Help Center", "content": "Keep in mind there are file size restrictions and usage caps per user/org.\n## What are the file upload size restrictions?\n- All files uploaded to a GPT or a ChatGPT conversation have a hard limit of 512MB per file.\n- All text and document f … [1,495 characters in the file]", "content_chars": 1495, "published_date": "2026-09-23" }, { "rank": 9, "url": "https://openai.apidog.io/api-3845640", "title": "Upload file - Open AI (ChatGPT)", "content": "Currently, the size of all the files uploaded by one organization can be up to 1 GB.\nPlease contact us if you need to increase the storage limit.", "content_chars": 145, "published_date": "2025-09-17" }, { "rank": 10, "url": "https://community.openai.com/t/token-limit-for-custom-gpts/946259", "title": "Token limit for Custom GPT's - OpenAI Developer Community", "content": "What are those file upload size restrictions?\n> All files uploaded to a GPT or a ChatGPT conversation have a hard limit of 512MB per file.\n> All text and document files uploaded to a GPT or to a ChatGPT conversation are capped at 2M tokens … [829 characters in the file]", "content_chars": 829, "published_date": "2024-09-18" }, { "rank": 11, "url": "https://developers.openai.com/api/docs/guides/retrieval", "title": "Retrieval | OpenAI API", "content": "|Storage|Cost|\n...\n|Up to 1 GB (across all stores)|Free|\n|Beyond 1 GB|$0.10/GB/day|\n...\nAdding files is rate limited per vector store ID.\nRequests to `/vector_stores/{vector_store_id}/files` and `/vector_stores/{vector_store_id}/file_batche … [451 characters in the file]", "content_chars": 451, "published_date": null }, { "rank": 12, "url": "https://community.openai.com/t/why-cant-i-upload-files-over-50mb-to-openai-via-both-windows-app-and-browser/1028681", "title": "Why Can't I Upload Files Over 50MB to OpenAI via Both ...", "content": "- **File Sizes**: 117MB and 150MB (both `.txt` files).\n...\n> All text and document files uploaded to a GPT or to a ChatGPT conversation are capped at 2M tokens per file.\nThis limitation does not apply to spreadsheets.\n...\nFor CSV files or spreadsheets, the file size cannot exceed approximately 50MB.", "content_chars": 300, "published_date": "2024-11-23" }, { "rank": 13, "url": "https://help.openai.com/en/articles/8550641-assistants-api-v2-faq", "title": "Assistants API (v2) FAQ", "content": "### What are the restrictions for File upload?\nThe restrictions for uploading a File are:\n- 512 MB per file\n- 5M tokens per file\n- 10k files per vector store\n- 1 vector store per assistant\n- 1 vector store per thread\nThe overall storage lim … [600 characters in the file]", "content_chars": 600, "published_date": "2026-09-22" }, { "rank": 14, "url": "https://developers.openai.com/api/docs/guides/batch", "title": "Batch API - OpenAI Developers", "content": "Prefer referencing remote assets with `image_url` (instead of base64 blobs) to\nkeep your `.jsonl` files well below the 200 MB Batch upload limit,\nespecially for multimodal Moderations requests.\n...\nSimilar to our Fine-tuning API, you must f … [1,259 characters in the file]", "content_chars": 1259, "published_date": null } ]
- timestamp_utc
- 2026-09-23T09:21:14Z
- results 10 › content
- What are those file upload size restrictions? > All files uploaded to a GPT or a ChatGPT conversation have a hard limit of 512MB per file. > All text and document files uploaded to a GPT or to a ChatGPT conversation are capped at 2M tokens per file. This limitation does not apply to spreadsheets. > For CSV files or spreadsheets, the file size cannot exceed approximately 50MB, depending on the size of each row. > For images, there’s a limit of 20MB per image. > Additionally, there are usage caps: > Each end-user is capped at 10GB. ... The size limit for file uploads can vary depending on the platform or tool you’re using. For OpenAI’s API, which powers GPT-based models, the file upload limit is generally: - **5 MB per file**: The maximum size allowed for any individual file uploaded to OpenAI’s API is 5 megabytes (MB).
An answering page was required. The top result, OpenAI's own Files API reference, states the 512 MB per-file limit, and eight more results give the same figure. A community reply at rank 10 claims a 5 MB limit; OpenAI's reference contradicts it, and the answer gave 512 MB.
Configuration and setup
How this tool was set up for the run and what the test needed in place. Each row is a fact from the run's records; a fact the records do not hold is left out, not guessed.
How this scenario is graded
How we decide Pass, Fail and Not gradable. The same rules apply to every tool tested on this scenario.
Each test case gets one result per tool: Pass, Fail or Not gradable. A test case we haven't run yet shows Untested. There are no partial results.
- Pass: the tool did everything the test expected, and nothing it said contradicts the correct answer.
- Fail: at least one expected behaviour clearly didn't happen; the test case's result says which one and quotes the tool.
- Not gradable: our evidence couldn't settle the outcome (for example a record we needed is missing). It is never counted as a fail, and the test case's result says what's missing.
Where this sits in the benchmark
This page is one cell of a larger study: one tool, one scenario. Only this benchmark's frame appears here.
| Level | Name | Scope |
|---|---|---|
| Benchmark | Web Search for AI → | 10 scenarios · 12 tools |
| Capability | Web Retrieval → | |
| Scenario | A page on the web answers the question → | |
| Tool | Perplexity Sonar → |
Global scenario definition → · Global capability definition →
History of this result
What has happened to this result since it was first published. Runs and grades are never overwritten: a retest or a re-grade publishes a new result and keeps the earlier one readable.
Act on this result
Nothing filed here edits the run or the grade. A challenge opens a review, and a review can produce a new run or a re-grade — which becomes the current result and leaves this one in the history.
You run the same kind of test against your own setup and get the same behaviour.
Agree →Yours behaves differently. Tell us what you got, with a screenshot if you have one.
Disagree →Something here is wrong — a reference value, a transcription, a grade.
Report an issue →Tell us what changed and we schedule a rerun of the failing test case. The old result stays as history.
Vendor notice →The same record is available as structured data through the AI Demos MCP server, with the counts, the coverage and every per-test-case reason carried as fields.
Verify the proof files
These files support this result. Open a file to inspect the original evidence.
File fingerprints (SHA-256)
A fingerprint identifies the exact file used for this result.