Valyu
Returns usable web text for agents, but the citation layer is too error-prone to trust.
Strong retrieval, unsafe citations
- You need an API that returns large extracted web content your agent can read without a second crawl.
- You are willing to independently verify citations and source domains before trusting an answer.
- You care more about usable content payload than low-latency answer-mode convenience.
- Your product depends on citation honesty without manual checks.
Our take
Valyu's /search mode returns long, usable page text and can support answer-making from the retrieved content, but /answer repeatedly cites the wrong entity and posts the benchmark's worst citation record. In this run it also measured far above the quoted web-source rate and streamed slowly enough that it is hard to justify as a default grounding layer for an agent.
In-Depth Review
Our detailed analysis of Valyu — features, performance, and real-world testing.
Feature-by-Feature Breakdown
Ranked Web Retrieval with Extracted Page Text▾
Feature tested: Ranked Web Retrieval with Extracted Page Text
Result: Partial
Expected behavior: Valyu’s /search mode returns ranked web results plus large extracted page text, rather than short snippets. In the benchmark it was exercised on current-fact, niche-technical, multi-source, content-depth, and freshness probes, with a median payload of about 24,912 characters.
Test case: Text prompt → Text prompt
Input type: Text prompt
Input used: Input artifact (Text prompt): Input
Observed output: Output artifact (Text prompt): Output
Input artifact: Input artifact (Text prompt): Input
Output artifact: Output artifact (Text prompt): Output
What changed: Text prompt transformed into Text prompt
Test case: Text prompt → Text prompt
Input type: Text prompt
Input used: Input artifact (Text prompt): Input
Observed output: Output artifact (Text prompt): Output
Input artifact: Input artifact (Text prompt): Input
Output artifact: Output artifact (Text prompt): Output
What changed: Text prompt transformed into Text prompt
Test case: Text prompt → Text prompt
Input type: Text prompt
Input used: Input artifact (Text prompt): Input
Observed output: Output artifact (Text prompt): Output
Input artifact: Input artifact (Text prompt): Input
Output artifact: Output artifact (Text prompt): Output
What changed: Text prompt transformed into Text prompt
Why it matters / Conclusion: Useful when you need a search API that hands back a lot of readable web text; the retrieval is only middling, but the extraction quality is good enough that the model can work from the payload.
Valyu’s /search mode returns ranked web results plus large extracted page text, rather than short snippets. In the benchmark it was exercised on current-fact, niche-technical, multi-source, content-depth, and freshness probes, with a median payload of about 24,912 characters.
Cited Answer Synthesis▾
Feature tested: Cited Answer Synthesis
Result: Failed
Expected behavior: Valyu’s /answer mode streams a synthesized answer with citations. In the benchmark it answered question sets directly and was evaluated on correctness and citation behavior, including wrong-entity citations and an abstention that still pointed to sources.
Test case: Text prompt → Text prompt
Input type: Text prompt
Input used: Input artifact (Text prompt): Input
Observed output: Output artifact (Text prompt): Output
Input artifact: Input artifact (Text prompt): Input
Output artifact: Output artifact (Text prompt): Output
What changed: Text prompt transformed into Text prompt
Test case: Text prompt → Text prompt
Input type: Text prompt
Input used: Input artifact (Text prompt): Input
Observed output: Output artifact (Text prompt): Output
Input artifact: Input artifact (Text prompt): Input
Output artifact: Output artifact (Text prompt): Output
What changed: Text prompt transformed into Text prompt
Test case: Text prompt → Text prompt
Input type: Text prompt
Input used: Input artifact (Text prompt): Input
Observed output: Output artifact (Text prompt): Output
Input artifact: Input artifact (Text prompt): Input
Output artifact: Output artifact (Text prompt): Output
What changed: Text prompt transformed into Text prompt
Test case: Text prompt → Text prompt
Input type: Text prompt
Input used: Input artifact (Text prompt): Input
Observed output: Output artifact (Text prompt): Output
Input artifact: Input artifact (Text prompt): Input
Output artifact: Output artifact (Text prompt): Output
What changed: Text prompt transformed into Text prompt
Why it matters / Conclusion: Do not trust the citations blindly; if you use Valyu, verify the domains and the claim-to-source match yourself.
Valyu’s /answer mode streams a synthesized answer with citations. In the benchmark it answered question sets directly and was evaluated on correctness and citation behavior, including wrong-entity citations and an abstention that still pointed to sources.
How it scored on the research's own criteria
The 11 evaluation dimensions from our hands-on research on Valyu, each judged from recorded runs on 4 test inputs — the same verdicts the ranking page ranks on.
held up partial failed not exercised by this input
| Criterion | Verdict | What the runs showed | Per input | Proof |
|---|---|---|---|---|
| Ambiguity handling | Weak1/5 | When a query can point to multiple entities, it can confidently lock onto the wrong one instead of pausing or disambiguating, which is a core failure. | — | |
| Answer quality (answer APIs) | Weak1/5 | Even when it can do the arithmetic, it may combine figures that are not comparable, so the final answer can be decisively wrong despite looking numeric and careful. | open proof ↗ | |
| Citation accuracy (answer APIs) | Weak1/5 | It does not just make citation mistakes; it can attach a real, plausible page to the wrong claim, which makes the answer look sourced when it is not. | open proof ↗ | |
| Extraction quality | Mixed3/5 | The returned text is usually usable and substantial, but the hard 25k ceiling and missing publication dates keep it from being a clean, fully faithful page feed. | open proof ↗ | |
| Freshness | Weak1/5 | Exact version lookups are where freshness matters most, and here it missed the specific release even when the broader topic was easy to name, so the recent-content performance is poor. | open proof ↗ | |
| Long-tail coverage | Weak2/5 | It can reach niche material sometimes, but a one-third top-3 hit rate is still thin for technical or long-tail queries, so this lands in the weak range. | open proof ↗ | |
| No-answer behaviour | Mixed3/5 | It usually knows to step back on impossible questions, but the partial-answer case shows it can still drift into unsupported detail after a correct abstention. | open proof ↗ | |
| Relevance @ top-k | Weak2/5 | It usually finds a relevant source somewhere in the top results, but top-1 is too weak and top-3 is only around 30%, so this is below average rather than strong. | open proof ↗ | |
| Cost per 1k queries | Weak1/5 | Measured spend is an order of magnitude above the published headline rate, so this is not just a little expensive; it is materially off-budget. | open proof ↗ | |
| p50 / p95 latency | Weak1/5 | Both modes are slow, and the answer mode is especially heavy at the tail, so agents would feel the latency even more than the median suggests. | open proof ↗ | |
| Stability | Strong5/5 | Ranking held up well across reruns: the overlap stayed very high and the changes stayed inside the reported noise band, so this is genuinely reproducible. | open proof ↗ |
Verdicts come verbatim from the study's recorded observations, never re-derived at render; a criterion with no recorded run shows Not exercised — this section cannot invent a score.
Featured in Rankings
Independent rankings where Valyu was tested and rated.
Banner Preview
How the embed badge will look on your site

Embed HTML
Copy this code to your website source
Quick Integration Guide
- 1Copy the HTML code block above.
- 2Paste it into your site's HTML or CMS editor.
- 3Banner appears instantly on your page.
- 4Links back to your tool profile here.
Similar Tools
Discover more AI tools like Valyu to enhance your workflow.
Comments (0)
Need a custom AI solution for this use case?
If you are looking to build a custom web text extraction, citation verification, or retrieval pipeline for your business or internal workflow, email us at contact@futuresmart.ai.
Found something inaccurate or missing? We try to keep our AI research accurate and useful. If you found outdated information, an issue, or have a suggestion, email us at collaborate@aidemos.com.