Does You.com return results for the less famous Loki?
You.com returned ten results for a question about Loki, the log aggregation system from Grafana Labs, and every one was about that Loki. None was about the Marvel character.
1 of 1 test case passed
Every test case in this scenario has a result.
The test case
Each test case is judged on its own: Pass, Fail, Not gradable, or Untested. The scenario result above is based on this test case.
Something more famous has the same namePassEvidence
“In Loki, the log aggregation system from Grafana Labs, which configuration block does retention_enabled have to be set in for old log data to actually be deleted?”
Copied from Captured file (JSON), results · an excerpt
- https://grafana.com/docs/loki/latest/operations/storage/retention/content
 Watch the keynote again and signup for more on-demand sessions. [Watch keynote](https://grafana.com/events/o … [26,382 characters in the file]
- https://stackoverflow.com/questions/73138278/why-my-loki-log-retention-is-not-workingcontent
##### Collectives™ on Stack Overflow Find centralized, trusted content and collaborate around the technologies you use most. [Learn more about Collectives](https://stackoverflow.com/collectives) **Stack Internal** Knowledge at work Bri … [14,774 characters in the file]
- https://grafana.com/docs/loki/latest/operations/storage/logs-deletion/content
 Watch the keynote again and signup for more on-demand sessions. [Watch keynote](https://grafana.com/events/o … [10,111 characters in the file]
- https://grafana.com/docs/loki/latest/content
## Overview Unlike other logging systems, Loki is built around the idea of only indexing metadata about your logs’ labels (just like Prometheus labels). Log data itself is then compressed and stored in chunks in object stores such as Amazo … [12,086 characters in the file]
- https://blog.devops.dev/log-and-metric-retention-in-loki-and-prometheus-57e81bbad023?gi=780056f55dc2content
[Sitemap](https://blog.devops.dev/sitemap/sitemap.xml) [Open in app](https://play.google.com/store/apps/details?id=com.medium.reader&referrer=utm_source%3DmobileNavBar&source=---top_nav_layout_nav------------------------------------------- … [13,666 characters in the file]
- https://grafana.com/docs/enterprise-logs/latest/manage/storage/retention/content
 Watch the keynote again and signup for more on-demand sessions. [Watch keynote](https://grafana.com/events/o … [25,580 characters in the file]
- https://oneuptime.com/blog/post/2026-01-30-loki-retention-strategies/viewcontent
[Skip to main content](https://oneuptime.com/blog/post/2026-01-30-loki-retention-strategies/view#main-content)  # How to Implement Loki Retention Strategies Co … [31,256 characters in the file]
- https://community.grafana.com/t/configuring-retention-for-loki-in-a-grafana-cloud-stack/140741content
I just created a free tier Grafana Cloud stack to start working with collecting and analyzing logs and metrics. When pushing data to the Loki-instance I get by default, it drop all logs older tha a week. Is there any way to change that? Do I need to run my own Loki-instance somewhere to enable ...
- https://medium.com/@aditya.hilman_10961/enabling-log-retention-in-loki-with-compactor-fe3de2002b47content
[Sitemap](https://medium.com/sitemap/sitemap.xml) [Open in app](https://play.google.com/store/apps/details?id=com.medium.reader&referrer=utm_source%3DmobileNavBar&source=---top_nav_layout_nav-------------------------------------------) Si … [9,577 characters in the file]
- https://github.com/grafana/loki/issues/8357content
[Skip to content](https://github.com/grafana/loki/issues/8357#start-of-content) You signed in with another tab or window. [Reload](https://github.com/grafana/loki/issues/8357) to refresh your session.You signed out in another tab or window … [7,134 characters in the file]
Show as JSON
[ { "rank": 1, "url": "https://grafana.com/docs/loki/latest/operations/storage/retention/", "title": "Log retention | Grafana Loki documentation", "content": "\n\nWatch the keynote again and signup for more on-demand sessions.\n\n\n[Watch keynote](https://grafana.com/events/o … [26,382 characters in the file]", "content_chars": 26382, "published_date": null }, { "rank": 2, "url": "https://stackoverflow.com/questions/73138278/why-my-loki-log-retention-is-not-working", "title": "purge - why my Loki log retention is not working? - Stack Overflow", "content": "##### Collectives™ on Stack Overflow\n\nFind centralized, trusted content and collaborate around the technologies you use most.\n\n[Learn more about Collectives](https://stackoverflow.com/collectives)\n\n**Stack Internal**\n\nKnowledge at work\n\nBri … [14,774 characters in the file]", "content_chars": 14774, "published_date": null }, { "rank": 3, "url": "https://grafana.com/docs/loki/latest/operations/storage/logs-deletion/", "title": "Log entry deletion | Grafana Loki documentation", "content": "\n\nWatch the keynote again and signup for more on-demand sessions.\n\n\n[Watch keynote](https://grafana.com/events/o … [10,111 characters in the file]", "content_chars": 10111, "published_date": null }, { "rank": 4, "url": "https://grafana.com/docs/loki/latest/", "title": "Grafana Loki | Grafana Loki documentation", "content": "## Overview\n\nUnlike other logging systems, Loki is built around the idea of only indexing metadata about your logs’ labels (just like Prometheus labels). Log data itself is then compressed and stored in chunks in object stores such as Amazo … [12,086 characters in the file]", "content_chars": 12086, "published_date": null }, { "rank": 5, "url": "https://blog.devops.dev/log-and-metric-retention-in-loki-and-prometheus-57e81bbad023?gi=780056f55dc2", "title": "Log and Metric Retention in Loki and Prometheus | by Faith Sodipe ...", "content": "[Sitemap](https://blog.devops.dev/sitemap/sitemap.xml)\n\n[Open in app](https://play.google.com/store/apps/details?id=com.medium.reader&referrer=utm_source%3DmobileNavBar&source=---top_nav_layout_nav------------------------------------------- … [13,666 characters in the file]", "content_chars": 13666, "published_date": "2025-06-13T16:31:59" }, { "rank": 6, "url": "https://grafana.com/docs/enterprise-logs/latest/manage/storage/retention/", "title": "Log retention | Grafana Enterprise Logs documentation", "content": "\n\nWatch the keynote again and signup for more on-demand sessions.\n\n\n[Watch keynote](https://grafana.com/events/o … [25,580 characters in the file]", "content_chars": 25580, "published_date": null }, { "rank": 7, "url": "https://oneuptime.com/blog/post/2026-01-30-loki-retention-strategies/view", "title": "How to Implement Loki Retention Strategies", "content": "[Skip to main content](https://oneuptime.com/blog/post/2026-01-30-loki-retention-strategies/view#main-content)\n\n\n\n# How to Implement Loki Retention Strategies\n\nCo … [31,256 characters in the file]", "content_chars": 31256, "published_date": "2026-01-30T00:00:00" }, { "rank": 8, "url": "https://community.grafana.com/t/configuring-retention-for-loki-in-a-grafana-cloud-stack/140741", "title": "Configuring retention for Loki in a Grafana Cloud stack - ...", "content": "I just created a free tier Grafana Cloud stack to start working with collecting and analyzing logs and metrics. When pushing data to the Loki-instance I get by default, it drop all logs older tha a week. Is there any way to change that? Do I need to run my own Loki-instance somewhere to enable ...", "content_chars": 298, "published_date": "2025-01-20T08:53:41" }, { "rank": 9, "url": "https://medium.com/@aditya.hilman_10961/enabling-log-retention-in-loki-with-compactor-fe3de2002b47", "title": "Enabling Log Retention in Loki with Compactor | by Aditya Hilman ...", "content": "[Sitemap](https://medium.com/sitemap/sitemap.xml)\n\n[Open in app](https://play.google.com/store/apps/details?id=com.medium.reader&referrer=utm_source%3DmobileNavBar&source=---top_nav_layout_nav-------------------------------------------)\n\nSi … [9,577 characters in the file]", "content_chars": 9577, "published_date": "2024-12-03T10:18:49" }, { "rank": 10, "url": "https://github.com/grafana/loki/issues/8357", "title": "Logs retention doesn't work · Issue #8357 · grafana/loki", "content": "[Skip to content](https://github.com/grafana/loki/issues/8357#start-of-content)\n\nYou signed in with another tab or window. [Reload](https://github.com/grafana/loki/issues/8357) to refresh your session.You signed out in another tab or window … [7,134 characters in the file]", "content_chars": 7134, "published_date": "2023-01-31T17:41:57" } ]
Excerpt ends here. Open the source for the complete output.
Copied from Captured file (JSON), results 1 › content · an excerpt
 Watch the keynote again and signup for more on-demand sessions. [Watch keynote](https://grafana.com/events/observabilitycon/?plcmt=obscon2025-post-event-banner)  📢 Registration + agenda now live Explore the latest Grafana Cloud and AI solutions, learn tips & tricks from demos and hands-on workshops, and get actionable advice to advance your observability strategy. Register now and get 50% off - limited tickets available (while they last!). [Register now](https://grafana.com/events/observabilitycon/?tech=target&plcmt=top-banner&aud=default) Searching... Site search Ask Grot AI [Try using **Grot AI** for this query ->](https://grafana.com/grot/?chat=&from=/search) All Docs View all results No results. There was an error with your request. > Documentation for automated readers > > A curated documentation index is available at: https://grafana.com/llms.txt > > A complete documentation index is available at: https://grafana.com/llms-full.txt > > These indexes can help with page discovery before fetching individual documents. This page is also available in Markdown, which may be easier for automated readers and AI tools to parse than HTML. The Markdown version is available at https://grafana.com/docs/loki/latest/operations/storage/retention.md, or by sending Accept: text/markdown to https://grafana.com/docs/loki/latest/operations/storage/retention/. For broader documentation discovery, the curated index is available at https://grafana.com/llms.txt and the complete index is available at https://grafana.com/llms-full.txt. Log retention [Documentation](https://grafana.com/docs/)[Grafana Loki](https://grafana.com/docs/loki/latest/)[Manage](https://grafana.com/docs/loki/latest/operations/)[Storage](https://grafana.com/docs/loki/latest/operations/storage/)Log retention Open source # Log retention Retention in Grafana Loki is achieved through the [Compactor](https://grafana.com/docs/loki/latest/operations/storage/retention/#compactor). By default the `compactor.retention-enabled` flag is not set, so the logs sent to Loki live forever. > Note > > If you have a lifecycle policy configured on the object store, please ensure that it is longer than the retention period. Granular retention policies to apply retention at per tenant or per stream level are also supported by the Compactor. > Note > > The Compactor does not support retention on > [legacy index types](https://grafana.com/docs/loki/latest/configure/storage/#index-storage). Please use the > [Table Manager](https://grafana.com/docs/loki/latest/operations/storage/table-manager/) when using legacy index types. > Both the Table manager and legacy index types are deprecated and may be removed in future major versions of Loki. ## Compactor The Compactor is responsible for compaction of index files and applying log retention. > Note > > Run the Compactor as a singleton (a single instance). The Compactor runs compaction and retention on two independent schedules: - Compaction runs every `compactor.compaction-interval`.
Excerpt ends here. Open the source for the complete output.
Copied from Captured file (JSON), results 10 › content · an excerpt
[Skip to content](https://github.com/grafana/loki/issues/8357#start-of-content) You signed in with another tab or window. [Reload](https://github.com/grafana/loki/issues/8357) to refresh your session.You signed out in another tab or window. [Reload](https://github.com/grafana/loki/issues/8357) to refresh your session.You switched accounts on another tab or window. [Reload](https://github.com/grafana/loki/issues/8357) to refresh your session.Dismiss alert {{ message }} [grafana](https://github.com/grafana)/ **[loki](https://github.com/grafana/loki)** Public - [Notifications](https://github.com/login?return_to=%2Fgrafana%2Floki) You must be signed in to change notification settings - [Fork\\ 4.1k](https://github.com/login?return_to=%2Fgrafana%2Floki) - [Star\\ 28.9k](https://github.com/login?return_to=%2Fgrafana%2Floki) # Logs retention doesn't work\#8357 [New issue](https://github.com/login?return_to=https://github.com/grafana/loki/issues/8357) Copy link [New issue](https://github.com/login?return_to=https://github.com/grafana/loki/issues/8357) Copy link Closed Closed [Logs retention doesn't work](https://github.com/grafana/loki/issues/8357#top)#8357 Copy link ## Description [](https://github.com/fpaparoni) [fpaparoni](https://github.com/fpaparoni) opened [on Jan 31, 2023on Jan 31, 2023](https://github.com/grafana/loki/issues/8357#issue-1564748865) Issue body actions **Describe the bug** Using a custom configuration I think the logs should be deleted after 1h, but they are always available **To Reproduce** I used the following configuration values for loki helm chart ``` loki: config: limits_config: retention_period: 1h compactor: retention_enabled: true retention_delete_delay: 1h table_manager: retention_deletes_enabled: true retention_period: 1h ``` launched the creation using the following command `helm install loki grafana/loki-stack --values loki-stack-values.yaml -n loki --create-namespace` and if I enter into the loki pod I can see the following configuration from /etc/loki/loki.yaml ``` auth_enabled: false chunk_store_config: max_look_back_period: 0s compactor: retention_delete_delay: 1h retention_enabled: true shared_store: filesystem working_directory: /data/loki/boltdb-shipper-compactor ingester: chunk_block_size: 262144 chunk_idle_period: 3m chunk_retain_period: 1m lifecycler: ring: replication_factor: 1 max_transfer_retries: 0 wal: dir: /data/loki/wal limits_config: enforce_metric_name: false max_entries_limit_per_query: 5000 reject_old_samples: true reject_old_samples_max_age: 168h retention_period: 1h memberlist: join_members: - 'loki-memberlist' schema_config: configs: - from: "2020-10-24" index: period: 24h prefix: index_ object_store: filesystem schema: v11 store: boltdb-shipper server: grpc_listen_port: 9095 http_listen_port: 3100 storage_config: boltdb_shipper: active_index_directory: /data/loki/boltdb-shipper-active cache_location: /data/loki/boltdb-shipper-cache cache_ttl: 24h shared_store: filesystem filesystem: directory: /data/loki/chunks table_manager: retention_deletes_enabled: true retention_period: 1h ``` **Expected behavior** After one hour logs should be deleted, but the retention doesn't work (of course there is something in the configuration that is wrong) **Environment:** - Infrastructure: Kubernetes - Deployment tool: helm ## Activity ### danielrosa-zh commented on Jan 31, 2023on Jan 31, 2023 [](https://github.com/danielrosa-zh) [danielrosa-zh](https://github.com/danielrosa-zh)
Excerpt ends here. Open the source for the complete output.
Search record: Loki results, page text, and call details
Open the whole JSON file ↗| ✓ | Expected: The results are about the Loki the question meant, Grafana Labs' log aggregation system, not its famous namesake.Found: All ten results were about Grafana Loki, none about the Marvel character. The top result says Loki retention is achieved through the Compactor; the tenth enables retention under the compactor block. |
- query_text
- In Loki, the log aggregation system from Grafana Labs, which configuration block does retention_enabled have to be set in for old log data to actually be deleted?
- region
- ap-south-1
- timestamp_utc
- 2026-09-21T11:49:51Z
- raw_response › metadata
- { "query": "In Loki, the log aggregation system from Grafana Labs, which configuration block does retention_enabled have to be set in for old log data to actually be deleted?", "search_uuid": "86875943-0906-45af-876e-1550450736ab", "latency": 10.901536450954154 }
It is a Pass: the results had to be about the Loki the question meant, and all ten were about Grafana's log system. Nine of the ten also mention the compactor, which the top result names as how Loki retention works.
Reference pages not returned. The reference pages grafana.com/docs/loki/ and grafana.com/oss/loki/ were not returned at those addresses. Rank 4 was the versioned documentation home, grafana.com/docs/loki/latest/; the rank-1 retention page answered the question directly.
Configuration and setup
How this tool was set up for the run and what the test needed in place. Each row is a fact from the run's records; a fact the records do not hold is left out, not guessed.
How this scenario is graded
How we decide Pass, Fail and Not gradable. The same rules apply to every tool tested on this scenario.
Each test case gets one result per tool: Pass, Fail or Not gradable. A test case we haven't run yet shows Untested. There are no partial results.
- Pass: the tool did everything the test expected, and nothing it said contradicts the correct answer.
- Fail: at least one expected behaviour clearly didn't happen; the test case's result says which one and quotes the tool.
- Not gradable: our evidence couldn't settle the outcome (for example a record we needed is missing). It is never counted as a fail, and the test case's result says what's missing.
Where this sits in the benchmark
This page is one cell of a larger study: one tool, one scenario. Only this benchmark's frame appears here.
| Level | Name | Scope |
|---|---|---|
| Benchmark | Web Search for AI → | 10 scenarios · 12 tools |
| Capability | Web Retrieval → | |
| Scenario | Something more famous has the same name → | |
| Tool | You.com → |
Global scenario definition → · Global capability definition → · You.com product page →
History of this result
What has happened to this result since it was first published. Runs and grades are never overwritten: a retest or a re-grade publishes a new result and keeps the earlier one readable.
Act on this result
Nothing filed here edits the run or the grade. A challenge opens a review, and a review can produce a new run or a re-grade — which becomes the current result and leaves this one in the history.
You run the same kind of test against your own setup and get the same behaviour.
Agree →Yours behaves differently. Tell us what you got, with a screenshot if you have one.
Disagree →Something here is wrong — a reference value, a transcription, a grade.
Report an issue →Tell us what changed and we schedule a rerun of the failing test case. The old result stays as history.
Vendor notice →The same record is available as structured data through the AI Demos MCP server, with the counts, the coverage and every per-test-case reason carried as fields.
Verify the proof files
These files support this result. Open a file to inspect the original evidence.
File fingerprints (SHA-256)
A fingerprint identifies the exact file used for this result.