AI Demos Research — the structured-intelligence platform. Every verdict on these pages opens to the execution behind it.
Graded 10 October 2026

Does You.com return results for the less famous Loki?

You.com returned ten results for a question about Loki, the log aggregation system from Grafana Labs, and every one was about that Loki. None was about the Marvel character.

1 of 1 test case passed

Every test case in this scenario has a result.

Pass rate100%1 of 1 gradable
Coverage1 of 1test case with a result
1PassDid everything it was expected to do.
0FailNo test case failed.
0Not gradableEvery result here could be graded.
0UntestedEvery test case in this scenario has a result.
The pass rate is a summary. The evidence is the test case below: what we sent, what we checked, what the tool returned, and the proof.

The test case

Each test case is judged on its own: Pass, Fail, Not gradable, or Untested. The scenario result above is based on this test case.

Something more famous has the same namePassEvidence
What we sent

“In Loki, the log aggregation system from Grafana Labs, which configuration block does retention_enabled have to be set in for old log data to actually be deleted?”

What the tool returned

Copied from Captured file (JSON), results · an excerpt

  1. https://grafana.com/docs/loki/latest/operations/storage/retention/
    content
    ![ObservabilityCON 2025](https://a-us.storyblok.com/f/1022730/280x40/b0872b99f9/grafana-logo-observabilitycon-2025-black.svg/m/)
    
    Watch the keynote again and signup for more on-demand sessions.
    
    
    [Watch keynote](https://grafana.com/events/o … [26,382 characters in the file]
  2. https://stackoverflow.com/questions/73138278/why-my-loki-log-retention-is-not-working
    content
    ##### Collectives™ on Stack Overflow
    
    Find centralized, trusted content and collaborate around the technologies you use most.
    
    [Learn more about Collectives](https://stackoverflow.com/collectives)
    
    **Stack Internal**
    
    Knowledge at work
    
    Bri … [14,774 characters in the file]
  3. https://grafana.com/docs/loki/latest/operations/storage/logs-deletion/
    content
    ![ObservabilityCON 2025](https://a-us.storyblok.com/f/1022730/280x40/b0872b99f9/grafana-logo-observabilitycon-2025-black.svg/m/)
    
    Watch the keynote again and signup for more on-demand sessions.
    
    
    [Watch keynote](https://grafana.com/events/o … [10,111 characters in the file]
  4. https://grafana.com/docs/loki/latest/
    content
    ## Overview
    
    Unlike other logging systems, Loki is built around the idea of only indexing metadata about your logs’ labels (just like Prometheus labels). Log data itself is then compressed and stored in chunks in object stores such as Amazo … [12,086 characters in the file]
  5. https://blog.devops.dev/log-and-metric-retention-in-loki-and-prometheus-57e81bbad023?gi=780056f55dc2
    content
    [Sitemap](https://blog.devops.dev/sitemap/sitemap.xml)
    
    [Open in app](https://play.google.com/store/apps/details?id=com.medium.reader&referrer=utm_source%3DmobileNavBar&source=---top_nav_layout_nav------------------------------------------- … [13,666 characters in the file]
  6. https://grafana.com/docs/enterprise-logs/latest/manage/storage/retention/
    content
    ![ObservabilityCON 2025](https://a-us.storyblok.com/f/1022730/280x40/b0872b99f9/grafana-logo-observabilitycon-2025-black.svg/m/)
    
    Watch the keynote again and signup for more on-demand sessions.
    
    
    [Watch keynote](https://grafana.com/events/o … [25,580 characters in the file]
  7. https://oneuptime.com/blog/post/2026-01-30-loki-retention-strategies/view
    content
    [Skip to main content](https://oneuptime.com/blog/post/2026-01-30-loki-retention-strategies/view#main-content)
    
    ![](https://oneuptime.com/blog/post/2026-01-30-loki-retention-strategies/view)
    
    # How to Implement Loki Retention Strategies
    
    Co … [31,256 characters in the file]
  8. https://community.grafana.com/t/configuring-retention-for-loki-in-a-grafana-cloud-stack/140741
    content
    I just created a free tier Grafana Cloud stack to start working with collecting and analyzing logs and metrics. When pushing data to the Loki-instance I get by default, it drop all logs older tha a week. Is there any way to change that? Do I need to run my own Loki-instance somewhere to enable ...
  9. https://medium.com/@aditya.hilman_10961/enabling-log-retention-in-loki-with-compactor-fe3de2002b47
    content
    [Sitemap](https://medium.com/sitemap/sitemap.xml)
    
    [Open in app](https://play.google.com/store/apps/details?id=com.medium.reader&referrer=utm_source%3DmobileNavBar&source=---top_nav_layout_nav-------------------------------------------)
    
    Si … [9,577 characters in the file]
  10. https://github.com/grafana/loki/issues/8357
    content
    [Skip to content](https://github.com/grafana/loki/issues/8357#start-of-content)
    
    You signed in with another tab or window. [Reload](https://github.com/grafana/loki/issues/8357) to refresh your session.You signed out in another tab or window … [7,134 characters in the file]
Show as JSON
JSON
[
  {
    "rank": 1,
    "url": "https://grafana.com/docs/loki/latest/operations/storage/retention/",
    "title": "Log retention | Grafana Loki documentation",
    "content": "![ObservabilityCON 2025](https://a-us.storyblok.com/f/1022730/280x40/b0872b99f9/grafana-logo-observabilitycon-2025-black.svg/m/)\n\nWatch the keynote again and signup for more on-demand sessions.\n\n\n[Watch keynote](https://grafana.com/events/o … [26,382 characters in the file]",
    "content_chars": 26382,
    "published_date": null
  },
  {
    "rank": 2,
    "url": "https://stackoverflow.com/questions/73138278/why-my-loki-log-retention-is-not-working",
    "title": "purge - why my Loki log retention is not working? - Stack Overflow",
    "content": "##### Collectives™ on Stack Overflow\n\nFind centralized, trusted content and collaborate around the technologies you use most.\n\n[Learn more about Collectives](https://stackoverflow.com/collectives)\n\n**Stack Internal**\n\nKnowledge at work\n\nBri … [14,774 characters in the file]",
    "content_chars": 14774,
    "published_date": null
  },
  {
    "rank": 3,
    "url": "https://grafana.com/docs/loki/latest/operations/storage/logs-deletion/",
    "title": "Log entry deletion | Grafana Loki documentation",
    "content": "![ObservabilityCON 2025](https://a-us.storyblok.com/f/1022730/280x40/b0872b99f9/grafana-logo-observabilitycon-2025-black.svg/m/)\n\nWatch the keynote again and signup for more on-demand sessions.\n\n\n[Watch keynote](https://grafana.com/events/o … [10,111 characters in the file]",
    "content_chars": 10111,
    "published_date": null
  },
  {
    "rank": 4,
    "url": "https://grafana.com/docs/loki/latest/",
    "title": "Grafana Loki | Grafana Loki documentation",
    "content": "## Overview\n\nUnlike other logging systems, Loki is built around the idea of only indexing metadata about your logs’ labels (just like Prometheus labels). Log data itself is then compressed and stored in chunks in object stores such as Amazo … [12,086 characters in the file]",
    "content_chars": 12086,
    "published_date": null
  },
  {
    "rank": 5,
    "url": "https://blog.devops.dev/log-and-metric-retention-in-loki-and-prometheus-57e81bbad023?gi=780056f55dc2",
    "title": "Log and Metric Retention in Loki and Prometheus | by Faith Sodipe ...",
    "content": "[Sitemap](https://blog.devops.dev/sitemap/sitemap.xml)\n\n[Open in app](https://play.google.com/store/apps/details?id=com.medium.reader&referrer=utm_source%3DmobileNavBar&source=---top_nav_layout_nav------------------------------------------- … [13,666 characters in the file]",
    "content_chars": 13666,
    "published_date": "2025-06-13T16:31:59"
  },
  {
    "rank": 6,
    "url": "https://grafana.com/docs/enterprise-logs/latest/manage/storage/retention/",
    "title": "Log retention | Grafana Enterprise Logs documentation",
    "content": "![ObservabilityCON 2025](https://a-us.storyblok.com/f/1022730/280x40/b0872b99f9/grafana-logo-observabilitycon-2025-black.svg/m/)\n\nWatch the keynote again and signup for more on-demand sessions.\n\n\n[Watch keynote](https://grafana.com/events/o … [25,580 characters in the file]",
    "content_chars": 25580,
    "published_date": null
  },
  {
    "rank": 7,
    "url": "https://oneuptime.com/blog/post/2026-01-30-loki-retention-strategies/view",
    "title": "How to Implement Loki Retention Strategies",
    "content": "[Skip to main content](https://oneuptime.com/blog/post/2026-01-30-loki-retention-strategies/view#main-content)\n\n![](https://oneuptime.com/blog/post/2026-01-30-loki-retention-strategies/view)\n\n# How to Implement Loki Retention Strategies\n\nCo … [31,256 characters in the file]",
    "content_chars": 31256,
    "published_date": "2026-01-30T00:00:00"
  },
  {
    "rank": 8,
    "url": "https://community.grafana.com/t/configuring-retention-for-loki-in-a-grafana-cloud-stack/140741",
    "title": "Configuring retention for Loki in a Grafana Cloud stack - ...",
    "content": "I just created a free tier Grafana Cloud stack to start working with collecting and analyzing logs and metrics. When pushing data to the Loki-instance I get by default, it drop all logs older tha a week. Is there any way to change that? Do I need to run my own Loki-instance somewhere to enable ...",
    "content_chars": 298,
    "published_date": "2025-01-20T08:53:41"
  },
  {
    "rank": 9,
    "url": "https://medium.com/@aditya.hilman_10961/enabling-log-retention-in-loki-with-compactor-fe3de2002b47",
    "title": "Enabling Log Retention in Loki with Compactor | by Aditya Hilman ...",
    "content": "[Sitemap](https://medium.com/sitemap/sitemap.xml)\n\n[Open in app](https://play.google.com/store/apps/details?id=com.medium.reader&referrer=utm_source%3DmobileNavBar&source=---top_nav_layout_nav-------------------------------------------)\n\nSi … [9,577 characters in the file]",
    "content_chars": 9577,
    "published_date": "2024-12-03T10:18:49"
  },
  {
    "rank": 10,
    "url": "https://github.com/grafana/loki/issues/8357",
    "title": "Logs retention doesn't work · Issue #8357 · grafana/loki",
    "content": "[Skip to content](https://github.com/grafana/loki/issues/8357#start-of-content)\n\nYou signed in with another tab or window. [Reload](https://github.com/grafana/loki/issues/8357) to refresh your session.You signed out in another tab or window … [7,134 characters in the file]",
    "content_chars": 7134,
    "published_date": "2023-01-31T17:41:57"
  }
]

Excerpt ends here. Open the source for the complete output.

Copied from Captured file (JSON), results 1 › content · an excerpt

Text
![ObservabilityCON 2025](https://a-us.storyblok.com/f/1022730/280x40/b0872b99f9/grafana-logo-observabilitycon-2025-black.svg/m/)

Watch the keynote again and signup for more on-demand sessions.


[Watch keynote](https://grafana.com/events/observabilitycon/?plcmt=obscon2025-post-event-banner)![](https://grafana.com/media/events/grafanacon/2025/icon-close-x.svg)

![ObservabilityCON 2025](https://grafana.com/media/events/obscon/2025/grafana-obscon2025-promo-logo-black.svg)

📢 Registration + agenda now live
Explore the latest Grafana Cloud and AI solutions, learn tips & tricks from demos and hands-on workshops, and get actionable advice to advance your observability strategy. Register now and get 50% off - limited tickets available (while they last!).


[Register now](https://grafana.com/events/observabilitycon/?tech=target&plcmt=top-banner&aud=default)

Searching...

Site search

Ask Grot AI

[Try using ![Grot AI](https://grafana.com/static/img/grot-chat.svg)**Grot AI** for this query ->](https://grafana.com/grot/?chat=&from=/search)

All

Docs

View all results

No results.

There was an error with your request.

> Documentation for automated readers
>
> A curated documentation index is available at: https://grafana.com/llms.txt
>
> A complete documentation index is available at: https://grafana.com/llms-full.txt
>
> These indexes can help with page discovery before fetching individual documents.

This page is also available in Markdown, which may be easier for automated readers
and AI tools to parse than HTML. The Markdown version is available at
https://grafana.com/docs/loki/latest/operations/storage/retention.md, or by sending
Accept: text/markdown to https://grafana.com/docs/loki/latest/operations/storage/retention/. For broader
documentation discovery, the curated index is available at https://grafana.com/llms.txt
and the complete index is available at https://grafana.com/llms-full.txt.

Log retention

[Documentation](https://grafana.com/docs/)![breadcrumb arrow](https://grafana.com/static/assets/img/icons/grafana-icon-breadcrumb-arrow-gray.svg)[Grafana Loki](https://grafana.com/docs/loki/latest/)![breadcrumb arrow](https://grafana.com/static/assets/img/icons/grafana-icon-breadcrumb-arrow-gray.svg)[Manage](https://grafana.com/docs/loki/latest/operations/)![breadcrumb arrow](https://grafana.com/static/assets/img/icons/grafana-icon-breadcrumb-arrow-gray.svg)[Storage](https://grafana.com/docs/loki/latest/operations/storage/)![breadcrumb arrow](https://grafana.com/static/assets/img/icons/grafana-icon-breadcrumb-arrow-gray.svg)Log retention

Open source

# Log retention

Retention in Grafana Loki is achieved through the [Compactor](https://grafana.com/docs/loki/latest/operations/storage/retention/#compactor).
By default the `compactor.retention-enabled` flag is not set, so the logs sent to Loki live forever.

> Note
>
> If you have a lifecycle policy configured on the object store, please ensure that it is longer than the retention period.

Granular retention policies to apply retention at per tenant or per stream level are also supported by the Compactor.

> Note
>
> The Compactor does not support retention on
> [legacy index types](https://grafana.com/docs/loki/latest/configure/storage/#index-storage). Please use the
> [Table Manager](https://grafana.com/docs/loki/latest/operations/storage/table-manager/) when using legacy index types.
> Both the Table manager and legacy index types are deprecated and may be removed in future major versions of Loki.

## Compactor

The Compactor is responsible for compaction of index files and applying log retention.

> Note
>
> Run the Compactor as a singleton (a single instance).

The Compactor runs compaction and retention on two independent schedules:

- Compaction runs every `compactor.compaction-interval`.

Excerpt ends here. Open the source for the complete output.

Copied from Captured file (JSON), results 10 › content · an excerpt

Text
[Skip to content](https://github.com/grafana/loki/issues/8357#start-of-content)

You signed in with another tab or window. [Reload](https://github.com/grafana/loki/issues/8357) to refresh your session.You signed out in another tab or window. [Reload](https://github.com/grafana/loki/issues/8357) to refresh your session.You switched accounts on another tab or window. [Reload](https://github.com/grafana/loki/issues/8357) to refresh your session.Dismiss alert

{{ message }}

[grafana](https://github.com/grafana)/ **[loki](https://github.com/grafana/loki)** Public

- [Notifications](https://github.com/login?return_to=%2Fgrafana%2Floki) You must be signed in to change notification settings
- [Fork\\
4.1k](https://github.com/login?return_to=%2Fgrafana%2Floki)
- [Star\\
28.9k](https://github.com/login?return_to=%2Fgrafana%2Floki)


# Logs retention doesn't work\#8357

[New issue](https://github.com/login?return_to=https://github.com/grafana/loki/issues/8357)

Copy link

[New issue](https://github.com/login?return_to=https://github.com/grafana/loki/issues/8357)

Copy link

Closed

Closed

[Logs retention doesn't work](https://github.com/grafana/loki/issues/8357#top)#8357

Copy link

## Description

[![@fpaparoni](https://avatars.githubusercontent.com/u/4602065?u=c7cc4aa7d4f6f3b26010e2edddb43450f259a42f&v=4&size=48)](https://github.com/fpaparoni)

[fpaparoni](https://github.com/fpaparoni)

opened [on Jan 31, 2023on Jan 31, 2023](https://github.com/grafana/loki/issues/8357#issue-1564748865)

Issue body actions

**Describe the bug**

Using a custom configuration I think the logs should be deleted after 1h, but they are always available

**To Reproduce**

I used the following configuration values for loki helm chart

```
loki:
  config:
    limits_config:
      retention_period: 1h
    compactor:
      retention_enabled: true
      retention_delete_delay: 1h
    table_manager:
      retention_deletes_enabled: true
      retention_period: 1h
```

launched the creation using the following command

`helm install loki grafana/loki-stack --values loki-stack-values.yaml -n loki --create-namespace`

and if I enter into the loki pod I can see the following configuration from /etc/loki/loki.yaml

```
auth_enabled: false
chunk_store_config:
  max_look_back_period: 0s
compactor:
  retention_delete_delay: 1h
  retention_enabled: true
  shared_store: filesystem
  working_directory: /data/loki/boltdb-shipper-compactor
ingester:
  chunk_block_size: 262144
  chunk_idle_period: 3m
  chunk_retain_period: 1m
  lifecycler:
    ring:
      replication_factor: 1
  max_transfer_retries: 0
  wal:
    dir: /data/loki/wal
limits_config:
  enforce_metric_name: false
  max_entries_limit_per_query: 5000
  reject_old_samples: true
  reject_old_samples_max_age: 168h
  retention_period: 1h
memberlist:
  join_members:
  - 'loki-memberlist'
schema_config:
  configs:
  - from: "2020-10-24"
    index:
      period: 24h
      prefix: index_
    object_store: filesystem
    schema: v11
    store: boltdb-shipper
server:
  grpc_listen_port: 9095
  http_listen_port: 3100
storage_config:
  boltdb_shipper:
    active_index_directory: /data/loki/boltdb-shipper-active
    cache_location: /data/loki/boltdb-shipper-cache
    cache_ttl: 24h
    shared_store: filesystem
  filesystem:
    directory: /data/loki/chunks
table_manager:
  retention_deletes_enabled: true
  retention_period: 1h
```

**Expected behavior**

After one hour logs should be deleted, but the retention doesn't work (of course there is something in the configuration that is wrong)

**Environment:**

- Infrastructure: Kubernetes
- Deployment tool: helm

## Activity

### danielrosa-zh commented on Jan 31, 2023on Jan 31, 2023

[![@danielrosa-zh](https://avatars.githubusercontent.com/u/92591588?u=338bb817890c8036cd7fb7b373b0779c4ff10127&v=4&size=48)](https://github.com/danielrosa-zh)

[danielrosa-zh](https://github.com/danielrosa-zh)

Excerpt ends here. Open the source for the complete output.

Search record: Loki results, page text, and call details

Open the whole JSON file ↗
Expected vs. Found
✓Expected: The results are about the Loki the question meant, Grafana Labs' log aggregation system, not its famous namesake.Found: All ten results were about Grafana Loki, none about the Marvel character. The top result says Loki retention is achieved through the Compactor; the tenth enables retention under the compactor block.
Supporting proof
Cited values4 values from this file
query_text
In Loki, the log aggregation system from Grafana Labs, which configuration block does retention_enabled have to be set in for old log data to actually be deleted?
region
ap-south-1
timestamp_utc
2026-09-21T11:49:51Z
raw_response › metadata
{ "query": "In Loki, the log aggregation system from Grafana Labs, which configuration block does retention_enabled have to be set in for old log data to actually be deleted?", "search_uuid": "86875943-0906-45af-876e-1550450736ab", "latency": 10.901536450954154 }
Why this result

It is a Pass: the results had to be about the Loki the question meant, and all ten were about Grafana's log system. Nine of the ten also mention the compactor, which the top result names as how Loki retention works.

Also observed in this test case

Reference pages not returned. The reference pages grafana.com/docs/loki/ and grafana.com/oss/loki/ were not returned at those addresses. Rank 4 was the versioned documentation home, grafana.com/docs/loki/latest/; the rank-1 retention page answered the question directly.

Tested by Aman · evidence dated 21 September 2026

Configuration and setup

How this tool was set up for the run and what the test needed in place. Each row is a fact from the run's records; a fact the records do not hold is left out, not guessed.

Software that produced the output
You.com
Build or version
Not exposed by the hosted product
Surface
API
Set up before the run
Two things share a name: the question should target the less famous one and include a trait that distinguishes it from the famous one.
Feature
You.com Search API (/v1/search) · full-page extraction add-on, other settings at vendor defaults
Run from
India (AWS ap-south-1)
Tested
21 September 2026 · Aman

How this scenario is graded

How we decide Pass, Fail and Not gradable. The same rules apply to every tool tested on this scenario.

How results are decided

Each test case gets one result per tool: Pass, Fail or Not gradable. A test case we haven't run yet shows Untested. There are no partial results.

The rules
  • Pass: the tool did everything the test expected, and nothing it said contradicts the correct answer.
  • Fail: at least one expected behaviour clearly didn't happen; the test case's result says which one and quotes the tool.
  • Not gradable: our evidence couldn't settle the outcome (for example a record we needed is missing). It is never counted as a fail, and the test case's result says what's missing.

Where this sits in the benchmark

This page is one cell of a larger study: one tool, one scenario. Only this benchmark's frame appears here.

LevelNameScope
BenchmarkWeb Search for AI →10 scenarios · 12 tools
CapabilityWeb Retrieval →
ScenarioSomething more famous has the same name →
ToolYou.com →

History of this result

What has happened to this result since it was first published. Runs and grades are never overwritten: a retest or a re-grade publishes a new result and keeps the earlier one readable.

from the publication record
16 November 2026First publishedWeb Search for AI v1

Act on this result

Nothing filed here edits the run or the grade. A challenge opens a review, and a review can produce a new run or a re-grade — which becomes the current result and leaves this one in the history.

This matches what I see

You run the same kind of test against your own setup and get the same behaviour.

Agree →
This does not match

Yours behaves differently. Tell us what you got, with a screenshot if you have one.

Disagree →
Point out an issue

Something here is wrong — a reference value, a transcription, a grade.

Report an issue →
Request a retest

On a newer build, a larger dataset, or your own setup.

Request a retest →
We have fixed this

Tell us what changed and we schedule a rerun of the failing test case. The old result stays as history.

Vendor notice →
Filed against this evidenceNothing yet. Challenges, counter-evidence and fix notices appear here with their outcome, and stay on the page after they are resolved.
Cite this result
aidemos.com/benchmarks/web-search-for-ai/results/you-com/name-disambiguation · 1 pass · 0 fail · coverage 1/1 · graded 2026-10-10

The same record is available as structured data through the AI Demos MCP server, with the counts, the coverage and every per-test-case reason carried as fields.

Verify the proof files

These files support this result. Open a file to inspect the original evidence.

Captured file (JSON) ↗application/json · 332 KB
File fingerprints (SHA-256)

A fingerprint identifies the exact file used for this result.

Captured file (JSON)78f616fd468592efaa2bda58b1ee102b3faf22e385537079ff81287a47fcac45