Later turns could draw on the stored working preferences without the user restating them, showing that prior context remained available across sessions and influenced follow-up responses.
What was measured
Relevant Retrieval
Checks whether the tool retrieves the right memory for the current task.
decisive for this rankingtransformation
The main value of memory is surfacing the right context when needed, so retrieval quality directly determines usefulness. (3 of 3 judges)
What was given, what came back
Test input: Personal Work Brain Memory · text · group: memory-for-ai-agents
Input — what we sent
The exact prompt
Session 1: Use this under user_id: founder_001 I run a small AI product/research team. When you help me, remember how I work: - Keep outputs short, direct, and copy-paste ready. - Do not make writing sound too polished or motivational. - Always mention what proof or artifact is needed before making a strong claim. - If a task is risky or unclear, tell me the safest next step instead of guessing. Session 2: Use this under user_id: founder_001 Today I am testing tools for an AI memory use case. I want to show users that memory is not just "remember my favorite color." It should help an assistant continue real work across days, remember my working style, and avoid repeating the same explanation again. Create a short internal update for my team about what I worked on today and what we should test next. Session 3: Use this under user_id: founder_001 Now write a formal email to a potential enterprise partner asking if they are open to a product demo next week. Keep it professional.
A multi-session personal assistant memory test where the user first sets working-style preferences, then asks for an internal update, and finally requests a formal partner email to check whether the assistant applies memory selectively and appropriately across different writing tasks.
Why this input is hard
- · work-style preference memory
- · cross-session retrieval
- · tone adaptation by task
- · proof-first behavior
- · avoiding overgeneralization of memory
Output — unretouched


Also checked on this input — same tool, 2 other criteria
Correct Application◐ MixedThe tool applied the memory selectively: the internal update was useful but a bit more structured and polished than the requested short, direct style, while the formal partner email stayed professional and did not leak the internal terse style into a different writing task.Memory Capture Quality✓ WorkedThe tool captured a reusable working-style profile, not just a one-off fact: it stored the user's short, direct output preference, the anti-hype writing style, the requirement to mention proof or artifacts before strong claims, the safe-next-step rule for risky tasks, and the small AI product/research team context.
Provenance
- Observation
- 95da3a54-d778-448f-8d00-2488e9aab719
- Evidence run
- 6e31afbb-34d7-459a-b688-68ef76fc615a
- Study
- Memory for AI Agents
- Research task
- 86ba16xrp
- Tested at
- not recorded
- Source
- first-party
- Evidence state
- verified
- Proof shown
- input + output shown
- Cost / latency
- not captured
- Repeat run
- not captured
- Tester
- not captured
The last three rows are honest blanks, not placeholders — our capture has no field for them yet.
Query this
get_evidence({
tool: "supermemory",
scenario: "memory-for-ai-agents"
})MCP · mcp.aidemos.com/api/mcp
Free with attribution.
Same input, same check — 4 other tools
measured on Relevant Retrieval
Cognee✓ WorkedRecalls prior working-style memory in later sessions through GRAPH_COMPLETION, exposing evidence chunks plus dataset and document/chunk IDs rather than a simple memory-hit flag.Hindsight✓ WorkedOn a later task, it retrieved the earlier work-style and memory-testing context for the internal update instead of falling back to unrelated conversation history.Mem0✓ WorkedRetrieves the previously stored work-style memory in a later session so the assistant can reuse it for a follow-up internal update.Zep✓ WorkedRetrieved the saved founder work style in a later task and produced a short internal update without requiring the user to restate the preference block.
This evidence is published in
Real inputs and real outputs, no retouching · every cell queryable via API & MCP · aidemos.com