Returns the correct refund-policy facts: a 30-day return window, unused/unwashed/original-packaging requirements, and a 5–7 business-day refund processing time.
What was measured
policy accuracy
Gives policy details that match the provided knowledge base and does not misstate rules.
transformation
What was given, what came back
Test input: Refund policy, application, and processing-time question · text · group: stylenova-customer-support
Input — what we sent
The exact prompt
What's your refund policy? And if I'm eligible, how do I actually apply for one? Also, how long does it usually take to process?
A multi-part customer-support query asking for the refund policy, how to apply for a refund, and how long processing usually takes. It tests grounded FAQ answering and multi-step policy completeness.
Why this input is hard
- · knowledge-base grounding
- · multi-part query handling
- · policy accuracy
- · response completeness
- · hallucination resistance
Output — unretouched
Also checked on this input — same tool, 4 other criteria
knowledge-bound reasoning✓ WorkedBases the answer on the supplied knowledge base instead of inventing refund-application steps that are not provided.multi-part query handling◐ MixedCan handle a three-part support question by answering the policy and timing subrequests correctly, but it leaves the application-step subrequest unanswered.response completeness⚠ StruggledLeaves one of the user’s requested items unanswered by not explaining how to apply for a refund, so the support reply is incomplete.uncertainty acknowledgment✓ WorkedClearly acknowledges a knowledge gap by saying it does not have instructions in the knowledge base for how to apply for a refund specifically.
Provenance
- Observation
- 3abe8514-2cdb-4e84-97b7-8ab47ef230d0
- Evidence run
- cf8842ae-b5a5-4bf3-a6d9-d61ebe406097
- Study
- Automate customer support using an AI chatbot
- Research task
- 86b9jm3ev
- Tested at
- not recorded
- Source
- first-party
- Evidence state
- verified
- Proof shown
- input + output shown
- Cost / latency
- not captured
- Repeat run
- not captured
- Tester
- not captured
The last three rows are honest blanks, not placeholders — our capture has no field for them yet.
Query this
get_evidence({
tool: "fs-agent",
scenario: "stylenova-customer-support"
})MCP · mcp.aidemos.com/api/mcp
Free with attribution.
Same input, same check — 6 other tools
measured on policy accuracy
Chatbase✓ WorkedThe bot preserves exact KB policy values instead of paraphrasing them away: a 30-day return window, refunds processed in 5–7 business days, unused/unwashed/original-packaging conditions, and the Elite vs non-Elite return-shipping split ($4.99 vs free).Freshdesk✓ WorkedStays aligned with the stated refund policy: returns within 30 days, items unused/unwashed/in original packaging, exchanges for size or color, free returns for Elite members, and $4.99 shipping for other customers.JotForm✓ WorkedMatched the refund rules exactly: a 30-day return window, unused/unwashed items in original packaging, Elite members with free returns, $4.99 return shipping for others, and refunds processed in 5-7 business days.Kommunicate✓ WorkedStates the core refund policy accurately: returns within 30 days of delivery, items must be unused/unwashed/in original packaging, and refunds are processed 5–7 business days after the returned item is received.Tidio✓ WorkedReturns policy details that match the described support policy: returns within 30 days of delivery, items must be unused/unwashed/in original packaging, Elite members get free returns, and all others pay a $4.99 return-shipping fee.Wonderchat✓ WorkedIt matched the stated rules: returns within 30 days of delivery, items unused/unwashed/in original packaging, Elite free returns, $4.99 return shipping for other customers, and refunds processed in 5–7 business days after receipt and inspection.
This evidence is published in
Real inputs and real outputs, no retouching · every cell queryable via API & MCP · aidemos.com