It matched the stated rules: returns within 30 days of delivery, items unused/unwashed/in original packaging, Elite free returns, $4.99 return shipping for other customers, and refunds processed in 5–7 business days after receipt and inspection.
What was measured
policy accuracy
Gives policy details that match the provided knowledge base and does not misstate rules.
transformation
What was given, what came back
Test input: Refund policy, application, and processing-time question · text · group: stylenova-customer-support
Input — what we sent
The exact prompt
What's your refund policy? And if I'm eligible, how do I actually apply for one? Also, how long does it usually take to process?
A multi-part customer-support query asking for the refund policy, how to apply for a refund, and how long processing usually takes. It tests grounded FAQ answering and multi-step policy completeness.
Why this input is hard
- · knowledge-base grounding
- · multi-part query handling
- · policy accuracy
- · response completeness
- · hallucination resistance
Output — unretouched
Also checked on this input — same tool, 3 other criteria
conversational quality◐ MixedThe response was clearly structured and support-appropriate, but the report says it was slightly over-explained for a simple policy check and could overwhelm a customer who wanted a quick answer.multi-part query handling✓ WorkedIt answered a single 3-part support question in one response, covering the refund policy, how to apply, and the usual processing time.response completeness✓ WorkedIt fully covered the refund request by giving the policy, the application steps, the processing timeline, and contact options for starting the return.
Provenance
- Observation
- 751630a9-990a-4019-bb41-a66e6c164ddc
- Evidence run
- cf8842ae-b5a5-4bf3-a6d9-d61ebe406097
- Study
- Automate customer support using an AI chatbot
- Research task
- 86b9jm3ev
- Tested at
- not recorded
- Source
- first-party
- Evidence state
- verified
- Proof shown
- input + output shown
- Cost / latency
- not captured
- Repeat run
- not captured
- Tester
- not captured
The last three rows are honest blanks, not placeholders — our capture has no field for them yet.
Query this
get_evidence({
tool: "wonderchat",
scenario: "stylenova-customer-support"
})MCP · mcp.aidemos.com/api/mcp
Free with attribution.
Same input, same check — 6 other tools
measured on policy accuracy
Chatbase✓ WorkedThe bot preserves exact KB policy values instead of paraphrasing them away: a 30-day return window, refunds processed in 5–7 business days, unused/unwashed/original-packaging conditions, and the Elite vs non-Elite return-shipping split ($4.99 vs free).Freshdesk✓ WorkedStays aligned with the stated refund policy: returns within 30 days, items unused/unwashed/in original packaging, exchanges for size or color, free returns for Elite members, and $4.99 shipping for other customers.FS Agent✓ WorkedReturns the correct refund-policy facts: a 30-day return window, unused/unwashed/original-packaging requirements, and a 5–7 business-day refund processing time.JotForm✓ WorkedMatched the refund rules exactly: a 30-day return window, unused/unwashed items in original packaging, Elite members with free returns, $4.99 return shipping for others, and refunds processed in 5-7 business days.Kommunicate✓ WorkedStates the core refund policy accurately: returns within 30 days of delivery, items must be unused/unwashed/in original packaging, and refunds are processed 5–7 business days after the returned item is received.Tidio✓ WorkedReturns policy details that match the described support policy: returns within 30 days of delivery, items must be unused/unwashed/in original packaging, Elite members get free returns, and all others pay a $4.99 return-shipping fee.
This evidence is published in
Real inputs and real outputs, no retouching · every cell queryable via API & MCP · aidemos.com