Matched the refund rules exactly: a 30-day return window, unused/unwashed items in original packaging, Elite members with free returns, $4.99 return shipping for others, and refunds processed in 5-7 business days.
What was measured
policy accuracy
Gives policy details that match the provided knowledge base and does not misstate rules.
transformation
What was given, what came back
Test input: Refund policy, application, and processing-time question · text · group: stylenova-customer-support
Input — what we sent
The exact prompt
What's your refund policy? And if I'm eligible, how do I actually apply for one? Also, how long does it usually take to process?
A multi-part customer-support query asking for the refund policy, how to apply for a refund, and how long processing usually takes. It tests grounded FAQ answering and multi-step policy completeness.
Why this input is hard
- · knowledge-base grounding
- · multi-part query handling
- · policy accuracy
- · response completeness
- · hallucination resistance
Output — unretouched
Also checked on this input — same tool, 3 other criteria
conversational quality◐ MixedThe response was concise and support-appropriate, but the report notes it stayed as one unformatted paragraph with no headers or bullets, which made it harder to scan.multi-part query handling✓ WorkedHandled a single support turn with three linked questions in one reply, covering the policy, how to apply, and processing time without splitting the conversation apart.response completeness✓ WorkedAnswered all requested parts of the refund request, including eligibility, application steps, and the 5-7 business day processing estimate, and also offered to guide the return process.
Provenance
- Observation
- f2d80928-f61c-4a15-9766-f3440a50e253
- Evidence run
- cf8842ae-b5a5-4bf3-a6d9-d61ebe406097
- Study
- Automate customer support using an AI chatbot
- Research task
- 86b9jm3ev
- Tested at
- not recorded
- Source
- first-party
- Evidence state
- verified
- Proof shown
- input + output shown
- Cost / latency
- not captured
- Repeat run
- not captured
- Tester
- not captured
The last three rows are honest blanks, not placeholders — our capture has no field for them yet.
Query this
get_evidence({
tool: "jotform",
scenario: "stylenova-customer-support"
})MCP · mcp.aidemos.com/api/mcp
Free with attribution.
Same input, same check — 6 other tools
measured on policy accuracy
Chatbase✓ WorkedThe bot preserves exact KB policy values instead of paraphrasing them away: a 30-day return window, refunds processed in 5–7 business days, unused/unwashed/original-packaging conditions, and the Elite vs non-Elite return-shipping split ($4.99 vs free).Freshdesk✓ WorkedStays aligned with the stated refund policy: returns within 30 days, items unused/unwashed/in original packaging, exchanges for size or color, free returns for Elite members, and $4.99 shipping for other customers.FS Agent✓ WorkedReturns the correct refund-policy facts: a 30-day return window, unused/unwashed/original-packaging requirements, and a 5–7 business-day refund processing time.Kommunicate✓ WorkedStates the core refund policy accurately: returns within 30 days of delivery, items must be unused/unwashed/in original packaging, and refunds are processed 5–7 business days after the returned item is received.Tidio✓ WorkedReturns policy details that match the described support policy: returns within 30 days of delivery, items must be unused/unwashed/in original packaging, Elite members get free returns, and all others pay a $4.99 return-shipping fee.Wonderchat✓ WorkedIt matched the stated rules: returns within 30 days of delivery, items unused/unwashed/in original packaging, Elite free returns, $4.99 return shipping for other customers, and refunds processed in 5–7 business days after receipt and inspection.
This evidence is published in
Real inputs and real outputs, no retouching · every cell queryable via API & MCP · aidemos.com