Evidence · first-party tested
When asked to 'compare that to last month' with the 'same breakdown,' it narrowed the scope to the paid-pending subproblem and did not compare the full earlier pipeline breakdown or ask a clarifying question.
✗ FailedBasedash →
The observation
When asked to 'compare that to last month' with the 'same breakdown,' it narrowed the scope to the paid-pending subproblem and did not compare the full earlier pipeline breakdown or ask a clarifying question.
Criterion: Ambiguity Handling · Scenario: Order pipeline breakdown with pending-but-paid edge case and last-month comparison (group: nl2sql-live-database)
Query this
get_evidence({
tool: "basedash",
scenario: "nl2sql-live-database"
})MCP · mcp.aidemos.com/api/mcp
Free with attribution.
Free with attribution.
Same input, other tools
Real outputs, no retouching · every cell queryable via API & MCP · aidemos.com