Capability definition · C8

Analytics and observability

Lets the operator see what the agent did, inspect any conversation, and trust the reported numbers

What this capability means

A product has this capability when an operator can inspect what the agent did, review conversations or tool calls, and check that reported analytics match the underlying activity.

Boundary: It does not judge the quality of the agent’s answers or actions themselves; it judges whether those actions can be seen and verified.

Scenarios that test this capability

A scenario is a real-world situation used to test a capability.

Benchmarks that include this capability

A capability has global identity and may be used by more than one benchmark.

Benchmark

AI Customer Support Chatbots

Automate customer support using an AI chatbot / AI customer support agent — which agents handle real customer support conversations for a business best?

Analytics and observability — Capability definition | AI Demos