Capability in benchmark · Version 1

Multilingual support

The agent handles customers who do not write in English and can follow language switches during a conversation.

2 scenarios · 6 current published Results · 3 tools with published Results

How the tools performed

Explore current published Results across this capability’s scenarios. Open a scenario to compare its tools, or a Result to inspect the evidence.

Each cell reports its own published test set. There is no combined capability score or claim that different Results used identical tests.

Scenarios in this capability
Tools with published Results appear first, alphabetically. Remaining participants stay visible below.
Participating toolCustomer communicates in another supported language →Customer switches languages during the conversation →
BotpressCustomer communicates in another supported language →
1 Pass
1/1 assessed1/1 gradableView Result →
Customer switches languages during the conversation →
1 Pass
1/1 assessed1/1 gradableView Result →
Intercom FinCustomer communicates in another supported language →
1 Pass
1/1 assessed1/1 gradableView Result →
Customer switches languages during the conversation →
1 Fail
1/1 assessed1/1 gradableView Result →
Zendesk AICustomer communicates in another supported language →
1 Pass
1/1 assessed1/1 gradableView Result →
Customer switches languages during the conversation →
1 Fail
1/1 assessed1/1 gradableView Result →
AdaNo published result across these scenarios
ChatbaseNo published result across these scenarios
CustomGPT.aiNo published result across these scenarios
DecagonNo published result across these scenarios
Freshdesk FreddyNo published result across these scenarios
FS Agent (DIY control)No published result across these scenarios
GorgiasNo published result across these scenarios
Help ScoutNo published result across these scenarios
KommunicateNo published result across these scenarios
Tidio LyroNo published result across these scenarios

Reading the comparison

Publication availability and test coverage describe different things.

Published evidence

Publication is not testing progress

“No published result” says only that there is no current public Result. It does not indicate whether a tool has been tested, passed, failed or is applicable.

Test coverage

Read each Result’s test set

Assessed includes Pass, Fail and Not gradable. Gradable includes Pass and Fail. Each fraction uses the pinned tests in that same published Result.

Go deeper

Choose the view you need

A scenario compares tools on one situation. A tool page follows one tool across this benchmark. A Result explains the outcome and shows the evidence.

Multilingual support in AI Customer Support Chatbots | AI Demos