Scenario definition · S105
The learner gives a clearly wrong answer
A learner gives a wrong answer that comes from a recognisable misunderstanding rather than a random guess.
What this scenario means
This situation checks whether the learner’s response is wrong for a specific reason, not just because the learner guessed. It is a real test because the wrongness should point to an understandable misconception in the answer itself.
What we evaluate
- Whether the answer is plainly wrong.
- Whether the wrong answer reflects a recognisable misunderstanding.
- Whether the wrongness is not just an arbitrary guess.
◌Test-case detail. Exact wording, inputs, fixture state, expected output and detailed grading remain at the test-case level and may be withheld while the benchmark version is active. The scenario and its evaluation intent are public.
Capabilities this scenario exercises
A scenario may exercise one or more capabilities.
Answer Feedback
Explains what the learner understood correctly and what remains wrong, missing, or incomplete
Benchmarks that use this scenario
A scenario has global identity and may be reused across benchmarks.
Quiz Generation
Which AI quiz tool turns study material into valid quizzes, and then grades, explains and tracks what the learner actually understood?