Scenario in benchmark · Quiz Generation · Version 1

The learner gives a clearly wrong answer

A learner gives a wrong answer that comes from a recognisable misunderstanding rather than a random guess.

Capability: Answer Feedback1 pinned test case per toolNeutral global definition →

What we check

  1. Whether the answer is plainly wrong.
  2. Whether the wrong answer reflects a recognisable misunderstanding.
  3. Whether the wrongness is not just an arbitrary guess.

Exact wording, inputs, fixture state, expected output and detailed grading remain at the test-case level and may be withheld while the benchmark version is active. The scenario and its evaluation intent are public.

How the tools performed

One row per tool, from its current published Result for this scenario and benchmark version. Open a row for the full summary and the exact counts.

Failed · 1
QuestionWellFailed1 of 1 test case failedFailed to give full help for a clearly wrong learner answer.View Result →

The feedback pointed at a series-circuit misunderstanding, but it did not explain why the answer was wrong, state the correct idea, or show a model answer; the end screen showed only an overall score.

0 Pass · 1 Fail · 0 Not gradable · 1 of 1 assessed · 1 of 1 gradable

Passed · 4
Edcafe AIPassed1 of 1 test case passedPassed this scenario.View Result →

The learner-facing feedback said the answer was incorrect, gave the rule that current stays the same in a series circuit, and addressed the stated misunderstanding rather than only showing the answer.

1 Pass · 0 Fail · 0 Not gradable · 1 of 1 assessed · 1 of 1 gradable

PDF to QuizPassed1 of 1 test case passedExplained the learner’s clearly wrong answer by correcting the belief that bulbs use up current.View Result →

It addressed the misunderstanding rather than simply revealing the right answer.

1 Pass · 0 Fail · 0 Not gradable · 1 of 1 assessed · 1 of 1 gradable

QuizgeckoPassed1 of 1 test case passedHandled the clearly wrong answer by marking it wrong and explaining both the correct series-circuit rule and the learner’s misconception.View Result →

It showed 0.20 A as the bare ideal answer and then offered follow-up options after feedback.

1 Pass · 0 Fail · 0 Not gradable · 1 of 1 assessed · 1 of 1 gradable

StudyglenPassed1 of 1 test case passedPasses this scenario: it gives diagnostic feedback for a wrong answer that reflects a real misconception.View Result →

On Question 15 it said the response was wrong, gave the continuous-path idea, and matched the source chapter's energy/current distinction.

1 Pass · 0 Fail · 0 Not gradable · 1 of 1 assessed · 1 of 1 gradable

Failures first, then A–Z within each group. Not a ranking. Assessed = Pass + Fail + Not gradable; Gradable = Pass + Fail, both out of the Result’s pinned test cases.

No published Result yet (5): DoctoQuiz, GPT-5.6 terra, Knowt, Quizizz, QuizRise.

No published Result does not tell you whether a tool has been tested.

Test design

Pinned test cases
1
Disclosure
0 public · 1 withheld
Capabilities exercised here
Answer Feedback

How the results are graded

  • Pass the test-case expectations hold.
  • Fail an expectation demonstrably does not hold.
  • Not gradable the evidence cannot establish the outcome.

Version 1 uses test-case expectations; no scenario rubric is pinned. Benchmark methodology →

The learner gives a clearly wrong answer in Quiz Generation | AI Demos