Scenario in benchmark · Quiz Generation · Version 1

A teacher gives the quiz to a class

A teacher delivers an already-valid quiz to a class of multiple identifiable learners.

Capability: Quiz Delivery1 pinned test case per toolNeutral global definition →

What we check

  1. Whether each intended learner can access and complete the quiz.
  2. Whether each learner's responses and completion state are recorded as a separate attempt.
  3. Whether each attempt is attributed to the correct learner and class.
  4. Whether submissions are kept distinct rather than merged across learners.

Exact wording, inputs, fixture state, expected output and detailed grading remain at the test-case level and may be withheld while the benchmark version is active. The scenario and its evaluation intent are public.

How the tools performed

One row per tool, from its current published Result for this scenario and benchmark version. Open a row for the full summary and the exact counts.

Failed · 3
Edcafe AIFailed1 of 1 test case failedDid not fully meet the requirements for giving a quiz to a class.View Result →

Three learners completed the quiz through Google Classroom and had separate submissions, but the report did not identify their class or Google accounts.

0 Pass · 1 Fail · 0 Not gradable · 1 of 1 assessed · 1 of 1 gradable

PDF to QuizFailed1 of 1 test case failedLet a learner take a shared quiz, but did not provide results attributed to a learner or class.View Result →

The teacher’s results panels stayed empty after a reload, and the learner’s signed-in dashboard was empty too.

0 Pass · 1 Fail · 0 Not gradable · 1 of 1 assessed · 1 of 1 gradable

StudyglenFailed1 of 1 test case failedDelivered a live quiz and kept individual scores, but did not save each learner's answers or attribute their work to a class.View Result →

The host showed group answer counts, and the export provided learner totals without answers.

0 Pass · 1 Fail · 0 Not gradable · 1 of 1 assessed · 1 of 1 gradable

Passed · 1
QuizgeckoPassed1 of 1 test case passedLet both learners take and finish the same class quiz, with results attributed separately.View Result →

The teacher’s Course Report listed 2 learners, 2 quiz sessions and 2 completions; the learners’ scores were 26% and 36%.

1 Pass · 0 Fail · 0 Not gradable · 1 of 1 assessed · 1 of 1 gradable

Failures first, then A–Z within each group. Not a ranking. Assessed = Pass + Fail + Not gradable; Gradable = Pass + Fail, both out of the Result’s pinned test cases.

No published Result yet (6): DoctoQuiz, GPT-5.6 terra, Knowt, QuestionWell, Quizizz, QuizRise.

No published Result does not tell you whether a tool has been tested.

Test design

Pinned test cases
1
Disclosure
0 public · 1 withheld
Capabilities exercised here
Quiz Delivery

How the results are graded

  • Pass the test-case expectations hold.
  • Fail an expectation demonstrably does not hold.
  • Not gradable the evidence cannot establish the outcome.

Version 1 uses test-case expectations; no scenario rubric is pinned. Benchmark methodology →

A teacher gives the quiz to a class in Quiz Generation | AI Demos