Scenario in benchmark · Quiz Generation · Version 1
A teacher gives the quiz to a class
A teacher delivers an already-valid quiz to a class of multiple identifiable learners.
What we check
- Whether each intended learner can access and complete the quiz.
- Whether each learner's responses and completion state are recorded as a separate attempt.
- Whether each attempt is attributed to the correct learner and class.
- Whether submissions are kept distinct rather than merged across learners.
Exact wording, inputs, fixture state, expected output and detailed grading remain at the test-case level and may be withheld while the benchmark version is active. The scenario and its evaluation intent are public.
How the tools performed
One row per tool, from its current published Result for this scenario and benchmark version. Open a row for the full summary and the exact counts.
Edcafe AIFailed1 of 1 test case failedDid not fully meet the requirements for giving a quiz to a class.View Result →
Three learners completed the quiz through Google Classroom and had separate submissions, but the report did not identify their class or Google accounts.
0 Pass · 1 Fail · 0 Not gradable · 1 of 1 assessed · 1 of 1 gradable
PDF to QuizFailed1 of 1 test case failedLet a learner take a shared quiz, but did not provide results attributed to a learner or class.View Result →
The teacher’s results panels stayed empty after a reload, and the learner’s signed-in dashboard was empty too.
0 Pass · 1 Fail · 0 Not gradable · 1 of 1 assessed · 1 of 1 gradable
StudyglenFailed1 of 1 test case failedDelivered a live quiz and kept individual scores, but did not save each learner's answers or attribute their work to a class.View Result →
The host showed group answer counts, and the export provided learner totals without answers.
0 Pass · 1 Fail · 0 Not gradable · 1 of 1 assessed · 1 of 1 gradable
QuizgeckoPassed1 of 1 test case passedLet both learners take and finish the same class quiz, with results attributed separately.View Result →
The teacher’s Course Report listed 2 learners, 2 quiz sessions and 2 completions; the learners’ scores were 26% and 36%.
1 Pass · 0 Fail · 0 Not gradable · 1 of 1 assessed · 1 of 1 gradable
Failures first, then A–Z within each group. Not a ranking. Assessed = Pass + Fail + Not gradable; Gradable = Pass + Fail, both out of the Result’s pinned test cases.
No published Result yet (6): DoctoQuiz, GPT-5.6 terra, Knowt, QuestionWell, Quizizz, QuizRise.
No published Result does not tell you whether a tool has been tested.Test design
- Pinned test cases
- 1
- Disclosure
- 0 public · 1 withheld
- Capabilities exercised here
- Quiz Delivery
How the results are graded
- Pass the test-case expectations hold.
- Fail an expectation demonstrably does not hold.
- Not gradable the evidence cannot establish the outcome.
Version 1 uses test-case expectations; no scenario rubric is pinned. Benchmark methodology →