Scenario in benchmark · Quiz Generation · Version 1
The learner checks whether they are improving
A learner reviews progress after earlier and later attempts show improvement in one topic and continued errors in another.
What we check
- Whether the progress view agrees with the recorded attempts over time.
- Whether it presents the improved topic more positively than before.
- Whether it still shows the weaker topic as needing work.
- Whether it avoids claiming complete mastery while weakness remains.
Exact wording, inputs, fixture state, expected output and detailed grading remain at the test-case level and may be withheld while the benchmark version is active. The scenario and its evaluation intent are public.
How the tools performed
One row per tool, from its current published Result for this scenario and benchmark version. Open a row for the full summary and the exact counts.
Edcafe AIFailed1 of 1 test case failedDid not give the learner a way to track improvement across attempts.View Result →
The improved attempt replaced the earlier result rather than creating a history, and the teacher report kept only the first submission.
0 Pass · 1 Fail · 0 Not gradable · 1 of 1 assessed · 1 of 1 gradable
QuestionWellFailed1 of 1 test case failedFails this scenario: the learner view shows only whole-quiz scores, not topic-level progress.View Result →
The same attempts appear broken out by learning outcome on the teacher side, so the missing detail exists but is not shown to learners.
0 Pass · 1 Fail · 0 Not gradable · 1 of 1 assessed · 1 of 1 gradable
QuizgeckoFailed1 of 1 test case failedFails to show learner progress by topic in this scenario.View Result →
The counts line up with the attempts, but the captured views stay at quiz or question level, so the improved topic never appears more positive and the weaker topic never appears as needing work.
0 Pass · 1 Fail · 0 Not gradable · 1 of 1 assessed · 1 of 1 gradable
StudyglenFailed1 of 1 test case failedDid not show progress by topic.View Result →
Its Progress view was empty while an earlier quiz attempt was already recorded, and the Library and attempt reviews give only whole-quiz scores and per-question marks, so nothing shows which topic improved and which, like the still-wrong ammeter question, needs work.
0 Pass · 1 Fail · 0 Not gradable · 1 of 1 assessed · 1 of 1 gradable
PDF to QuizPassed1 of 1 test case passedShowed improvement from 53% to 85% while continuing to flag circuit measurement as needing work.View Result →
Across 2 attempts of 47 questions, it counted 94 answers and reported mean and median scores of 69%, without claiming complete mastery.
1 Pass · 0 Fail · 0 Not gradable · 1 of 1 assessed · 1 of 1 gradable
Failures first, then A–Z within each group. Not a ranking. Assessed = Pass + Fail + Not gradable; Gradable = Pass + Fail, both out of the Result’s pinned test cases.
No published Result yet (5): DoctoQuiz, GPT-5.6 terra, Knowt, Quizizz, QuizRise.
No published Result does not tell you whether a tool has been tested.Test design
- Pinned test cases
- 1
- Disclosure
- 0 public · 1 withheld
- Capabilities exercised here
- Learner Progress
How the results are graded
- Pass the test-case expectations hold.
- Fail an expectation demonstrably does not hold.
- Not gradable the evidence cannot establish the outcome.
Version 1 uses test-case expectations; no scenario rubric is pinned. Benchmark methodology →