Tool in benchmark · Version 1

DoctoQuiz in Quiz Generation

Scenario-level performance from current published Results.

0Passed
4Failed
12No published Result yet

4 of 16 scenarios published

CapabilityScenariosResult
Quiz Generation0 pass · 4 fail · 4 of 5 published
Answer Feedback0 of 2 published
Class Reports0 of 1 published
Grading0 of 3 published
Learner Progress0 of 1 published
Personalized Practice0 of 2 published
Quiz Delivery0 of 2 published
PassedFailedPublished, different test setNo published Result yet

Where DoctoQuiz failed

4 of 4 graded scenarios. Open a Result to see the conversation and the evidence.

Quiz Generation

A cleanly scanned document

DoctoQuiz turned a scanned Electric Circuits chapter into a ten-question quiz that mostly tested material the chapter never teaches. It asked about Ohm's law, capacitors and diodes, which the chapter never mentions; only two questions, on the ampere and on parallel current, touched the chapter, and both test its most generic facts.

View Result →
Quiz Generation

Important information appears in both text and a diagram

DoctoQuiz generated a quiz that covered text-based concepts but omitted the diagram-only core idea. None of its ten questions assessed the Fenmoor Ditch food web’s feeding relationships.

View Result →
Quiz Generation

The user asks the quiz to test a particular learning goal

DoctoQuiz returned ten multiple-choice questions when asked for one open-ended question testing an explanation goal. It provided no model answer or key points.

View Result →
Quiz Generation

The user turns study material into a quiz

DoctoQuiz produced correctly keyed multiple-choice quizzes in English and Hindi, but both omitted core material while repeating other topics. Each ten-question quiz left out home circuits from a chapter with six core sections; the Hindi quiz kept every question, option and answer in Hindi.

View Result →

How DoctoQuiz performed

Open a capability to explore its scenarios. Each row reports the test set in its published Result.

Quiz Generation4 fail1 no Result yet
ScenarioPublished outcomesTest coverageResult
A cleanly scanned document
0 Pass1 Fail0 Not gradable
1 of 1 test case failed
What happened

DoctoQuiz turned a scanned Electric Circuits chapter into a ten-question quiz that mostly tested material the chapter never teaches. It asked about Ohm's law, capacitors and diodes, which the chapter never mentions; only two questions, on the ampere and on parallel current, touched the chapter, and both test its most generic facts.

1/1 assessed1/1 gradablePublished test setView Result →
Important information appears in both text and a diagram
0 Pass1 Fail0 Not gradable
1 of 1 test case failed
What happened

DoctoQuiz generated a quiz that covered text-based concepts but omitted the diagram-only core idea. None of its ten questions assessed the Fenmoor Ditch food web’s feeding relationships.

1/1 assessed1/1 gradablePublished test setView Result →
The user asks the quiz to test a particular learning goal
0 Pass1 Fail0 Not gradable
1 of 1 test case failed
What happened

DoctoQuiz returned ten multiple-choice questions when asked for one open-ended question testing an explanation goal. It provided no model answer or key points.

1/1 assessed1/1 gradablePublished test setView Result →
The user turns study material into a quiz
0 Pass2 Fail0 Not gradable
2 of 2 test cases failed
What happened

DoctoQuiz produced correctly keyed multiple-choice quizzes in English and Hindi, but both omitted core material while repeating other topics. Each ten-question quiz left out home circuits from a chapter with six core sections; the Hindi quiz kept every question, option and answer in Hindi.

2/2 assessed2/2 gradablePublished test setView Result →
The user turns a recorded lecture into a quizNo published result
Answer Feedback2 no Result yet
ScenarioPublished outcomesTest coverageResult
The learner gives a clearly wrong answerNo published result
The learner's answer is partly correctNo published result
Class Reports1 no Result yet
ScenarioPublished outcomesTest coverageResult
The teacher checks what the class struggled withNo published result
Grading3 no Result yet
ScenarioPublished outcomesTest coverageResult
The learner answers correctly in their own wordsNo published result
The learner answers some fixed-answer questions correctly and others incorrectlyNo published result
The learner's answer is partly correctNo published result
Learner Progress1 no Result yet
ScenarioPublished outcomesTest coverageResult
The learner checks whether they are improvingNo published result
Personalized Practice2 no Result yet
ScenarioPublished outcomesTest coverageResult
One topic is weaker than the othersNo published result
The learner returns to the material laterNo published result
Quiz Delivery2 no Result yet
ScenarioPublished outcomesTest coverageResult
A learner takes a quiz on their ownNo published result
A teacher gives the quiz to a classNo published result

Reading these Results

Published evidence and test coverage answer different questions.

Publication availability

Which scenarios have a Result?

A published Result is public evidence for this tool on one scenario. “No published result” does not say whether testing has taken place.

Test coverage

What does each Result cover?

Assessed includes Pass, Fail and Not gradable. Gradable includes Pass and Fail. Both use the pinned test count in that published Result.

Scenario scope

Out of 15 scenarios

The summary counts each of the 15 scenarios once. A scenario fails when any of its published test cases failed. “No published Result yet” means nothing is public for that scenario; it does not say whether DoctoQuiz was tested on it.

DoctoQuiz in Quiz Generation | AI Demos