Tool in benchmark · Version 1

QuestionWell in Quiz Generation

Scenario-level performance from current published Results.

5Passed
7Failed
4No published Result yet

12 of 16 scenarios published

CapabilityScenariosResult
Answer Feedback1 pass · 1 fail · 2 of 2 published
Class Reports1 pass · 0 fail · 1 of 1 published
Grading3 pass · 0 fail · 3 of 3 published
Learner Progress0 pass · 1 fail · 1 of 1 published
Personalized Practice0 pass · 2 fail · 2 of 2 published
Quiz Generation0 pass · 3 fail · 3 of 5 published
Quiz Delivery0 of 2 published
PassedFailedPublished, different test setNo published Result yet

Where QuestionWell failed

7 of 12 graded scenarios. Open a Result to see the conversation and the evidence.

Answer Feedback

The learner gives a clearly wrong answer

QuestionWell failed to give full help for a clearly wrong learner answer. The feedback pointed at a series-circuit misunderstanding, but it did not explain why the answer was wrong, state the correct idea, or show a model answer; the end screen showed only an overall score.

View Result →
Learner Progress

The learner checks whether they are improving

QuestionWell fails this scenario: the learner view shows only whole-quiz scores, not topic-level progress. The same attempts appear broken out by learning outcome on the teacher side, so the missing detail exists but is not shown to learners.

View Result →
Personalized Practice

One topic is weaker than the others

QuestionWell did not personalize practice from learners' stored performance histories. Its Teaching Assistant first asked for results to be shared, then said it could not access the assignment or class results.

View Result →
Personalized Practice

The learner returns to the material later

QuestionWell offered neither returning learner new personalized practice. Its assistant also asked for student results again in a new conversation.

View Result →
Quiz Generation

A cleanly scanned document

QuestionWell read the image-only scan of a science chapter faithfully, but one of the 20 questions it wrote has two correct answers. Asked the total current leaving a battery that pushes 0.60 A through two parallel lamps, question 13 keys exactly 0.60 A, while another option, the sum of both branch currents, is equally correct.

View Result →
Quiz Generation

Important information appears in both text and a diagram

QuestionWell wrote 30 questions from the food-web chapter, including items on animals that appear only in its diagram, but some keys disagree with the chapter. The one question on the diagram keys the stickleback as getting food from kingfishers, the reverse of the figure, and a question on energy keys new leaves where the chapter says energy leaves the chain as heat.

View Result →
Quiz Generation

The user turns study material into a quiz

QuestionWell produced multiple-choice quizzes from both chapters, with answer-quality problems in each. One quiz had a defensible unkeyed option and repeated a core idea. The Hindi quiz used Hindi throughout, but keyed equal branch currents despite the chapter’s 0.30 A and 0.18 A examples; another item’s statement did not fit its answer choices.

View Result →

How QuestionWell performed

Open a capability to explore its scenarios. Each row reports the test set in its published Result.

Answer Feedback1 pass1 fail
ScenarioPublished outcomesTest coverageResult
The learner gives a clearly wrong answer
0 Pass1 Fail0 Not gradable
1 of 1 test case failed
What happened

QuestionWell failed to give full help for a clearly wrong learner answer. The feedback pointed at a series-circuit misunderstanding, but it did not explain why the answer was wrong, state the correct idea, or show a model answer; the end screen showed only an overall score.

1/1 assessed1/1 gradablePublished test setView Result →
The learner's answer is partly correct
2 Pass0 Fail0 Not gradable
2 of 2 test cases passed
What happened

QuestionWell handles partly correct open-ended answers as partial rather than fully correct or wrong. It named the correct idea, named the missing idea, and told the learner what to add; it also showed a distinct partial-correct judgment and a 1.5/3 total in the same session.

2/2 assessed2/2 gradablePublished test setView Result →
Class Reports1 pass
ScenarioPublished outcomesTest coverageResult
The teacher checks what the class struggled with
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

QuestionWell showed the class’s shared weakness in electrical measurement without hiding it behind overall scores. Both learners’ ammeter outcome was red while circuit basics were green, making the stronger and weaker areas visible together.

1/1 assessed1/1 gradablePublished test setView Result →
Grading3 pass
ScenarioPublished outcomesTest coverageResult
The learner answers correctly in their own words
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

QuestionWell marked a learner's answer fully correct even though it was worded differently from the quiz's model answer. It returned an unqualified “Correct!”, and nothing on the result screen marked the answer down or flagged the wording.

1/1 assessed1/1 gradablePublished test setView Result →
The learner answers some fixed-answer questions correctly and others incorrectly
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

QuestionWell correctly distinguished right and wrong fixed answers and produced a consistent total. It marked 9 answers correct and 11 incorrect, awarded no partial credit, and scored the attempt 9/20.

1/1 assessed1/1 gradablePublished test setView Result →
The learner's answer is partly correct
2 Pass0 Fail0 Not gradable
2 of 2 test cases passed
What happened

QuestionWell handles partly correct open-ended answers as partial rather than fully correct or wrong. It named the correct idea, named the missing idea, and told the learner what to add; it also showed a distinct partial-correct judgment and a 1.5/3 total in the same session.

2/2 assessed2/2 gradablePublished test setView Result →
Learner Progress1 fail
ScenarioPublished outcomesTest coverageResult
The learner checks whether they are improving
0 Pass1 Fail0 Not gradable
1 of 1 test case failed
What happened

QuestionWell fails this scenario: the learner view shows only whole-quiz scores, not topic-level progress. The same attempts appear broken out by learning outcome on the teacher side, so the missing detail exists but is not shown to learners.

1/1 assessed1/1 gradablePublished test setView Result →
Personalized Practice2 fail
ScenarioPublished outcomesTest coverageResult
One topic is weaker than the others
0 Pass1 Fail0 Not gradable
1 of 1 test case failed
What happened

QuestionWell did not personalize practice from learners' stored performance histories. Its Teaching Assistant first asked for results to be shared, then said it could not access the assignment or class results.

1/1 assessed1/1 gradablePublished test setView Result →
The learner returns to the material later
0 Pass1 Fail0 Not gradable
1 of 1 test case failed
What happened

QuestionWell offered neither returning learner new personalized practice. Its assistant also asked for student results again in a new conversation.

1/1 assessed1/1 gradablePublished test setView Result →
Quiz Generation3 fail2 no Result yet
ScenarioPublished outcomesTest coverageResult
A cleanly scanned document
0 Pass1 Fail0 Not gradable
1 of 1 test case failed
What happened

QuestionWell read the image-only scan of a science chapter faithfully, but one of the 20 questions it wrote has two correct answers. Asked the total current leaving a battery that pushes 0.60 A through two parallel lamps, question 13 keys exactly 0.60 A, while another option, the sum of both branch currents, is equally correct.

1/1 assessed1/1 gradablePublished test setView Result →
Important information appears in both text and a diagram
0 Pass1 Fail0 Not gradable
1 of 1 test case failed
What happened

QuestionWell wrote 30 questions from the food-web chapter, including items on animals that appear only in its diagram, but some keys disagree with the chapter. The one question on the diagram keys the stickleback as getting food from kingfishers, the reverse of the figure, and a question on energy keys new leaves where the chapter says energy leaves the chain as heat.

1/1 assessed1/1 gradablePublished test setView Result →
The user turns study material into a quiz
0 Pass2 Fail0 Not gradable
2 of 2 test cases failed
What happened

QuestionWell produced multiple-choice quizzes from both chapters, with answer-quality problems in each. One quiz had a defensible unkeyed option and repeated a core idea. The Hindi quiz used Hindi throughout, but keyed equal branch currents despite the chapter’s 0.30 A and 0.18 A examples; another item’s statement did not fit its answer choices.

2/2 assessed2/2 gradablePublished test setView Result →
The user asks the quiz to test a particular learning goalNo published result
The user turns a recorded lecture into a quizNo published result
Quiz Delivery2 no Result yet
ScenarioPublished outcomesTest coverageResult
A learner takes a quiz on their ownNo published result
A teacher gives the quiz to a classNo published result

Reading these Results

Published evidence and test coverage answer different questions.

Publication availability

Which scenarios have a Result?

A published Result is public evidence for this tool on one scenario. “No published result” does not say whether testing has taken place.

Test coverage

What does each Result cover?

Assessed includes Pass, Fail and Not gradable. Gradable includes Pass and Fail. Both use the pinned test count in that published Result.

Scenario scope

Out of 15 scenarios

The summary counts each of the 15 scenarios once. A scenario fails when any of its published test cases failed. “No published Result yet” means nothing is public for that scenario; it does not say whether QuestionWell was tested on it.

QuestionWell in Quiz Generation | AI Demos