QuestionWell in Quiz Generation
Scenario-level performance from current published Results.
12 of 16 scenarios published
Where QuestionWell failed
7 of 12 graded scenarios. Open a Result to see the conversation and the evidence.
The learner gives a clearly wrong answer
QuestionWell failed to give full help for a clearly wrong learner answer. The feedback pointed at a series-circuit misunderstanding, but it did not explain why the answer was wrong, state the correct idea, or show a model answer; the end screen showed only an overall score.
View Result →The learner checks whether they are improving
QuestionWell fails this scenario: the learner view shows only whole-quiz scores, not topic-level progress. The same attempts appear broken out by learning outcome on the teacher side, so the missing detail exists but is not shown to learners.
View Result →One topic is weaker than the others
QuestionWell did not personalize practice from learners' stored performance histories. Its Teaching Assistant first asked for results to be shared, then said it could not access the assignment or class results.
View Result →The learner returns to the material later
QuestionWell offered neither returning learner new personalized practice. Its assistant also asked for student results again in a new conversation.
View Result →A cleanly scanned document
QuestionWell read the image-only scan of a science chapter faithfully, but one of the 20 questions it wrote has two correct answers. Asked the total current leaving a battery that pushes 0.60 A through two parallel lamps, question 13 keys exactly 0.60 A, while another option, the sum of both branch currents, is equally correct.
View Result →Important information appears in both text and a diagram
QuestionWell wrote 30 questions from the food-web chapter, including items on animals that appear only in its diagram, but some keys disagree with the chapter. The one question on the diagram keys the stickleback as getting food from kingfishers, the reverse of the figure, and a question on energy keys new leaves where the chapter says energy leaves the chain as heat.
View Result →The user turns study material into a quiz
QuestionWell produced multiple-choice quizzes from both chapters, with answer-quality problems in each. One quiz had a defensible unkeyed option and repeated a core idea. The Hindi quiz used Hindi throughout, but keyed equal branch currents despite the chapter’s 0.30 A and 0.18 A examples; another item’s statement did not fit its answer choices.
View Result →How QuestionWell performed
Open a capability to explore its scenarios. Each row reports the test set in its published Result.
Answer Feedback1 pass1 fail
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| The learner gives a clearly wrong answer | 0 Pass1 Fail0 Not gradable 1 of 1 test case failedWhat happenedQuestionWell failed to give full help for a clearly wrong learner answer. The feedback pointed at a series-circuit misunderstanding, but it did not explain why the answer was wrong, state the correct idea, or show a model answer; the end screen showed only an overall score. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The learner's answer is partly correct | 2 Pass0 Fail0 Not gradable 2 of 2 test cases passedWhat happenedQuestionWell handles partly correct open-ended answers as partial rather than fully correct or wrong. It named the correct idea, named the missing idea, and told the learner what to add; it also showed a distinct partial-correct judgment and a 1.5/3 total in the same session. | 2/2 assessed2/2 gradablePublished test set | View Result → |
Class Reports1 pass
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| The teacher checks what the class struggled with | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedQuestionWell showed the class’s shared weakness in electrical measurement without hiding it behind overall scores. Both learners’ ammeter outcome was red while circuit basics were green, making the stronger and weaker areas visible together. | 1/1 assessed1/1 gradablePublished test set | View Result → |
Grading3 pass
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| The learner answers correctly in their own words | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedQuestionWell marked a learner's answer fully correct even though it was worded differently from the quiz's model answer. It returned an unqualified “Correct!”, and nothing on the result screen marked the answer down or flagged the wording. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The learner answers some fixed-answer questions correctly and others incorrectly | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedQuestionWell correctly distinguished right and wrong fixed answers and produced a consistent total. It marked 9 answers correct and 11 incorrect, awarded no partial credit, and scored the attempt 9/20. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The learner's answer is partly correct | 2 Pass0 Fail0 Not gradable 2 of 2 test cases passedWhat happenedQuestionWell handles partly correct open-ended answers as partial rather than fully correct or wrong. It named the correct idea, named the missing idea, and told the learner what to add; it also showed a distinct partial-correct judgment and a 1.5/3 total in the same session. | 2/2 assessed2/2 gradablePublished test set | View Result → |
Learner Progress1 fail
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| The learner checks whether they are improving | 0 Pass1 Fail0 Not gradable 1 of 1 test case failedWhat happenedQuestionWell fails this scenario: the learner view shows only whole-quiz scores, not topic-level progress. The same attempts appear broken out by learning outcome on the teacher side, so the missing detail exists but is not shown to learners. | 1/1 assessed1/1 gradablePublished test set | View Result → |
Personalized Practice2 fail
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| One topic is weaker than the others | 0 Pass1 Fail0 Not gradable 1 of 1 test case failedWhat happenedQuestionWell did not personalize practice from learners' stored performance histories. Its Teaching Assistant first asked for results to be shared, then said it could not access the assignment or class results. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The learner returns to the material later | 0 Pass1 Fail0 Not gradable 1 of 1 test case failedWhat happenedQuestionWell offered neither returning learner new personalized practice. Its assistant also asked for student results again in a new conversation. | 1/1 assessed1/1 gradablePublished test set | View Result → |
Quiz Generation3 fail2 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| A cleanly scanned document | 0 Pass1 Fail0 Not gradable 1 of 1 test case failedWhat happenedQuestionWell read the image-only scan of a science chapter faithfully, but one of the 20 questions it wrote has two correct answers. Asked the total current leaving a battery that pushes 0.60 A through two parallel lamps, question 13 keys exactly 0.60 A, while another option, the sum of both branch currents, is equally correct. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| Important information appears in both text and a diagram | 0 Pass1 Fail0 Not gradable 1 of 1 test case failedWhat happenedQuestionWell wrote 30 questions from the food-web chapter, including items on animals that appear only in its diagram, but some keys disagree with the chapter. The one question on the diagram keys the stickleback as getting food from kingfishers, the reverse of the figure, and a question on energy keys new leaves where the chapter says energy leaves the chain as heat. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The user turns study material into a quiz | 0 Pass2 Fail0 Not gradable 2 of 2 test cases failedWhat happenedQuestionWell produced multiple-choice quizzes from both chapters, with answer-quality problems in each. One quiz had a defensible unkeyed option and repeated a core idea. The Hindi quiz used Hindi throughout, but keyed equal branch currents despite the chapter’s 0.30 A and 0.18 A examples; another item’s statement did not fit its answer choices. | 2/2 assessed2/2 gradablePublished test set | View Result → |
| The user asks the quiz to test a particular learning goal | No published result | ||
| The user turns a recorded lecture into a quiz | No published result | ||
Quiz Delivery2 no Result yet
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| A learner takes a quiz on their own | No published result | ||
| A teacher gives the quiz to a class | No published result | ||
Reading these Results
Published evidence and test coverage answer different questions.
Which scenarios have a Result?
A published Result is public evidence for this tool on one scenario. “No published result” does not say whether testing has taken place.
What does each Result cover?
Assessed includes Pass, Fail and Not gradable. Gradable includes Pass and Fail. Both use the pinned test count in that published Result.
Out of 15 scenarios
The summary counts each of the 15 scenarios once. A scenario fails when any of its published test cases failed. “No published Result yet” means nothing is public for that scenario; it does not say whether QuestionWell was tested on it.