The user turns study material into a quiz
Study material is turned into a quiz.
What this scenario means
This scenario tests whether the system can take supplied study material and turn it into questions grounded in that material. A good system selects the core ideas, keeps the questions answerable from the source, and includes answer or evaluation information that matches the material. It should not invent unsupported content, lose important ideas, or make the quiz impossible to judge fairly.
What we evaluate
- Whether the quiz is grounded in the supplied study material rather than outside knowledge.
- Whether the questions are answerable from the material and focus on the core ideas, not just supporting detail.
- Whether the answer or evaluation information matches the source material.
- Whether the quiz includes enough information for responses to be judged against the material.
Capabilities this scenario exercises
A scenario may exercise one or more capabilities.
Quiz Generation
Creates valid quizzes from supplied material that test the intended knowledge and include sufficient information for answers to be evaluated
Benchmarks that use this scenario
A scenario has global identity and may be reused across benchmarks.
Quiz Generation
Which AI quiz tool turns study material into valid quizzes, and then grades, explains and tracks what the learner actually understood?