Scenario definition · S99
The user turns a recorded lecture into a quiz
The user provides a recorded lecture and asks the product to generate a quiz from it.
What this scenario means
This scenario tests whether the product can turn spoken source material into quiz content. A good system uses the lecture itself as the basis for the quiz and carries its subject matter into the generated output.
What we evaluate
- Whether the product generates a quiz from the recorded lecture.
- Whether the quiz is based on the lecture content rather than on a different source.
◌Test-case detail. Exact wording, inputs, fixture state, expected output and detailed grading remain at the test-case level and may be withheld while the benchmark version is active. The scenario and its evaluation intent are public.
Capabilities this scenario exercises
A scenario may exercise one or more capabilities.
Quiz Generation
Creates valid quizzes from supplied material that test the intended knowledge and include sufficient information for answers to be evaluated
Benchmarks that use this scenario
A scenario has global identity and may be reused across benchmarks.
Quiz Generation
Which AI quiz tool turns study material into valid quizzes, and then grades, explains and tracks what the learner actually understood?