Scenario definition · S106

One topic is weaker than the others

Two otherwise equivalent learner histories differ only in which topic is weaker.

What this scenario means

This scenario tests whether personalised practice uses prior performance history to adapt the next practice focus. A good system does not treat both histories the same. It directs practice toward the weaker topic in each case, so the learner gets work matched to demonstrated strengths and weaknesses.

What we evaluate

  • Whether the practice focus changes when the performance history changes.
  • Whether each learner is directed toward the topic they were weaker on.
  • Whether the system avoids giving both histories the same fixed focus despite opposite strengths and weaknesses.
◌Test-case detail. Exact wording, inputs, fixture state, expected output and detailed grading remain at the test-case level and may be withheld while the benchmark version is active. The scenario and its evaluation intent are public.

Capabilities this scenario exercises

A scenario may exercise one or more capabilities.

Capability

Personalized Practice

Changes subsequent practice according to the learner's demonstrated strengths and weaknesses, including across sessions

Benchmarks that use this scenario

A scenario has global identity and may be reused across benchmarks.

One topic is weaker than the others — Scenario definition | AI Demos