AI Demos Research — the structured-intelligence platform. Every verdict on these pages opens to the execution behind it.
Graded 28 October 2026

Can Studyglen show a learner whether they are improving?

Studyglen did not show progress by topic. Its Progress view was empty while an earlier quiz attempt was already recorded, and the Library and attempt reviews give only whole-quiz scores and per-question marks, so nothing shows which topic improved and which, like the still-wrong ammeter question, needs work.

1 of 1 test case failed

Every test case in this scenario has a result.

Pass rate0%0 of 1 gradable
Coverage1 of 1test case with a result
0PassNo test case passed.
1FailMissed at least one thing it was expected to do; the reason and proof are with each test case below.
0Not gradableEvery result here could be graded.
0UntestedEvery test case in this scenario has a result.
The pass rate is a summary. The evidence is the test case below: what we sent, what we checked, what the tool returned, and the proof.

The test case

Each test case is judged on its own: Pass, Fail, Not gradable, or Untested. The scenario result above is based on this test case.

Progress agrees with the attempts behind itFailEvidence
What we sent

Nothing was sent: we opened Studyglen's Progress view, Library and attempt review screens for an account that already held earlier quiz attempts.

What the tool returned

The tool's response has no text to quote: it is what the evidence under Proofs shows.

Proof 2 · Screen recording · ▶ 0:09–0:13

Proof 1 · Screenshot

Expected vs. Found
✗Expected: Progress agrees with the attempts, shows the improved topic more positively, still shows the weak topic as needing work, and claims no full mastery.Found: Progress read 'Make your first quiz or deck' while an attempt existed; other screens give only whole-quiz scores and per-question marks, with no topic view. Nothing claimed full mastery.
Supporting proof
Proof 1Screenshot
Screenshot: the empty Progress screen while an earlier attempt was already recorded
Open original ↗
Proof 2Screen recording
Screen recording: Progress, the earlier attempt's review, the retake and the Library after
Key moments
Open original ↗
Proof 3Screenshot
Screenshot: Library before the retake, with 2 attempts and a 38% average
Open original ↗
Proof 4Screenshot
Screenshot: Library after the retake, 3 attempts, 52% average, last score 80%
Open original ↗
Proof 5Screenshot
Screenshot: the retake's 80% result, with the ammeter question still wrong
Open original ↗
Proof 6Screenshot
Screenshot: the retake's attempt review, with per-question marks only
Open original ↗
Why this result

The progress view had to agree with the attempts and show by topic what improved and what still needs work. It was empty, and no screen shows results by topic. Studyglen documents Progress as a flashcard view and this account had no deck, though its empty text names quizzes.

Also observed in this test case

Library scores match attempts. The Library's own figures match the attempts: two attempts and a 38% average before the retake; three attempts, a 52% average and a last score of 80% after it.

Tested by Anshika Gupta · evidence dated 28 October 2026

Configuration and setup

How this tool was set up for the run and what the test needed in place. Each row is a fact from the run's records; a fact the records do not hold is left out, not guessed.

Software that produced the output
Studyglen
Build or version
Not exposed by the hosted product
Surface
Web app
Set up before the run
A learner history on one circuits quiz, an earlier 50% attempt and a later 80% one with the ammeter question wrong in both, had to exist; Studyglen's own progress view, Library and attempt reviews were then opened.
Tested
28 October 2026 · Anshika Gupta

How this scenario is graded

How we decide Pass, Fail and Not gradable. The same rules apply to every tool tested on this scenario.

How results are decided

Each test case gets one result per tool: Pass, Fail or Not gradable. A test case we haven't run yet shows Untested. There are no partial results.

The rules
  • Pass: the tool did everything the test expected, and nothing it said contradicts the correct answer.
  • Fail: at least one expected behaviour clearly didn't happen; the test case's result says which one and quotes the tool.
  • Not gradable: our evidence couldn't settle the outcome (for example a record we needed is missing). It is never counted as a fail, and the test case's result says what's missing.

Where this sits in the benchmark

This page is one cell of a larger study: one tool, one scenario. Only this benchmark's frame appears here.

LevelNameScope
BenchmarkQuiz Generation →15 scenarios · 10 tools
CapabilityLearner Progress →
ScenarioThe learner checks whether they are improving →
ToolStudyglen →

History of this result

What has happened to this result since it was first published. Runs and grades are never overwritten: a retest or a re-grade publishes a new result and keeps the earlier one readable.

from the publication record
16 November 2026First publishedQuiz Generation v1

Act on this result

Nothing filed here edits the run or the grade. A challenge opens a review, and a review can produce a new run or a re-grade — which becomes the current result and leaves this one in the history.

This matches what I see

You run the same kind of test against your own setup and get the same behaviour.

Agree →
This does not match

Yours behaves differently. Tell us what you got, with a screenshot if you have one.

Disagree →
Point out an issue

Something here is wrong — a reference value, a transcription, a grade.

Report an issue →
Request a retest

On a newer build, a larger dataset, or your own setup.

Request a retest →
We have fixed this

Tell us what changed and we schedule a rerun of the failing test case. The old result stays as history.

Vendor notice →
Filed against this evidenceNothing yet. Challenges, counter-evidence and fix notices appear here with their outcome, and stay on the page after they are resolved.
Cite this result
aidemos.com/benchmarks/quiz-generation/results/studyglen/the-learner-checks-whether-they-are-improving · 0 pass · 1 fail · coverage 1/1 · graded 2026-10-28

The same record is available as structured data through the AI Demos MCP server, with the counts, the coverage and every per-test-case reason carried as fields.

Verify the proof files

These files support this result. Open a file to inspect the original evidence.

Proof 1 · Screenshot ↗image/png · 107 KB
Proof 3 · Screenshot ↗image/png · 293 KB
Proof 4 · Screenshot ↗image/png · 333 KB
Proof 5 · Screenshot ↗image/png · 270 KB
Proof 6 · Screenshot ↗image/png · 246 KB
File fingerprints (SHA-256)

A fingerprint identifies the exact file used for this result.

Proof 1 · Screenshot82a6d19de5c0021883ac129b9cd286c1804faf86baf875a263aab0112b69adc7
Proof 2 · Screen recordingf0a0cfff219c275c9b93f65b41944ca1d3212f6fa66100f6017f75abee4cf81d
Proof 3 · Screenshotd38735f1ddb1a346725cc894bb0274ea382d81925857890d2be0d59fe1ded1fe
Proof 4 · Screenshot3494876da6038182e75160cf38b2f3b81eab267bf3a8e3d5ab357727bca349a1
Proof 5 · Screenshoteb7f851bd2b3f8e3205f41e7a69ba5962b322388714e637e29a91b15aa2b9517
Proof 6 · Screenshota99bf9ea62e142648d83499a8ebc3651eb93dcebe5dc7049e0ac3eeb926a8fd5