Turns chapter content into revision notes organized by major topics and subtopics, using a structured bullet-based format rather than a plain paragraph summary.
What was measured
Summary Output Quality
How well the tool turns source material into accurate, complete, topic- and subtopic-organized revision notes rather than a plain paragraph summary.
decisive for this rankingtransformation
The main goal is accurate, complete revision notes, not just any summary, so note quality directly determines whether the tool succeeds. (3 of 3 judges)
What was given, what came back
Test input: Summarize study material into exam-ready notes · video · group: exam-ready-notes-summarization
Input — what we sent
Input, verbatim
https://youtu.be/1Y_sfMEmyPY
A prompt asking the tool to transform study material into structured, revision-focused notes suitable for exam preparation, emphasizing clarity, organization, and retention.
Why this input is hard
- · structured summarization
- · bullet-point organization
- · heading and subtopic segmentation
- · revision-focused output
- · conceptual accuracy
- · tabular formatting where applicable
- · active recall support
- · reducing cognitive overload
Output — unretouched
Also checked on this input — same tool, 6 other criteria
Structural & Tabular Formatting✓ WorkedUses clear headings, numbered sections, and bullet points to make the notes easy to scan and revise quickly.Structural & Tabular Formatting✗ FailedDoes not recreate tables or other visual structures; the output stays text-only instead of becoming a tabular or diagrammatic study sheet.Study Material Handling✓ WorkedAccepts long-form study inputs from YouTube links, PDFs, images, audio, and multi-source uploads of up to 10 sources in one session, then merges them into a single consolidated summary.Study Material Handling⚠ StruggledWhen study sources are unrelated, the merge can lose separation and slightly blend topics together instead of keeping each source cleanly distinct.Workflow & Revision Flexibility✓ WorkedSupports follow-up chat on generated notes, including concise simplifications that help explain the material in a faster, more accessible way.Workflow & Revision Flexibility✓ WorkedAdds clickable timestamps to note sections so learners can jump back to the exact lecture moment for a topic instead of searching manually.
Provenance
- Observation
- 86bf9d04-d021-4932-85d7-c6fa9f34fdf3
- Evidence run
- 21866df7-cbfc-4e32-8736-9033baf45244
- Study
- Convert Lecture Recordings into Structured Exam Ready Notes
- Research task
- 86b8anp45
- Tested at
- not recorded
- Source
- first-party
- Evidence state
- verified
- Proof shown
- input + output shown
- Cost / latency
- not captured
- Repeat run
- not captured
- Tester
- not captured
The last three rows are honest blanks, not placeholders — our capture has no field for them yet.
Query this
get_evidence({
tool: "gpai",
scenario: "exam-ready-notes-summarization"
})MCP · mcp.aidemos.com/api/mcp
Free with attribution.
Same input, same check — 3 other tools
measured on Summary Output Quality
NoteGPT✓ Worked9/10Smart Summary produces more detailed revision notes than Chapter Summary, with extended explanation depth, bullet organization, tabular representations, FAQ inclusion, and comparative formatting; the report rated it 9/10.Summarize.tech⚠ Struggled4/10Produces condensed, paragraph-heavy summaries that read more like transcript condensation than revision notes, with weak topic/subtopic reorganization; the report rates its exam-focused summarization capability at 4/10.YouLearn AI✓ WorkedRestructures source material into revision notes with topic and subtopic segmentation, key-insight extraction, highlighted core points, and coverage described as complete without major omissions.
This evidence is published in
From the same study (page rebuilt from a later run)
Real inputs and real outputs, no retouching · every cell queryable via API & MCP · aidemos.com