Produces condensed, paragraph-heavy summaries that read more like transcript condensation than revision notes, with weak topic/subtopic reorganization; the report rates its exam-focused summarization capability at 4/10.
What was measured
Summary Output Quality
How well the tool turns source material into accurate, complete, topic- and subtopic-organized revision notes rather than a plain paragraph summary.
decisive for this rankingtransformation
The main goal is accurate, complete revision notes, not just any summary, so note quality directly determines whether the tool succeeds. (3 of 3 judges)
What was given, what came back
Test input: Summarize study material into exam-ready notes · video · group: exam-ready-notes-summarization
Input — what we sent
Input, verbatim
https://youtu.be/1Y_sfMEmyPY
A prompt asking the tool to transform study material into structured, revision-focused notes suitable for exam preparation, emphasizing clarity, organization, and retention.
Why this input is hard
- · structured summarization
- · bullet-point organization
- · heading and subtopic segmentation
- · revision-focused output
- · conceptual accuracy
- · tabular formatting where applicable
- · active recall support
- · reducing cognitive overload
Also checked on this input — same tool, 4 other criteria
Active Recall Support (Quiz/Flashcards)✗ FailedDoes not generate quizzes or flashcards for revision; the scorecard rates Recall Support at 2/10 (20%).Structural & Tabular Formatting✗ FailedUses timestamps for navigation but does not provide exam-ready structure such as headings, bullet points, tables, or topic hierarchy; the displayed scorecard rates Structure at 3/10 (30%).Study Material Handling◐ MixedAccepts pasted YouTube lecture links and turns them into time-based summary segments with expandable sections, but the platform is restricted to video-only input and the report says it does not support PDFs, images, multi-source inputs, or other file-based academic documents.Workflow & Revision Flexibility◐ MixedSupports timestamp navigation and fast summary generation, but offers no editing, highlighting/bookmarking, customization, or export/download options.
Provenance
- Observation
- 2e7421ac-f7a2-4321-bc3c-5080c863221b
- Evidence run
- 21866df7-cbfc-4e32-8736-9033baf45244
- Study
- Convert Lecture Recordings into Structured Exam Ready Notes
- Research task
- 86b8anp45
- Tested at
- not recorded
- Source
- first-party
- Evidence state
- verified
- Proof shown
- input + output shown
- Cost / latency
- not captured
- Repeat run
- not captured
- Tester
- not captured
The last three rows are honest blanks, not placeholders — our capture has no field for them yet.
Query this
get_evidence({
tool: "summarizetech",
scenario: "exam-ready-notes-summarization"
})MCP · mcp.aidemos.com/api/mcp
Free with attribution.
Same input, same check — 3 other tools
measured on Summary Output Quality
GPAI✓ WorkedTurns chapter content into revision notes organized by major topics and subtopics, using a structured bullet-based format rather than a plain paragraph summary.NoteGPT✓ Worked9/10Smart Summary produces more detailed revision notes than Chapter Summary, with extended explanation depth, bullet organization, tabular representations, FAQ inclusion, and comparative formatting; the report rated it 9/10.YouLearn AI✓ WorkedRestructures source material into revision notes with topic and subtopic segmentation, key-insight extraction, highlighted core points, and coverage described as complete without major omissions.
This evidence is published in
From the same study (page rebuilt from a later run)
Real inputs and real outputs, no retouching · every cell queryable via API & MCP · aidemos.com