A Good Talk Doesn’t Look Like a Summary, It Teaches You! Measuring Takeaways from Paper-to-Video Talks
Ishani Mondal, Aparna Garimella, Ananya Sai, Pannaga Shivaswamy, Jordan Boyd-Graber · 2026
Read A Good Talk Doesn’t Look Like a Summary, It Teaches You! Measuring Takeaways from Paper-to-Video Talks by Ishani Mondal, Aparna Garimella, Ananya Sai, Pannaga Shivaswamy, Jordan Boyd-Graber (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-28531.txt.
Description
Ishani Mondal, Aparna Garimella, Ananya Sai, Pannaga Shivaswamy, and Jordan Boyd-Graber judge whether automatically generated talk videos actually teach. Software now converts research papers into narrated video presentations, and existing metrics grade visual polish or whether key points appear. A video can hit every point and still leave a viewer unable to explain why the method works.
Their EffectivePresentationScorer grades instructional quality: whether main ideas are explained clearly, needed background is introduced, and technical details connect to the paper's contribution. Applied to current paper-to-video systems, it finds videos that mention the right topics and mirror the paper's structure, yet skip prerequisite concepts and never clarify the reasoning. Those teaching failures, the authors show, are exactly what presence-based metrics cannot see.
Catalog record
| CREATOR | Ishani Mondal, Aparna Garimella, Ananya Sai, Pannaga Shivaswamy, Jordan Boyd-Graber |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 163 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.28531