A Good Talk Doesn’t Look Like a Summary, It Teaches You! Measuring Takeaways from Paper-to-Video Talks

Ishani Mondal, Aparna Garimella, Ananya Sai, Pannaga Shivaswamy, Jordan Boyd-Graber · 2026

Read A Good Talk Doesn’t Look Like a Summary, It Teaches You! Measuring Takeaways from Paper-to-Video Talks by Ishani Mondal, Aparna Garimella, Ananya Sai, Pannaga Shivaswamy, Jordan Boyd-Graber (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-28531.txt.

Description

Ishani Mondal, Aparna Garimella, Ananya Sai, Pannaga Shivaswamy, and Jordan Boyd-Graber judge whether automatically generated talk videos actually teach. Software now converts research papers into narrated video presentations, and existing metrics grade visual polish or whether key points appear. A video can hit every point and still leave a viewer unable to explain why the method works.

Their EffectivePresentationScorer grades instructional quality: whether main ideas are explained clearly, needed background is introduced, and technical details connect to the paper's contribution. Applied to current paper-to-video systems, it finds videos that mention the right topics and mirror the paper's structure, yet skip prerequisite concepts and never clarify the reasoning. Those teaching failures, the authors show, are exactly what presence-based metrics cannot see.

Catalog record

CREATORIshani Mondal, Aparna Garimella, Ananya Sai, Pannaga Shivaswamy, Jordan Boyd-Graber
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE163 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.28531

Browse the full library · About the Tower of Babel