VideoAgent: Personalized Synthesis of Scientific Videos

Xiao Liang, Bangxin Li, Zixuan Chen, Hanyue Zheng, Zhi Ma, Di Wang, Cong Tian, Quan Wang · 2025

Read VideoAgent: Personalized Synthesis of Scientific Videos by Xiao Liang, Bangxin Li, Zixuan Chen, Hanyue Zheng, Zhi Ma, Di Wang, Cong Tian, Quan Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-11253.txt.

Introduction

Xiao Liang and 7 co-authors present VideoAgent, a system that turns research papers into scientific videos, in this 2025 paper. Technical papers reach few readers in their raw form. Posters and slide decks, the usual automated summaries, follow fixed templates and a straight line, which flattens a paper's logic.

VideoAgent treats video making as a planning problem driven by intent. It separates understanding the paper from producing media, then mixes static slides with animated segments as the narration's density demands. The authors also propose SciVidEval, a benchmark scoring both media quality and teaching value, including studies of what human viewers actually learned. Tests report that the videos carry complex technical reasoning with strong narrative fidelity.

Catalog record

CREATORXiao Liang, Bangxin Li, Zixuan Chen, Hanyue Zheng, Zhi Ma, Di Wang, Cong Tian, Quan Wang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE17 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-11253

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

VideoAgent: Personalized Synthesis of Scientific Videos Xiao Liang, Bangxin Li, Zixuan Chen, Hanyue Zheng, Zhi Ma, Di Wang, Cong Tian, Quan Wang Abstract Automating the generation of scientific videos is a crucial yet challenging task for effective knowledge dissemination. However, existing works on document automation primarily focus on static media such as posters and slides, lacking mechanisms for personalized dynamic orchestration and multimodal content synchronization. To address these challenges, we introduce VideoAgent , a novel multi-agent framework that synthesizes personalized scientific videos through a conversational interface. VideoAgent parses a source paper into a fine-grained asset library and, guided by user requirements, orchestrates a narrative flow that synthesizes both static slides and dynamic animations to explain complex concepts. To enable rigorous evaluation, we also propose SciVidEval , the first comprehensive suite for this task, which combines automated metrics for multimodal content quality and synchronization with a Video-Quiz-based human evaluation to measure knowledge transfer. Extensive experiments demonstrate that our method significantly outperforms existing commercial scientific video generation services and approaches human-level quality in scientific communication. Code and data are available at: https://github.com/ZX-Chan/VideoAgent † † address: School of Computer Science and Technology, Xidian University 1 Introduction The ultimate value of scientific research lies in its effective dissemination and application. Compared to static posters or slides, video offers unique advantages in vividly illustrating dynamic processes and engaging broader audiences, making it an increasingly vital medium for communication [ 1 ] . However, transforming a dense paper—filled with specialized terminology, data charts, and complex logic—into such a compelling video is a demanding task. While recent works on automated poster generation [ 2 , 3 , 4 , 5 ] and slide presentation creation [ 6 , 7 ] have made significant strides in multimodal information extraction and perceptual layout for static pages, synthesizing a compelling video is not a simple extension of these techniques and requires addressing the following core challenges: 1) Personalized and Dynamic Orchestration. This requires moving beyond fixed templates to user-guided synthesis, discerning when to use static slides or dynamic animations to best convey complex ideas. 2) Multimodal Content Synchronization. This requires a mechanism to ensure both temporal and semantic consistency between the generated narration and its corresponding visual stream. To address these challenges, we introduce VideoAgent , a novel multi-stage framework that generates personalized scientific presentation videos through an intuitive conversational interface, as illustrated in Figure 1 . The framework first parses the source paper PDF, decomposing it into a fine-grained library of multimodal assets, including precisely extracted text, figures, tables, and equations. An interactive requirement analyzer then translates user requirements, such as target audience and desired length, into a configuration. Subsequently, a personalized planner orchestrates the presentation flow, generating static slides via python-pptx and, crucially, dynamic animations via python-manim to illustrate complex concepts vividly. Finally, the multimodal synthesizer integrates all visual and audio assets to produce a comprehensive video, complete with synchronized narration and subtitles. We evaluate the framework using SciVidEval , a comprehensive methodology we introduce that combines automated metrics with human assessment. Its automated component assesses videos across three core dimensions: narration quality, visual quality, and audio-visual synchronization. To directly measure knowledge transfer, this analysis is complemented by a Video-Quiz-based human evaluation. For this, we task graduate students with answering automatically generated multiple-choice questions on core concepts based solely on watching the video. Their resulting accuracy serves as a direct measure of the video’s efficacy in conveying key scientific insights. Our main contributions are threefold: • We propose VideoAgent , a novel framework for scientific video synthesis that orchestrates the composition of both static slides and dynamic animations from a source paper. • We introduce SciVidEval , a benchmark combining automated metrics for multimodal quality and synchronization with a video-quiz assessing knowledge transfer. • Extensive experiments demonstrate the proposed method outperforms commercial services and baselines, approaching human-level quality in scientific communication. Figure 1: The VideoAgent framework transforms a scientific paper into a personalized video via four main stages: Document Parser, Requirement Analyzer, Personalized Planner, and Multimodal Synthesizer. 2 VideoAgent 2.1 Document Parser To compress a PDF paper into a fine-grained, structured asset library, we first utilize Docling [ 8 ] to parse the textual and visual content (e.g., figures, tables) separately. We employ Marker [ 9 ] to convert the extracted content into a Markdown . This structured text is then fed to a summarization agent, which performs semantic compression to generate chapter summaries. For visual assets such as equations and figures, we generate corresponding textual descriptions based on their surrounding context. These assets and their descriptions are stored in a JSON file, which preserves global semantics while reducing token cost for downstream processing. 2.2 Requirement Analyzer To accommodate different audiences and communication goals, we introduce a dialogue-guided requirement analysis module. This component categorizes user inputs into two distinct types: 1) Functional Requirements , which include qualitative choices like enabling animations, adding narration, or providing detailed explanations for specific figures; and 2) Technical Specifications , which cover quantitative parameters such as video duration, resolution, and presentation style (e.g., “font or color scheme”). These diverse user requirements are translated into a structured JSON configuration file, which is then passed to the Planner agent to guide the subsequent generation process. This approach enables highly personalized and targeted video synthesis that aligns with the user’s specific communication objectives. Figure 2: The SciVidEval process involves 1. Video Content Extraction to obtain keyframes and narration scripts, and 2. Content Quality Evaluation , which assesses video content against the paper on narration, visual, and synchronization quality. 2.3 Personalized Planner The Personalized Planner serves as the core orchestrator, iterating through the chapter summaries from the Document Parser to generate a detailed storyboard for the final video. The process involves the following steps: • Content Selection. For each chapter, the planner selects relevant figures and tables from the asset library, deciding whether to include them based on user requirements. • Storyboard Generation. Based on the word count of the chapter summary and the size and number of associated visuals, the planner determines the number of slides required for that chapter. The final output is a comprehensive storyboard in JSON format, which defines the sequence of all slides and animations. • Static Slide Synthesis. By default, the planner generates python-pptx code to define the layout for static slides. This includes setting the page title, formatting text boxes, and positioning figures based on their aspect ratio to ensure visual balance. • Dynamic Animation Synthesis. First, the planner distills a source figure and its context into a highly-detailed JSON plan that specifies scene-by-scene actions, timings, and narration. This plan is then consumed by a specialist code generation agent, which translates the plan’s abstract directives into executable python-manim code using a library of advanced animation templates. After iterating through all chapters, the generated code is executed to produce a .pptx file and the corresponding .mp4 animation clips. The storyboard file explicitly includes placeholders to indicate the insertion points for these animations. 2.4 Multimodal Synthesizer In the final stage, the generated .pptx file is converted into a sequence of high-resolution images. A Text-to-Speech [ 10 ] agent is then invoked to generate narration audio and synchronized subtitles for each chapter, including

Read the complete text