Talk to Your Slides: Language-Driven Agents for Efficient Slide Editing

Kyudan Jung, Hojun Cho, Jooyeol Yun, Soyoung Yang, Jaehyeok Jang, Jaegul Choo · 2025

Read Talk to Your Slides: Language-Driven Agents for Efficient Slide Editing by Kyudan Jung, Hojun Cho, Jooyeol Yun, Soyoung Yang, Jaehyeok Jang, Jaegul Choo (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-11604.txt.

Introduction

Editing slides by hand is slow, and AI agents that click through screens waste effort on what is really structured data. Kyudan Jung and co-authors built a slide editor that works by language in this 2025 paper. Their agent reads and writes the slide file's object model directly. That route edits text exactly and keeps the design intact.

Screen-based agents pay high computing costs and lag on batch jobs. The new system stacks layers that turn a plain instruction into low-level code steps. It handles layout changes and mass text updates in the same frame. Tests compare its speed and accuracy with visual agents. Direct data editing could make deck upkeep — a daily chore in offices and schools — nearly instant.

Catalog record

CREATORKyudan Jung, Hojun Cho, Jooyeol Yun, Soyoung Yang, Jaehyeok Jang, Jaegul Choo
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-11604

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Talk to Your Slides: Language-Driven Agents for Efficient Slide Editing Kyudan Jung, Hojun Cho, Jooyeol Yun, Soyoung Yang, Jaehyeok Jang, Jaegul Choo Abstract Editing presentation slides remains one of the most common and time-consuming tasks faced by millions of users daily, despite significant advances in automated slide generation. Existing approaches have successfully demonstrated slide editing via graphic user interface (GUI)-based agents, offering intuitive visual control. However, such methods often suffer from high computational cost and latency. In this paper, we propose Talk-to-Your-Slides , an LLM-powered agent designed to edit slides by leveraging structured information about slide objects rather than relying on image modality. The key insight of our work is designing the editing process with distinct high-level and low-level layers to facilitate interaction between user commands and slide objects. By providing direct access to application objects rather than screen pixels, our system enables 34.02% faster processing, 34.76% better instruction fidelity, and 87.42% cheaper operation than baselines. To evaluate slide editing capabilities, we introduce TSBench , a human-annotated dataset comprising 379 diverse editing instructions paired with corresponding slide variations in four categories. Our code, benchmark and demos are available at anonymous.4open.science/r/talk-to-your-slides . Figure 1: Comparison of slide editing methods on translating 50-page lecture slides from Korean to English. (a) Manual translation requires day(s) and consumes graduate-student labor. (b) A GUI-based agent reduces human effort but incurs high cost and occupies the host machine during execution. However, (c) our approach runs in the background at a low cost and in a relatively short time. 1 Introduction Figure 2: Overview of the Talk-to-Your-Slides framework. The system consists of four modules: instruction understanding, document understanding, document editing, and code generator. Recent advancements in large language models (LLMs) have revolutionized how we interact with software applications through natural language instructions, demonstrating remarkable success in tasks such as code generation, GUI navigation, and slide generation ( Yang et al. 2024 ; Hou et al. 2024 ; Zhang et al. 2024a ; Xu et al. 2025 ) . While these models have enabled significant progress in automated slide creation, a critical yet underexplored challenge remains in editing existing presentation slides. Presentation slides serve as a fundamental medium for communication across education, business, and research. However, modifying them to reflect updated content, adjust the layout, or enhance clarity often demands tedious, time-consuming manual effort. For example, as shown in Figure 1 , a professor prepares an international lecture that contains 50 slides across 10 different sessions and has to be translated from Korean to English while preserving technical terminology and formatting. Similarly, a marketing team needs to update product pricing on 120 slides spanning several presentations before a major launch. Several candidate approaches can be a solution to address these challenges. One straightforward approach is converting natural language instructions into direct scripting code that can be applied to PowerPoint presentations. But this baseline struggles with complex tasks requiring sequential operations. For instance, instructions like “Summarize the text on all slides and highlight key points in red” demand understanding both of user intent and contextual interpretation of slide content. Another approach leverages vision-based GUI agents that operate on screen-captured images (Figure 1 b) through repeated mouse click and keyboard interactions. However, due to the high computational cost of processing image inputs with vision-language models (VLMs), and the latency between interactions, this method tends to be resource-intensive and expensive to deploy. This limitation extends beyond presentation software such as PowerPoint to any application where vision-only interfaces become bottlenecks, such as Windows or iOS navigation agents. To alleviate these limitations, we propose Talk-to-Your-Slides , an LLM-powered agent designed to edit presentation slides by directly handling objects through text-based low-level structured information. This approach enables more accurate and cost-effective editing operations compared to multi-modal agents. We design the editing process with distinct high-level and low-level layers to facilitate interaction between high-level user commands and low-level objects within slides. This insight draws from previous research on planning and reasoning processes ( Guo et al. 2024b ; Chen et al. 2024a ; Chen et al. 2024b ; Zhao et al. 2023 ; Caldiran et al. 2009 ) . At the high-level, an LLM agent interprets user instructions and formulates structured editing plans. At the low-level, our system directly accesses slide components and executes precise edits through generated code. By providing direct access to application objects, we enable 34.02% faster processing, 34.76% better instruction fidelity, and 87.42% cheaper operation than GUI-based methods. Furthermore, to complement existing benchmarks that primarily focus on the visual aesthetics of slide generation ( Ge et al. 2025 ; Zheng et al. 2025 ; Guo et al. 2023 ; Zhang et al. 2024b ) , we present TSBench , a human-annotated dataset specifically designed to evaluate slide editing capabilities. TSBench consists of 379 diverse editing instructions, each paired with corresponding slides created using official Microsoft slide templates. Our benchmark enables systematic assessment of models’ proficiency in applying fine-grained modifications to existing presentation content. We categorize the editing commands into four distinct types: text editing, visual formatting, layout adjustment, and slide structure manipulation. These categories cover practical tasks such as modifying existing text, adjusting visual elements, aligning components, and managing slide transitions, respectively. Our contributions are summarized as follows: • We introduce a system Talk-to-Your-Slides , an LLM agent-based system specifically designed for slide editing tasks that approaches editing through a division of high-level and low-level operations. • We construct TSBench , a human-annotated benchmark dataset that enables systematic evaluation of slide editing agents in terms of their ability to accurately follow complex user instructions. • Through comprehensive experiments, we demonstrate that Talk-to-Your-Slides substantially outperforms baseline methods across execution success rate, instruction fidelity, and editing efficiency, reducing execution time by up to 87%. 2 Related Work This section covers related research on slide generation, GUI-based agents, and code generation with LLMs. 2.1 Slide Generation Prior work has primarily focused on generating presentation slides from natural language descriptions ( Sefid et al. 2021 ) . AutoPresent ( Ge et al. 2025 ) fine-tuned an LLaMA-based model on the SlidesBench training set, a dataset comprising 7,000 slide-generation examples, to generate Python code that invokes the SlidesLib API. However, this approach remains prone to execution errors and does not support fine-grained slide editing. PPTAgent ( Zheng et al. 2025 ) presents a simple process that mimics how people author slides. It first creates an outline and then edits slides using a fixed template. It also includes PPTEval, a tool to check slide content, design, and structure. PPTAgent works well for generating new slides. Our research extends these approaches by introducing precise editing capabilities that significantly reduce the manual effort required from users. 2.2 LLM Agents for GUI Control Our work is also related to research on LLM-based agents that control graphical user interfaces (GUIs) ( Gao et al. 2024 ; Koh et al. 2024 ) . UFO and UFO2 by Microsoft ( Zhang et al. 2024a ) introduces a dual-agent framework composed of an application-selection agent and an action agent that can operate across Windows applications such as Word and PowerPoint. By observing application screenshots, the agent executes actions like menu clicks and text input. While powerful, UFO relies on image-based state representations and pixel-level

Read the complete text