UniPPTBench: A Unified Benchmark for Presentation Generation Across Diverse Input Settings

Bo Zhao, Maosheng Pang, Chen Zhang, Huan Yang, Yixin Cao, Wei Ji · 2026

Read UniPPTBench: A Unified Benchmark for Presentation Generation Across Diverse Input Settings by Bo Zhao, Maosheng Pang, Chen Zhang, Huan Yang, Yixin Cao, Wei Ji (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-17356.txt.

Introduction

Zhao and colleagues present UniPPTBench, a shared benchmark for slide-deck generation across four input types: vague prompts, long texts, mixed-media texts and multi-source material. A companion test plan mixes shared scores with type-specific ones for grounded condensing, visual-text alignment and cross-source synthesis. Tests reveal wide gaps across types and repeat failures in grounding and synthesis. Glossy generic scores, they warn, often mask weak task fulfillment.

Catalog record

CREATORBo Zhao, Maosheng Pang, Chen Zhang, Huan Yang, Yixin Cao, Wei Ji
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE77956
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.17356

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

UniPPTBench: A Unified Benchmark for Presentation Generation Across Diverse Input Settings Bo Zhao, Maosheng Pang, Chen Zhang, Huan Yang, Yixin Cao, Wei Ji Abstract Recent advances in multimodal generative models have made automatic presentation generation increasingly feasible. However, existing research and systems remain limited in both scenario coverage and evaluation specificity. Prior work typically studies presentation generation under isolated input settings, whereas real-world use cases span diverse scenarios, including vague user prompts, long documents, multimodal materials, and multiple heterogeneous sources. Moreover, current evaluations are often insufficiently scenario-specific. They mainly rely on generic presentation-quality criteria, such as visual appeal, layout quality, and overall coherence, but fail to assess the core capabilities required by different input settings, including grounded compression, visual-text alignment, and cross-source synthesis. Consequently, the field lacks a unified benchmark and a scenario-aware evaluation framework for faithfully diagnosing presentation-generation systems across diverse real-world settings. We present UniPPTBench, a unified benchmark for presentation generation across four representative input settings: vague-prompt, long-document, multimodal-document, and multi-source generation. We further introduce UniPPTEval, a scenario-aware evaluation protocol that combines shared metrics for cross-setting comparison with scenario-specific metrics tailored to each setting’s core requirements. We also provide transparent reference baselines to support reproducible comparison. Experiments on UniPPTBench reveal substantial performance variation across settings and recurring failure modes in content grounding, multimodal integration, and cross-source synthesis. In particular, strong performance on generic presentation-quality metrics does not necessarily imply strong task fulfillment in grounded scenarios. Together, UniPPTBench and UniPPTEval provide a faithful and diagnostic foundation for evaluating presentation generation across diverse real-world scenarios. Code and data will be publicly available. Fig. 1: Motivation and overview of our framework. (a) Prior work usually studies presentation generation in isolated settings, such as prompt-only or PDF-to-slides generation, with largely similar generic metrics. (b) Real-world PPT generation involves more diverse inputs and evaluation needs, including vague prompts, long documents, multimodal files, and multi-source materials. (c) We therefore propose UniPPTBench for unified benchmarking across input settings, and UniPPTEval for combining shared and scenario-specific evaluation. I Introduction Recent advances in multimodal generative models [ 31 , 39 ] have made automatic presentation generation increasingly feasible. Given a high-level request or a collection of source materials, modern systems can now produce slide decks with structured content, visual elements, and coherent layouts. This capability has broad potential in education, business communication, research reporting, and content creation. Unlike conventional text generation, however, presentation generation is a visually grounded communication task: a system must generate fluent textual content, organize information into spatially structured slides, align claims with visual evidence, and maintain a coherent narrative across pages. A key challenge in real-world presentation generation is the diversity of input scenarios. Users may start from vague intent, long textual documents, multimodal materials, or multiple heterogeneous sources. Although these scenarios share the same output format—a complete slide deck—they impose different core requirements, ranging from open-ended planning and faithful compression to visual grounding and cross-source synthesis. Despite rapid progress, existing research has not yet provided a unified way to study these input regimes. Recent academic works have explored multimodal large language models and agent-based frameworks [ 38 , 33 , 35 ] for presentation generation from user instructions or source documents. However, most open-source systems are designed for a single input setting, such as instruction-only or document-conditioned generation [ 8 , 6 , 41 , 37 , 20 ] . As a result, it remains unclear whether a method that performs well in one setting can generalize to others, especially when the demand shifts from open-ended planning to grounded compression, multimodal evidence alignment, or multi-source synthesis. Meanwhile, commercial systems have started to support end-to-end slide generation from prompts or external materials [ 28 , 10 , 18 , 11 , 24 ] , but their internal workflows, training data, and evaluation procedures are usually not publicly disclosed, limiting transparent comparison and systematic diagnosis. This lack of unified task coverage also makes evaluation more difficult. Existing assessments often focus on generic presentation-quality dimensions, such as visual appeal, layout quality, readability, and content coherence [ 8 , 41 , 3 ] . While necessary, these dimensions are insufficient for judging whether a system fulfills the task imposed by a specific input scenario. A deck may look polished and well organized while omitting key evidence from a source document, misrepresenting a chart, or failing to reconcile duplicated or conflicting information across sources. In other words, visual quality and task fulfillment are related but not equivalent. Without scenario-aware evaluation, current benchmarks may overestimate presentation-generation ability by rewarding outputs that resemble good slides but are weakly grounded in the input [ 27 , 26 ] . These limitations call for a controlled evaluation infrastructure that can diagnose both general deck quality and the input-conditioned capabilities required by different presentation-generation scenarios. To address these challenges, we introduce UniPPTBench, a unified benchmark for presentation generation across four representative input settings: vague-prompt, long-document, multimodal-document, and multi-source generation. These settings are organized along a progression of grounding complexity. Vague-prompt generation evaluates open-ended planning under underspecified user intent. Long-document generation tests source-faithful compression and content selection. Multimodal-document generation emphasizes alignment between textual claims and visual materials such as figures, charts, and tables. Multi-source generation further requires evidence integration, redundancy removal, and faithful synthesis across heterogeneous sources. By covering these settings under a common task formulation, UniPPTBench enables systematic comparison across real-world workflows. Building on UniPPTBench, we propose UniPPTEval, a scenario-aware evaluation protocol that explicitly separates general presentation quality from input-conditioned task fulfillment. UniPPTEval combines shared metrics for deck-level quality, including structure, coherence, readability, and visual organization, with scenario-specific metrics targeting the core capability required by each setting. For example, long-document generation is evaluated for source coverage and faithful compression; multimodal-document generation for visual-text grounding and evidence alignment; and multi-source generation for cross-source integration, deduplication, and synthesis. This design reveals failure modes hidden by generic presentation-quality metrics alone. Moreover, a unified agent-based baseline for presentation generation is developed. Our UniPPTAgent is among the first open-source baselines designed to support multiple presentation-generation input settings within a unified framework. Unlike prior open-source systems tailored to one input regime [ 8 , 6 , 41 , 37 , 20 ] , our baseline uses a shared generation interface while adapting its planning, grounding, and slide-composition modules to different input types, which achieves state-of-the-art performance among open-source methods, providing a strong and reproducible reference point for future research rather than a minimal pipeline. Experiments on UniPPTBench reveal several important findings. First, system performance varies substantially across input settings, confirming that single-scenario evaluation gives an incomplete estimate of presentation-generation capability. Second, generic presentation-quality metrics do not reliably reflect grounded task fulfillment: many systems generate visually plausible and coherent decks while failing to preserve key source content, align claims with visual evidence, or synthesize relations across documents. Third, multimodal-document and multi-source settings remain especially challenging, exposing limitations in evidence grounding, information integration, deduplication, and faithful synthesis. These findings suggest that presentation generation should be evaluated not only by whether the output looks like a high-quality deck, but also by whether it satisfies the scenario-specific requirements imposed by its input. Our contributions are summarized as follows: 1. We introduce UniPPTBench, a unified benchmark for presentation generation covering four representative real-world

Read the complete text