TextAtlas5M: A Large-scale Dataset for Dense Text Image Generation

Alex Jinpeng Wang, Dongxing Mao, Jiawei Zhang, Weiming Han, Zhuobai Dong, Linjie Li, Yiqi Lin, Zhengyuan Yang, Libo Qin, Fuwei Zhang, Lijuan Wang, Min Li · 2025

Read TextAtlas5M: A Large-scale Dataset for Dense Text Image Generation by Alex Jinpeng Wang, Dongxing Mao, Jiawei Zhang, Weiming Han, Zhuobai Dong, Linjie Li, Yiqi Lin, Zhengyuan Yang, Libo Qin, Fuwei Zhang, Lijuan Wang, Min Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-07870.txt.

Introduction

Alex Jinpeng Wang and co-authors release a data set for images packed with text in a 2025 paper. AI image makers now take long prompts, but rendering long text inside an image stays hard. Posters, charts, and signs all need clean, dense text. Past data sets held mostly short, simple strings, which left models untested on real layouts.

Their set, TextAtlas5M, holds five million images with long text, made and gathered across many types. A test set of 3,000 images was polished by hand across three domains. Even top closed models, such as GPT-4o with DALL·E-3, stumbled on those tests. Open models lagged further behind. The authors offer the set for training and grading the next round of models.

Catalog record

CREATORAlex Jinpeng Wang, Dongxing Mao, Jiawei Zhang, Weiming Han, Zhuobai Dong, Linjie Li, Yiqi Lin, Zhengyuan Yang, Libo Qin, Fuwei Zhang, Lijuan Wang, Min Li
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE66 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-07870

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

TextAtlas5M: A Large-scale Dataset for Dense Text Image Generation Alex Jinpeng Wang, Dongxing Mao, Jiawei Zhang, Weiming Han, Zhuobai Dong, Linjie Li, Yiqi Lin, Zhengyuan Yang, Libo Qin, Fuwei Zhang, Lijuan Wang, Min Li Abstract Text-conditioned image generation has gained significant attention in recent years and are processing increasingly longer and comprehensive text prompt. In everyday life, dense and intricate text appears in contexts like advertisements, infographics, and signage, where the integration of both text and visuals is essential for conveying complex information. However, despite these advances, the generation of images containing long-form text remains a persistent challenge, largely due to the limitations of existing datasets, which often focus on shorter and simpler text. To address this gap, we introduce TextAtlas5M, a novel dataset specifically designed to evaluate long-text rendering in text-conditioned image generation. Our dataset consists of 5 million long-text generated and collected images across diverse data types, enabling comprehensive evaluation of large-scale generative models on long-text image generation. We further curate 3000 human-improved test set TextAtlasEval across 3 data domains, establishing one of the most extensive benchmarks for text-conditioned generation. Evaluations suggest that the TextAtlasEval benchmarks present significant challenges even for the most advanced proprietary models (e.g. GPT4o with DallE-3), while their open-source counterparts show an even larger performance gap. These evidences position TextAtlas5M as a valuable dataset for training and evaluating future-generation text-conditioned image generation models. Datasets are released. https://textatlas5m.github.io 1 Introduction Text-conditioned image generation is processing inputs of longer texts, with a growth in processing inputs of longer contexts from 77 text tokens in Dall-E ( Ramesh et al. 2021a ) to 300 text tokens in PixArt- \alpha ( Chen et al. 2023c ) , and recently achieving 2,000-token capacity in autoregressive architectures ( Team 2024 ) . In this regard, the task of generating comprehensive and controllable images with longer text input, such as image with complex layout or dense text, is considered a promising testbed. Figure 1 : A comparison of TextAtlas5M with previous text-rich image datasets ( Schuhmann et al. 2022 ; Tuo et al. 2023 ; Chen et al. 2024b ) . Unlike prior datasets with short or unstructured alt-text, TextAtlas5M features more diverse, complex long-form text. Text plays a central role in image generation, serving as one of the most pervasive elements in visual communication through news, books, advertisements, and more. For instance, over 50% of images in large-scale image generation datasets like LAION-2B ( Schuhmann et al. 2022 ) contain text detectable by OCR models ( Lin et al. 2025 ) . However, despite the increasing prevalence of dense text in real-world scenarios, state-of-the-art models such as SD-XL3 ( Esser et al. 2024 ) , DallE-3 ( Betker et al. 2023 ) and Chameleon ( Team 2024 ) struggle with tasks requiring the generation of dense text (see Appendix for examples). Table 1 : Dataset Comparison with Existing Text-Rich Image Generation Datasets . The last two columns detail the sources of automatically generated labels, while the final column presents the average text token length derived from OCR applied to the images. Dataset Name Samples Annotations Domain Labels Token Length TextCaps ( Sidorov et al. 2020 ) 28K Caption Real Image Human 26.36 SynthText ( Gupta et al. 2016 ) 0.8M OCR Synthetic Image Auto 13.75 Marion10M ( Chen et al. 2024b ) 10M Caption+OCR Real Image Auto 16.13 AnyWords3M ( Tuo et al. 2023 ) 3M Caption+OCR Real Image Auto 9.92 RenderedText ( Wendler ) 12M Text Synthetic Image Auto 21.21 TextAtlas5M 5M Caption/OCR Real&Synthetic Image Auto/Human 148.82 This limitation stems from the reliance on existing text-rich image datasets like Marion10M and AnyWords3M ( Tuo et al. 2023 ; Chen et al. 2023a ) , which focus on short and simple text, failing to meet the demand for handling longer and more intricate inputs. Such limitations are particularly evident in practical scenarios—ranging from advertising layouts that require seamless brand messaging integration to infographics that demand precise synchronization of text and visuals, as shown by the Notice Board in Figure 1 . To address these challenges, we introduce TextAtlas5M, a comprehensive dataset designed to advance and evaluate text-to-image generation models, with a particular focus on generating dense-text images. As illustrated in Figure 1 and Table 1 , TextAtlas5M stands out in several key ways compared to previous text-rich datasets. Unlike earlier datasets, which primarily focus on short and simple text, TextAtlas5M includes a diverse and complex range of data. It spans from interleaved documents and synthetic data to real-world images containing dense text, offering a more varied and challenging set of examples. Moreover, our dataset features longer text captions, which pose additional challenges for models, and includes human annotations for particularly difficult examples, ensuring a more thorough evaluation of model capabilities. The synthetic subset progresses through three levels of complexity, starting with simple text on clean backgrounds. It then advances to interleaved data, blending text with visual elements, and culminates in synthetic natural images, where realistic scenes integrate seamlessly with text. The real image subset captures diverse, real-world dense-text scenarios. It includes filtered samples from datasets like AnyText ( Tuo et al. 2023 ) and TextDiffuser ( Chen et al. 2024b ) , detailed descriptions from PowerPoint slides, book covers, and academic PDF papers. To enrich diversity, we also gather dense-text images guided by predefined topics from CommonCrawl 1 1 1 https://commoncrawl.org/ and LAION-5B ( Schuhmann et al. 2022 ) . To assess the capability of model in dense text image generation, we introduce a dedicated test set, TextAtlasEval, designed for comprehensive evaluation. This test set spans four distinct data types, ensuring diversity across domains and enhancing the relevance of TextAtlas5M for real-world applications. Our contributions are as follows: • Introduction of TextAtlas5M: We present TextAtlas5M, a large-scale dataset for text-conditioned image generation, focusing on text-rich images. The dataset includes three levels of synthetic data and a diverse collection of real images, curated from widely relevant real-world topics. • Long-Text Evaluation Benchmark: We design a dedicated test set to address the longstanding gap in metrics for evaluating long-text information in image generation. By requiring models to effectively process and generate longer text, TextAtlas5M sets itself apart from existing text rendering benchmarks. • Comprehensive Model Evaluation: We thoroughly evaluate proprietary and open-source models to assess their long-text generation capabilities. The results reveal the significant challenges posed by TextAtlas5M and provide valuable insights into the limitations of current models, offering key directions for advancing text-rich image generation in future research. Figure 2 : Examples of Subsets in TextAtlas5M. The dataset includes Synthetic Data and Real Data splits. Synthetic data consists of three progressively complex subsets, while real data is gathered from diverse sources. 2 Related Works Text-conditioned Image Synthesis. Recent advances in generative modeling have prominently featured diffusion-based ( Song & Ermon 2019 ; Ho et al. 2020 ; Ho & Salimans 2022 ) and autoregressive-based ( Ramesh et al. 2021b ; Esser et al. 2021 ) frameworks. Diffusion models, such as DALL-E ( Ramesh et al. 2021a ) and Parti ( Yu et al. 2022 ) , produce high-fidelity outputs through an iterative refinement process but are limited by slow inference speeds. While, autoregressive models ( Lu et al. 2024 ; Sun

Read the complete text