LeX-Art: Rethinking Text Generation via Scalable High-Quality Data Synthesis
Shitian Zhao, Qilong Wu, Xinyue Li, Bo Zhang, Ming Li, Dongyang Liu, Kaipeng Zhang, Hongsheng Li, Yu Qiao, Peng Gao, Zhen Li · 2025
Read LeX-Art: Rethinking Text Generation via Scalable High-Quality Data Synthesis by Shitian Zhao, Qilong Wu, Xinyue Li, Bo Zhang, Ming Li, Dongyang Liu, Kaipeng Zhang, Hongsheng Li, Yu Qiao, Peng Gao, Zhen Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-21749.txt.
Introduction
Shitian Zhao and a team of co-authors build a suite for text in images in twenty twenty-five. Image generators often garble the words they are asked to render. Prompt richness and rendering fidelity pull against each other. Their suite, LeX-Art, attacks the problem from the data side.
A synthesis pipeline built on Deepseek-R1 curates a data set of ten thousand images. Each is high-resolution, refined for aesthetics, and rich in rendered text. A prompt enrichment model, LeX-Enhancer, strengthens weak prompts. Two text-to-image models trained on the data reach state-of-the-art text rendering. A new benchmark, LeX-Bench, grades fidelity, aesthetics, and alignment. A new metric measures text accuracy more robustly than edit distance alone.
Catalog record
| CREATOR | Shitian Zhao, Qilong Wu, Xinyue Li, Bo Zhang, Ming Li, Dongyang Liu, Kaipeng Zhang, Hongsheng Li, Yu Qiao, Peng Gao, Zhen Li |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-21749
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
LeX-Art: Rethinking Text Generation via Scalable High-Quality Data Synthesis Thanks: Corresponding Authors Shitian Zhao, Qilong Wu, Xinyue Li, Bo Zhang, Ming Li, Dongyang Liu, Kaipeng Zhang, Hongsheng Li, Yu Qiao, Peng Gao, Zhen Li Abstract We introduce LeX-Art, a comprehensive suite for high-quality text-image synthesis that systematically bridges the gap between prompt expressiveness and text rendering fidelity. Our approach follows a data-centric paradigm, constructing a high-quality data synthesis pipeline based on Deepseek-R1 to curate LeX-10K, a dataset of 10K high-resolution, aesthetically refined 1024 × \times 1024 images. Beyond dataset construction, we develop LeX-Enhancer, a robust prompt enrichment model, and train two text-to-image models, LeX-FLUX and LeX-Lumina, achieving state-of-the-art text rendering performance. To systematically evaluate visual text generation, we introduce LeX-Bench, a benchmark that assesses fidelity, aesthetics, and alignment, complemented by Pairwise Normalized Edit Distance (PNED), a novel metric for robust text accuracy evaluation. Experiments demonstrate significant improvements, with LeX-Lumina achieving a 79.81% PNED gain on CreateBench, and LeX-FLUX outperforming baselines in color (+3.18%), positional (+4.45%), and font accuracy (+3.81%). Our codes, models, datasets, and demo are publicly available. Figure 1 : Given the prompts for visual text generation, our proposed LeX-FLUX and LeX-Lumina can generate text images with multiple words , aesthetic complex layout , and good text attributes controllability . † † footnotetext: ∗ Equal Contribution † Corresponding authors 1 Introduction Visual text generation is an important task for text-to-image (T2I) models. Producing text images that are clear, accurate, and aesthetically pleasing significantly enhances productivity in the design industry. Previous efforts, constrained by the limitations of foundational models such as SD-1.5 [ 38 ] and SD-XL [ 34 ] have resulted in poor performance in visual text generation. Consequently, researchers has focused predominantly on improving the accuracy of text, while overlooking an equally important aspect: the aesthetic quality of the generated text and its seamless integration and interaction with image content. Due to the limitations of base T2I models, recent works have adopted control-based [ 54 ] approaches for accurate visual text rendering, incorporating glyph information into the generation pipeline through specialized glyph modules, e.g . , AnyText [ 43 , 44 ] , GlyphControl [ 52 ] , Text-Diffuser [ 5 , 6 ] , and Glyph-ByT5 [ 31 , 32 ] . Incorporating glyph information in the image generation process can enhance control over text accuracy and layout in generated images, which is particularly beneficial for paragraph text generation. However, these methods often compromise diversity, aesthetics, and seamless integration with surrounding visual content. While ensuring text accuracy—regardless of its fusion with the background—may suffice for structured text scenarios like poster design, it falls short in applications requiring minimal yet visually harmonious text, such as slogans, logos, and artistic typography. In these cases, aesthetic appeal, integration with the overall image, and dynamic layout become crucial. To achieve high-quality multi-word visual text generation with diverse font styles, dynamic layouts, and strong aesthetic appeal , we take an alternative approach that avoids the constraints of control-based methods. Instead of introducing additional control signals, we aim to maximize the inherent text rendering capabilities of base T2I models through high-quality data curation and supervised fine-tuning. Existing open-sourced and web-crawled text image datasets [ 12 , 43 , 44 , 40 ] exhibit significant limitations in enhancing the text rendering capabilities of foundation models. This is primarily due to the scarcity of high-quality text image samples within these datasets, making it challenging to meet the demands of model training. Given these limitations, relying solely on curated datasets is insufficient for achieving high-quality text rendering. Instead, a more scalable and systematic approach is required to generate diverse, aesthetically rich, and well-integrated text samples. To address these challenges, we introduce LeX-Art , a comprehensive framework for high-quality text-image synthesis and enhancement, designed to systematically bridge the gap between prompt expressiveness and high-quality rendered text. As shown in Fig. 2 , LeX-Art consists of three key components: (1) dataset construction, (2) model fine-tuning, and (3) benchmark evaluation. Our approach begins by leveraging the strong reasoning capabilities of DeepSeek-R1 [ 13 ] to refine seed prompts extracted from the AnyWord-3M [ 43 ] dataset. These enriched prompts incorporate detailed textual attributes such as font styles, color schemes, and spatial layouts, significantly improving the quality of textual descriptions for image synthesis. With these enhanced prompts, we construct LeX-10K, a dataset of 10K high-quality text-image pairs. To ensure data reliability, we introduce a multi-stage filtering and recaptioning process: Q-Align [ 50 ] and Paddle-OCR-v3 [ 26 ] assess fidelity, aesthetic quality, and text bounding box coverage, while a knowledge-augmented recaptioning module refines textual descriptions to enhance alignment with generated images. Beyond dataset creation, we leverage 60,856 DeepSeek-R1-enhanced prompts to fine-tune a locally deployable model, LeX-Enhancer, which specializes in robust prompt enrichment for text-image generation. We further fine-tune two visual text generation models, LeX-FLUX and LeX-Lumina, using LeX-10K. Notably, our experiments demonstrate that LeX-FLUX achieves superior text rendering performance, while even the lightweight LeX-Lumina (2B) benefits significantly, highlighting the impact of our data synthesis strategy. To systematically evaluate our approach, we propose LeX-Bench, a benchmark designed to assess visual text generation across multiple dimensions, including text fidelity, aesthetics, and alignment with input prompts. Furthermore, we introduce Pairwise Normalized Edit Distance (PNED), a new metric for evaluating text accuracy. PNED computes the discrepancy between ground-truth and OCR-detected words using NED-based [ 53 ] matching, making it a flexible metric for non-glyph-conditioned visual text generation. Experimental results demonstrate that LeX-Art provides a scalable and effective framework for improving text-image generation, offering a systematic solution to the challenges of high-quality text rendering. 2 Related Work Text-to-image models. Image generation has long been a pivotal problem in the field of artificial intelligence. To efficiently and effectively generate high-quality images, researchers have developed a variety of algorithms. These include Generative Adversarial Networks (GANs) [ 11 , 55 , 19 , 4 , 20 , 48 ] ; Variational Autoencoders (VAEs) [ 1 , 21 , 23 , 37 , 46 , 45 ] ; and Diffusion Models [ 16 , 3 , 7 , 10 ] . However, in recent years, Flow Matching [ 28 , 30 ] has emerged as the de facto paradigm in image generation due to its training stability and sampling efficiency. As described above, with continuous advancements in modeling paradigms and architectural designs, image generation models have achieved remarkable progress in generating realistic portraits, high-resolution images, and text image synthesis. Among these, text rendering has become increasingly important as a challenging task with significant economic value, making it a key metric for evaluating the capabilities of text-to-image models. In SD3 [ 9 ] and Seedream [ 10 ] , they use DPO [ 36 , 47 ] to improve the model’s text rendering ability. In Playground-v3 [ 29 ] , they use a fine-grained caption to improve the text rendering capability. In this work, we focus on improving the text rendering capabilities of T2I models via post-training with high-quality synthetic data. Visual text generation. A prevailing explanation for the difficulty of text rendering in text-to-image generation models is that the text information in the prompt, after being processed by the text encoder, often becomes distorted or inadequately preserved. This degradation