Advancing WordArt-Oriented Scene Text Recognition: Datasets and Methods

Xingsong Ye, Yongkun Du, Jiaxin Zhang, Haojie Zhang, Chong Sun, Chen Li, Jing Lyu, Zhineng Chen (🖂) · 2026

Read Advancing WordArt-Oriented Scene Text Recognition: Datasets and Methods by Xingsong Ye, Yongkun Du, Jiaxin Zhang, Haojie Zhang, Chong Sun, Chen Li, Jing Lyu, Zhineng Chen (🖂) (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-24484.txt.

Introduction

Ye and colleagues tackle reading text that was designed to be looked at, not read by machines. WordArt, artistic text with custom fonts, textures, and layouts, breaks ordinary scene text recognition. Its datasets and fixed template models assume regular lettering. Their 2026 effort advances the task from both the data and model sides at once.

A two million image synthetic dataset dwarfs earlier artistic text resources, by hundreds of times. One subset comes from an upgraded rendering pipeline, giving accurate, controllable WordArt. The other mines prompts with a vision language model, and makes images for real range. The companion recogniser pairs a visual encoder accepting arbitrary shaped inputs with an autoregressive decoder. The decoder models complex layouts directly, breaking the fixed template bottleneck. Tests show the design beating prior scene text methods on artistic material. Ye's team frames data scale and shape freedom as the twin keys to reading WordArt.

Catalog record

CREATORXingsong Ye, Yongkun Du, Jiaxin Zhang, Haojie Zhang, Chong Sun, Chen Li, Jing Lyu, Zhineng Chen (🖂)
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.24484

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Advancing WordArt-Oriented Scene Text Recognition: Datasets and Methods Xingsong Ye, Yongkun Du, Jiaxin Zhang, Haojie Zhang, Chong Sun, Chen Li, Jing Lyu, Zhineng Chen (🖂) Abstract WordArt (artistic text) features highly customized fonts, textures, and layouts, making WordArt-oriented scene TExt Recognition (WATER) substantially more challenging than general Scene Text Recognition (STR). Existing STR datasets and methods, typically built around regular scene text and fixed-template inputs, struggle to scale to WATER. Thus, we aim to advance this task from both data and model perspectives. On the data side, we construct a 2M synthetic dataset, WATER-S , with the scale improved by hundreds of times compared to existing artistic text data. WATER-S consists of two complementary subsets. One rendered by an upgraded rendering pipeline (SynthWordArt), which provides highly accurate and controllable synthetic WordArt data. The other is generated by combining Qwen3-VL for prompt mining and Z-Image for image synthesis, which improves the coverage of realistic and diverse data. On the model side, we propose WATERec . It adopts a visual encoder supporting arbitrary-shaped inputs and an autoregressive decoder to model complex layouts, structurally breaking the bottleneck of fixed-template STR on WordArt. Experiments show that this architecture outperforms prior STR methods, achieving state-of-the-art performance on irregular texts such as WordArt. Together with WATER-R , carefully reorganized from existing real STR data, our strong baseline with the new synthetic data and model design reaches 90.40% accuracy on WordArt-Bench, surpassing both general-purpose and OCR-specialized vision-language models by a large margin. Code and data are available at https://github.com/YesianRohn/WATER . 🖂 🖂 footnotetext: Corresponding author. E-mail: [email protected] 1 Introduction Figure 1 : Top: Two subsets’ examples of our synthetic datasets (WATER-S) and the real artistic text benchmark (WordArt-Bench). Bottom: Recognition accuracy on WordArt-Bench for various STR methods and VLMs. For each STR entry, the term before “/” denotes the model and the term after “/” denotes the training data used. “R” indicates existing real datasets only, while “RS” indicates adding our synthetic data. WordArt refers to artistic text [ 47 ] that exhibits strong visual stylization and appears widely in posters, signboards, magazines, and other advertising design scenarios. Compared to regular scene text, artistic text is highly customized in font shape, texture, layout, and pattern fusion, as shown in the top of Fig. 1 . Designers often embed complex graphics and semantic elements inside character contours, so that the text serves as both a linguistic carrier and a visual symbol. This highly stylized design introduces substantial visual distractions unrelated to the underlying text, making WordArt-oriented scene TExt Recognition (WATER) more challenging than general Scene Text Recognition (STR). Consequently, WATER is often treated as a distinct subtask within STR, and existing work [ 24 , 47 ] typically includes dedicated test subsets and benchmarks for this setting. Although mainstream STR models [ 16 , 14 , 13 ] and recent general/OCR-specialized vision-language models (VLMs) [ 5 , 38 , 1 ] perform well on common STR benchmarks, their performance on artistic text remains far from satisfactory (see the bottom of Fig. 1 ). The primary bottleneck for WATER is the lack of data. Real artistic text is difficult to collect in real scenes, and its annotation is expensive and inconsistent. Annotators must carefully inspect characters under complex textures and often must reason about ambiguous shapes to determine the correct label. As a result, current training sets are (i) too small to optimize modern models (e.g., WordArt provides only 4,805 training images [ 47 ] ), and (ii) insufficiently diverse to cover the long-tail of styles seen in real designs. Breaking this bottleneck requires moving beyond purely manual collection, and large-scale synthesis becomes an almost inevitable choice. However, current methods for scene text data generation [ 23 , 20 , 51 ] mainly focus on regular text and do not suit WordArt. Synthesizing artistic text is challenging for it must cover broad stylistic variations (fonts, textures, shadow) and realistic effects while still ensuring accurate labels. Therefore, we systematically explore two synthetic data paradigms oriented to WordArt: an improved tool-based rendering approach and a pioneering generative-model-based synthesis pipeline. They emphasize different aspects and, when combined, provide a richer and more comprehensive synthetic dataset WATER-S . Here, we customize and evaluate both paradigms for artistic text. (1) We collect about 11K open-source artistic fonts, we then develop an artistic-text-oriented rendering engine, SynthWordArt . It pastes target text with specified fonts and layout rules onto background images. Based on this tool, we generate a 1M-scale synthetic artistic text dataset, WATER-T , which substantially enlarges the number of training samples and the diversity of fonts. (2) To better mimic the rich style semantics and content compositions in real design scenarios, we leverage the advanced VLM, Qwen3-VL-8B [ 1 ] , to automatically mine and generate fine-grained captions from existing artistic text images, and obtain about 273K high-quality textual prompts. Then, we employ the state-of-the-art (SOTA) open-source image generation model Z-Image-Turbo [ 3 ] to synthesize images containing artistic-style text based on these prompts. Finally, we construct another 1M-scale synthetic artistic text dataset, WATER-Z . Compared with traditional rendering, WATER-Z exhibits higher diversity and realism in background textures, layout composition, and global visual style, as depicted at the top of Fig. 1 . Beyond the data, we aim to further establish a strong baseline specifically for WordArt. We find that WordArt often contains highly irregular text with unfixed aspect ratios. But many STR models resize all inputs to a fixed shape, which can severely distort highly irregular text. SVTRv2 [ 13 ] shows that such resizing can dominate failure cases and proposes multi-shape resizing with predefined templates. However, this approach requires manual template design and lacks flexibility in WordArt. Motivated by modern VLMs, we introduce a NaViT-like encoder [ 7 ] with RoPE [ 37 , 21 ] to support arbitrary-shaped inputs without relying on predefined resizing templates. On the decoding side, WordArt often violates standard left-to-right reading order and requires stronger contextual reasoning. Thus we adopt an autoregressive (AR) decoder to generate the character sequence step by step. Combining these ideas, we present WATERec , a strong STR baseline that better fits the characteristics of the WordArt data. To fairly and comprehensively evaluate STR methods on artistic text, we also re-construct WATER-R from existing real scene text data (Union14M-L [ 24 ] , WordArt-Train [ 47 ] , WAS-R [ 48 ] ). We perform strict hashing deduplication, so as to avoid label leakage between training and evaluation. Experimental results show that WATERec achieves new SOTA performance on the WordArt-Bench [ 47 ] and on several highly challenging subsets (including artistic subset) of the Union14M-Benchmark [ 24 ] . When we augment training with our synthetic data, adding either WATER-T or WATER-Z alone already brings consistent and significant improvements. When combining both datasets during training, WATERec further improves its accuracy on the WordArt-Bench to 90.40%, which, to our knowledge, is the first result exceeding 90% on this benchmark. We also evaluate representative general VLMs [ 1 , 40 , 8 ] and OCR-specialized VLMs [ 41 , 5 , 38 , 42 , 43 ] on the WordArt-Bench. Their best accuracies are 78.36% and 81.54%, respectively, which remain notably lower than that of

Read the complete text