TextFake: Benchmarking AI-Generated Image Detection on Text-Rich Images

Yuning Zhang, Changtao Miao, Mingyu Liao, Tingyu Liu, Xinghao Wang, Tao Gong, Qi Chu, Nenghai Yu · 2026

Read TextFake: Benchmarking AI-Generated Image Detection on Text-Rich Images by Yuning Zhang, Changtao Miao, Mingyu Liao, Tingyu Liu, Xinghao Wang, Tao Gong, Qi Chu, Nenghai Yu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-01050.txt.

Introduction

Zhang and co-authors test fake image detectors on fakes full of text in this 2026 paper. Detectors shine on natural images. But much misinformation rides on forged screenshots, documents, and news pages. Those text rich fakes had no benchmark of their own. The team built one to close the gap.

Their set, TextFake, holds 20,000 images across 28 languages, four topic classes, and two scene types. Fakes are made in four stages, with real images annotated on three controlled axes first. Counterparts are then generated to match the real spread, which blocks shortcut cues. Fourteen specialist detectors and three frontier vision APIs face the set cold. None breaks 80 percent accuracy, they report. Some fall over 60 points from their natural image scores. Three failure modes stand out. Dense glyphs swamp low level detectors. Clean rendering hides generative traces. And routine perturbations collapse thresholds toward chance.

Catalog record

CREATORYuning Zhang, Changtao Miao, Mingyu Liao, Tingyu Liu, Xinghao Wang, Tao Gong, Qi Chu, Nenghai Yu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.01050

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

TextFake: Benchmarking AI-Generated Image Detection on Text-Rich Images Yuning Zhang, Changtao Miao, Mingyu Liao, Tingyu Liu, Xinghao Wang, Tao Gong, Qi Chu, Nenghai Yu Abstract Recent AI-generated image (AIGI) detectors perform well on natural-image benchmarks, but their behavior on text-rich forgeries, such as fabricated screenshots, documents, and news pages prevalent in misinformation, remains untested. We introduce TextFake , a 20,000-image benchmark for text-rich AIGI detection spanning 28 languages, 4 topic categories, and 2 scene modalities. Fake images are synthesized via a four-stage pipeline that annotates real images along three controlled dimensions and generates counterparts through distribution-aligned structured prompting, ruling out covariate shortcuts. Zero-shot evaluation of 14 specialized detectors and 3 frontier VLM APIs reveals a large systematic gap: no method exceeds 80% accuracy, with some dropping over 60% from natural-image benchmarks. Diagnostic evaluations identify three failure modes: the Text Density Curse , where dense glyphs overwhelm low-level detectors; Cloaking via Rendering Fidelity , where stronger text rendering suppresses generative artifacts; and Threshold Collapse , where routine perturbations drive detectors toward chance-level performance. † † footnotetext: ∗ Project Lead. † Corresponding Author. 1 Introduction Figure 1: Text-rich fake images expose a critical detection gap: across representative detectors, mean accuracy drops from 86.7% on GenImage to 51.8% on TextFake, a decline of 34.9 percentage points. Despite rapid progress in AI-generated image (AIGI) detection 38 , existing benchmarks remain dominated by natural-scene images, leaving text-rich forgeries largely unexplored. Fabricated screenshots, fake news pages, and official documents are prevalent in misinformation and fraud 23 ; as frontier generators grow capable of rendering multilingual text and realistic layouts, this gap is increasingly consequential. Existing AIGI benchmarks have grown from early deepfake collections 19 ; 14 to large natural-image evaluations such as CIFAKE 3 and GenImage 39 . Yet text-rich imagery appears in none of them as a design dimension or evaluation target. Because no existing benchmark covers this modality, detection methods have never been evaluated on text-rich forgeries and their behavior here is unknown 35 ; 24 ; 31 , which leaves a task that is both high-stakes and unexplored. We introduce TextFake , a 20,000-image benchmark for text-rich AIGI detection covering 28 languages, two scene modalities, and four topics, with real and synthetic subsets distributionally aligned to reduce dataset shortcuts. Zero-shot evaluation of 14 specialized detectors and three frontier VLM APIs shows that no method exceeds 80% accuracy, while several spatial- and frequency-based detectors 34 ; 28 perform near chance. A four-stage pipeline reveals that performance declines as text density increases; higher-fidelity generators produce images that are harder to detect; and JPEG compression, Gaussian noise, and screenshot-induced moiré patterns cause severe prediction shifts. By aligning distributions across scene, topic, and language, the pipeline rules out covariate shortcuts and attributes these gaps to the intrinsic challenges posed by text-rich content. Our contributions are: • We construct TextFake , a 20,000-image benchmark for text-rich AIGI detection spanning 28 languages, two scene modalities, and four topics, with real and synthetic subsets distributionally aligned. • We introduce a four-stage pipeline that collects multilingual real images, annotates them via OCR and VLM classifiers, synthesizes fake counterparts via distribution-aligned structured prompting, and normalizes metadata for fair comparison. • We evaluate 14 specialized detectors and three frontier VLM APIs on TextFake, showing that natural-scene benchmark performance does not transfer, and conduct four diagnostic analyses (text density, rendering fidelity, perturbation robustness, and language/scene bias) that surface concrete failure modes. 2 Related Work AIGI Detection Benchmarks. AI-generated image detection has progressed from early deepfake datasets 19 ; 14 to open-domain natural-image benchmarks such as CIFAKE 3 , GenImage 39 , and cross-generator evaluations 20 . Specialized work has recently extended to scientific figures 15 . Despite this progress, all mainstream benchmarks are dominated by natural scenes; text-rich modalities (fabricated screenshots, official documents, and news pages) remain unevaluated. These are socially consequential because a single altered number or name can change the evidential meaning of an image, and they directly stress-test the text-rendering limits of frontier generators. TextFake fills this gap. Detection Paradigms. Current detectors broadly follow three lines. Spatial and frequency methods 13 ; 34 ; 22 ; 32 ; 33 ; 36 ; 18 ; 16 extract hand-crafted or learned features from pixel statistics, edge patterns, and spectral coefficients to flag low-level artifacts left by generative pipelines, cues that text-rich images naturally mask with dense, legitimate high-frequency glyph structures. Foundation-model-based detectors 37 ; 25 ; 5 ; 7 ; 6 ; 29 instead probe or fine-tune large pretrained vision encoders (e.g., CLIP, DINOv2), relying on their broad visual priors to generalize across unseen generators. Proprietary VLM APIs 11 ; 27 ; 2 take this further by framing detection as a visual question-answering task, prompting multimodal LLMs in a zero-shot manner. The latter two paradigms offer richer semantics but are not attuned to pixel-level typographic authenticity. 3 TextFake: A Distributionally Aligned Benchmark Existing AIGI detection benchmarks mainly target open-domain natural images 39 ; 3 ; 14 , leaving text-rich forgeries underexplored. This setting is important because screenshots, documents, and interface images contain dense glyph structures, layout regularities, and acquisition artifacts that differ substantially from natural scenes. To evaluate detector robustness in this high-risk regime, we construct TextFake , a multilingual benchmark with 20,000 text-rich images, evenly split into 10,000 real and 10,000 AI-generated samples. TextFake is built around distributional control . Each image is annotated along three dimensions: scene modality, semantic topic, and language. We align real and synthetic subsets on scene and topic distributions, while maintaining broad multilingual coverage for language-level analysis. This design reduces shortcut learning 10 and supports both aggregate evaluation and failure diagnosis. Figure 2: Overview of the TextFake construction pipeline. Stage 1 collects multilingual text-rich images from diverse sources including news sites, forums, and online communities, covering both screen captures and photographed or scanned paper documents. Stage 2 applies OCR and VLM-based classifiers to annotate each image with scene type, topic category, language, and text length, filtering out samples that fail language or content checks, and producing a statistical profile of the real-image distribution. Stage 3 generates fake counterparts through structured prompt synthesis, sampling attributes to align with the real-image distribution across languages, scenes, and topics. Stage 4 evenly combines real and synthetic images, strips file metadata, uniformly re-encodes all samples to eliminate format-level shortcuts, and applies optional perturbations such as Gaussian noise, JPEG compression, and brightness changes for robustness evaluation. 3.1 Construction Pipeline Figure 2 shows the four-stage construction pipeline. First, we collect real text-rich images from multilingual news sites, forums, and online communities, covering both screen captures and photographed or scanned paper documents. Second, each image is processed with OCR 5 and VLM-based 1 filters to obtain scene, topic, language, and text-length annotations. Third, synthetic images are generated through structured prompt synthesis. Each prompt combines fixed taxonomy attributes, source and platform information, dynamic event details, visual conditions, and device framing, with all attributes sampled to match the real-image distribution. Finally, real and synthetic images are combined, stripped of file metadata, uniformly JPEG re-encoded, and optionally perturbed for robustness evaluation. Structured prompt template A [UI_MODE] [SCENE] of [PLATFORM] in [LANGUAGE] about [TOPIC]: [DYNAMIC_CONTENT]. UI layout: [UI_ELEMENTS]. Aspect ratio: [ASPECT_RATIO]. Resolution: [RESOLUTION]. Device: [DEVICE]. Capture condition: [PHYSICAL_TRACE]. All

Read the complete text