Resolution Thresholds in VLM Detection of Harmful ASCII Art Across Construction Modes and Languages
Yikai Hua, Peter West · 2026
Read Resolution Thresholds in VLM Detection of Harmful ASCII Art Across Construction Modes and Languages by Yikai Hua, Peter West (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-29649.txt.
Introduction
Hua and West investigate a moderation loophole: harmful text drawn as ASCII art, pictures built from typed characters, can slip past vision-language models used as content filters. Such jailbreak attacks encode banned words visually. The authors ask how image resolution affects whether models detect the harmful content.
They generate ASCII art images at ten resolution scales across eight character construction modes. Modes range from dense block characters to word-embedded designs. Eight state-of-the-art vision-language models are evaluated on English and Chinese corpora. Detection rates decline sharply once resolution passes certain thresholds. The thresholds recur across models, modes, and languages. Word-based modes prove the most resistant to detection at every resolution. The authors call this a systematic vulnerability in vision-language moderation and argue for resolution-aware evaluation standards.
Catalog record
| CREATOR | Yikai Hua, Peter West |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| LICENSE | http://creativecommons.org/publicdomain/zero/1.0/ |
| RIGHTS | CC0 |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.29649
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Resolution Thresholds in VLM Detection of Harmful ASCII Art Across Construction Modes and Languages Yikai Hua, Peter West Abstract Large Vision-Language Models (VLMs) are increasingly deployed as content moderation tools, yet they remain vulnerable to jailbreak attacks in which harmful text is visually encoded as ASCII art. This can allow inappropriate or harmful content to bypass moderation systems. To address this vulnerability, this paper investigates how image resolution affects VLM detection of harmful ASCII art across eight character construction modes (L1–L8), ranging from dense block characters to word-embedded designs. We evaluate eight state-of-the-art VLMs on English and Chinese corpora using a pipeline that generates ASCII art images at ten resolution scales, probing whether a consistent detection-failure threshold exists across models, modes, and languages. Results indicate that detection rates decline sharply above certain resolution thresholds, and that word-based modes are the most resistant to detection across the full resolution range. These findings reveal a systematic vulnerability in VLM-based content moderation systems and motivate resolution-aware evaluation standards. Keywords: large vision-language models, ASCII art, content moderation, jailbreak, resolution threshold, harmful content detection Warning: this paper contains examples of toxic language used for research purposes. 1 Introduction Content moderation systems increasingly rely on Vision-Language Models (VLMs) such as GPT, Gemini, and Grok to flag harmful material submitted as images. This creates a concrete security risk: adversaries can encode harmful words as ASCII art, “the art of creating images using text characters as their constituent elements” ( 8 ) , and bypass the moderation system by exploiting VLMs’ weakness in recognizing ASCII art due to its nature of encoding visual patterns using textual characters. Understanding the conditions under which detection fails is therefore a prerequisite for building trustworthy moderation systems. To see why this gap is non-trivial to close, consider a harmful word whose letter shapes are rendered not as strokes but as a mosaic of innocuous filler words like love and peace . Submitted as an image to a VLM, this input pits two signals against each other: the fill characters appear harmless when read in isolation, while the overall visual shape encodes something harmful. Prior work has shown that by exploiting VLMs’ difficulty in processing non-standard character arrangements and maintaining visual-textual alignment that masking target words as ASCII art achieves high jailbreak success rates, especially when building ASCII art using positive words ( 7 ; 9 ) . One solution is to train VLMs on large datasets of harmful ASCII art, but this is a costly and reactive approach. A more proactive strategy is proposed to force VLMs to attend to the overall visual gestalt rather than individual characters by downscaling the image. When an ASCII art image is downscaled, individual characters blur and merge, potentially making the overall letter shape more visually salient rather than less ( 6 ) . However, existing work does not characterize how the detection-failure threshold — a scale above which VLMs can no longer reliably identify the harmful content — varies across ASCII art construction modes (e.g., block characters versus embedded English or Chinese words), VLM architectures, and content languages. This paper. We report a systematic empirical study of how image resolution interacts with ASCII art construction mode to affect VLM detection of harmful content. This is not a defense paper: we do not propose a new model, defense mechanism, or moderation system. The contribution is a characterization of a specific, underexplored vulnerability dimension. Our central questions are: (1) Does a consistent detection-failure threshold exist across VLMs, construction modes, and content languages? (2) Do word-embedded fill modes—which substitute innocuous English or Chinese words for individual characters—resist detection even when resolution is decreased? To answer these questions, we build a pipeline that renders harmful phrases and words from parallel English and Chinese corpora across eight fill modes (L1–L8, ranging from dense block characters to symbol sets, digits, letters, embedded English words, emoji, positive poem fragments, and Chinese words) at ten resolution scales. We evaluate eight state-of-the-art VLMs on the resulting image set and analyze detection-rate curves using logistic regression to estimate mode-specific thresholds, Cochran–Armitage trend tests to confirm monotonic trends, and chi-square tests to compare detection across the two languages. Our contributions are: (1) an evaluation pipeline and dataset spanning eight construction modes, ten resolution scales, two languages, and eight VLMs; (2) statistically grounded estimates of detection-failure thresholds, with 95% confidence intervals, for each (model, mode) combination; and (3) a descriptive cross-origin analysis of whether Chinese-built and US/Western-built models show differential detection patterns on Chinese-words fill mode (L8) relative to English word fill mode (L5), using L5 as a within-design control. These findings reveal a resolution-dependent vulnerability in VLM-based content moderation; the design of mitigations is left to future work. 2 Literature Review Large Vision-Language Models (VLMs) have developed rapidly in recent years. Recent models, such as GPT-4o-mini, Gemini-3-Flash-Preview, and Grok-4.1-Fast, demonstrate strong performance on multimodal tasks including visual question answering, image description, and content analysis, making them attractive candidates for automated content moderation pipelines. One active area of VLM research is multimodal content recognition, where models must integrate visual and textual signals to reason about complex inputs. 5 demonstrate that combining language models with visual features improves emotion recognition accuracy. 11 show that LLMs can perform competitive image classification when provided with structured visual input, highlighting their capacity for visual reasoning. These results underpin the assumption that VLMs can serve as effective content moderation tools. Despite this progress, VLMs exhibit well-documented limitations when processing ASCII art. 2 tested GPT-3.5 on cross-modal tasks involving ASCII art and found that the model handles only trivial cases, indicating that transformer models have some latent visual understanding of ASCII art but fall far short of reliable recognition. 9 further show that VLMs struggle with visual-textual alignment in non-standard formats, particularly when characters are arranged to form meaningful visual patterns. These failure modes are consistent with a broader pattern identified by 10 , who show that generative models acquire generation capabilities not contingent upon understanding, producing outputs that can exceed human-level quality while simultaneously failing at basic comprehension tasks that no human expert would miss. Applied to VLMs processing ASCII art, this suggests that a model may be capable of producing high-quality image descriptions in general yet still fail to parse the structured visual meaning encoded in character mosaics. The security implications of these limitations have attracted dedicated attention. 7 introduced ArtPrompt, a jailbreak attack that encodes a harmful word as ASCII art by masking it in the input prompt, achieving high attack success rates against leading LLMs. 1 and 3 further show that token-by-token reading prevents models from assembling visual meaning from ASCII art, especially when the fill characters are drawn from positive or neutral words — a design that maximizes ambiguity at the character level while preserving harmful meaning at the visual level. To solve this, 6 further reveal that reducing image resolution improves ASCII art recognition by compelling models to attend to global shape rather than individual characters, suggesting resolution as a meaningful intervention point. However, no existing work characterizes how resolution interacts with ASCII art construction mode to affect harmful content detection specifically, nor whether detection-failure thresholds are consistent across VLM architectures and content languages. This study addresses