One Perturbation, Two Failure Modes: Probing VLM Safety via Embedding-Guided Typographic Perturbations
Ravikumar Balakrishnan, Sanket Mendapara · 2026
Read One Perturbation, Two Failure Modes: Probing VLM Safety via Embedding-Guided Typographic Perturbations by Ravikumar Balakrishnan, Sanket Mendapara (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-25102.txt.
Introduction
Balakrishnan and Mendapara probe vision model safety via embedding-guided typo perturbations. Typo prompt injection exploits models' ability to read text in images, a growing threat for autonomous agents. An empirical study across four models and ten transformations finds embedding distance, with correlations as strong as -0.93, strongly predicts attack success. The authors then maximize image-text similarity under bounded perturbations, stress-testing both factors. Experiments across five degradation settings on four frontier models confirm optimization brings back readability and cuts safety refusals.
Catalog record
| CREATOR | Ravikumar Balakrishnan, Sanket Mendapara |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 16690 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.25102
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
One Perturbation, Two Failure Modes: Probing VLM Safety via Embedding-Guided Typographic Perturbations Ravikumar Balakrishnan, Sanket Mendapara Abstract Typographic prompt injection exploits vision language models’ (VLMs) ability to read text rendered in images, posing a growing threat as VLMs power autonomous agents. Prior work typically focus on maximizing attack success rate (ASR) but does not explain why certain renderings bypass safety alignment. We make two contributions. First, an empirical study across four VLMs including GPT-4o and Claude, twelve font sizes, and ten transformations reveals that multimodal embedding distance strongly predicts ASR ( r = − 0.71 r{=}{-}0.71 to − 0.93 {-}0.93 , p < 0.01 p{<}0.01 ), providing an interpretable, model agnostic proxy. Since embedding distance predicts ASR, reducing it should improve attack success, but the relationship is mediated by two factors: perceptual readability (whether the VLM can parse the text) and safety alignment (whether it refuses to comply). Second, we use this as a red teaming tool: we directly maximize image text embedding similarity under bounded ℓ ∞ \ell_{\infty} perturbations via CWA-SSA across four surrogate embedding models, stress testing both factors without access to the target model. Experiments across five degradation settings on GPT-4o, Claude Sonnet 4.5, Mistral-Large-3, and Qwen3-VL confirm that optimization recovers readability and reduces safety aligned refusals as two co-occurring effects, with the dominant mechanism depending on the model’s safety filter strength and the degree of visual degradation. 1 Introduction Figure 1 : Overview of our embedding-guided adversarial optimization. A degraded typographic image (left) is optimized via the popular CWA-SSA (Common Weakness Attack with Spectral Simulation Augmentation) across four surrogate embedding models to maximize cosine similarity with the source prompt text embedding (top). The resulting image (right) is visually similar but semantically realigned. This single objective produces two co-occurring effects: readability recovery and reduction of safety-aligned refusals, whose relative contribution varies across models and degradation settings. Vision-language models (VLMs) can read and follow textual instructions embedded within images, creating an attack vector known as typographic prompt injection (TPI) 5 . By rendering harmful prompts as images, attackers bypass text-based safety filters because the malicious instruction arrives through the visual modality. In practice, the attack surface is heterogeneous: adversarial text may appear at varying font sizes, under visual transformations (rotation, blur, noise), and across different attack strategies, while VLMs vary substantially in vulnerability. Yet prior work focuses on maximizing attack success rate (ASR) through novel attack designs 5 ; 9 ; 2 , without characterizing why certain renderings bypass safety alignment while others do not. Building this understanding is a prerequisite for designing robust VLM safety mechanisms. This paper makes two contributions. First, we present a systematic empirical study ( Section 2 ) showing that multimodal embedding distance is an interpretable, model-agnostic indicator of typographic attack success ( r=-0.71 to -0.93 ). Second, we use this insight as a red teaming tool ( Section 3 ): we directly maximize image-text embedding similarity under bounded perturbations, probing the robustness of VLM safety alignment. Our experiments ( Section 4 ) reveal that this single objective exposes two co-occurring vulnerabilities: recovering readability and reducing safety aligned refusals. The relative contribution depends on the model’s safety filter strength and the degree of visual degradation. 2 Text-Image Embedding Distance Correlates with ASR Before designing an optimization method, we first need to understand what makes a typographic attack succeed or fail. This section presents a controlled empirical study characterizing how rendering conditions (font size, visual transformations) affect attack success, and tests whether off-the-shelf multimodal embedding models can predict this variation. We evaluate 1,000 prompts curated from SALAD-Bench 7 across four VLMs, namely, GPT-4o, Claude Sonnet 4.5, Mistral-Large-3, and Qwen3-VL-4B. Each prompt is rendered as black text on a white background at 1024\times 1024 resolution using a standard sans serif font with word wrapping, and tested both as raw text and as typographic images at twelve font sizes (6–28px), as well as under ten visual transformations applied to 20px renderings. Attack success is judged by GPT-4o using a standardized evaluation protocol. Font size and transformation effects. Font size significantly affects ASR ( Table 1 ). Very small fonts (6px) reduce ASR across all models, though the magnitude varies: GPT-4o drops to 0.3% and Claude to 1.2%, while Mistral retains 15.0% and Qwen3-VL retains 23.9%. ASR increases rapidly from 6px to 10px and then more gradually beyond that. Among visual transformations applied to 20px renderings, heavy blur and triple degradation (blur + noise + low contrast) reduce ASR most severely, while rotation affects models asymmetrically: Mistral and Qwen3-VL drop substantially under 90 ∘ rotation, whereas GPT-4o and Claude are relatively stable. Table 1 : ASR (%) and JinaCLIP L2 distance across rendering conditions. Font sizes are rendered directly; transformations are applied to 20px text. n{=}1{,}000 . Condition d GPT-4o Claude Mistral Qwen 6px 1.265 0.3 1.2 15.0 23.9 8px 1.242 3.5 10.5 67.9 40.8 10px 1.192 6.4 21.6 73.5 43.1 20px 1.115 7.7 16.4 73.8 48.2 Text – 35.6 46.6 85.0 48.9 Rot 90 ∘ 1.173 4.8 9.2 39.9 18.2 Triple deg. 1.227 3.0 3.2 44.6 28.7 Heavy blur 1.244 2.7 0.7 26.7 25.2 Embedding distance correlates with ASR. For each prompt p rendered as image I , we compute the L2 distance between normalized multimodal embeddings: d(p,I)=\left\|\frac{\text{ImgEnc}(I)}{\|\text{ImgEnc}(I)\|}-\frac{\text{TxtEnc}(p)}{\|\text{TxtEnc}(p)\|}\right\|_{2} (1) using JinaCLIP 6 (1024-d) and Qwen3-VL-Embedding (2048-d). Table 1 already hints at this relationship: conditions that increase L2 distance tend to reduce ASR. We confirm this quantitatively in Table 2 . Both embedding models show strong negative correlations with ASR across all four VLMs ( r=-0.71 to -0.93 for font sizes, r=-0.72 to -0.99 for transformations, nearly all p<0.01 ). Table 2 : Pearson correlation between L2 embedding distance and ASR across font sizes (left) and visual transformations (right). Font sizes Transforms Emb. / VLM r p r p Jina / GPT-4o -0.795 .002 -0.829 .003 Jina / Claude -0.725 .008 -0.893 .001 Jina / Mistral -0.714 .009 -0.805 .005 Jina / Qwen -0.799 .002 -0.717 .020 Qwen / GPT-4o -0.843 .001 -0.628 .052 Qwen / Claude -0.812 .001 -0.880 .001 Qwen / Mistral -0.899 {<}.001 -0.987 {<}.001 Qwen / Qwen -0.934 {<}.001 -0.965 {<}.001 Key insight. The strong correlation between embedding distance and ASR implies that reducing the distance between a typographic image and its source text in embedding space should increase attack success. Visually degraded renderings reside in high distance regions and present the most room for improvement. However, the relationship between embedding distance and ASR is mediated by two factors: perceptual readability (whether the VLM can parse the text) and safety alignment (whether the VLM refuses to comply). Both are potential targets for an optimization that reshapes the image’s representation in embedding space. This motivates our approach. 3 Method: Probing Safety Robustness via Embedding Guided Optimization 3.1 Core Idea The empirical results in Section 2 suggest that image-text embedding distance strongly correlates with typographic attack success: when a typographic image is close to its source text in embedding space, VLMs are more likely to comply with the embedded instruction. A natural question is whether this relationship is causal: does reducing the embedding distance of a degraded typographic image increase its attack success, and if so, what does this reveal about VLM safety mechanisms? To