Exploiting Vision Encoder Vulnerabilities for Universal Adversarial Perturbations on Large Vision-Language Models

Hee-seon Kim †, Minbeom Kim †, Seokil Ham, Changick Kim · 2024

Read Exploiting Vision Encoder Vulnerabilities for Universal Adversarial Perturbations on Large Vision-Language Models by Hee-seon Kim †, Minbeom Kim †, Seokil Ham, Changick Kim (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-08108.txt.

Introduction

Hee-seon Kim, Minbeom Kim, Seokil Ham, and Changick Kim found where vision encoders are soft to attack. Their paper, from twenty twenty-four, deals with large vision-language models. Tiny tweaks to an input image can throw such models off. Past attacks aim at the encoder's last output and treat the whole net as one flat surface. The team shows the soft spots are in fact bunched in set parts and layers, not spread even.

From that map they build a universal tweak that works across tasks at low cost. It aims at the weak parts they found. Readers in AI safety get a proof that guard work should watch the inner steps, not just the gate.

Catalog record

CREATORHee-seon Kim †, Minbeom Kim †, Seokil Ham, Changick Kim
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE64 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-08108

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Exploiting Vision Encoder Vulnerabilities for Universal Adversarial Perturbations on Large Vision-Language Models Hee-seon Kim †, Minbeom Kim †, Seokil Ham, Changick Kim Abstract Large Vision-Language Models (LVLMs) have achieved remarkable performance on multimodal tasks but remain highly vulnerable to small adversarial perturbations in input images. Existing attacks typically target the vision encoder’s final output embeddings, implicitly treating the encoder as a uniform attack surface, while a systematic analysis of which internal components are most vulnerable has remained largely unexplored. We show such analysis is essential, as adversarial vulnerability in LVLM vision encoders is structurally concentrated rather than uniformly distributed. Building on this, we propose Vision Encoder Vulnerable-Component-Targeted Universal Adversarial Perturbation (VEV-UAP), a task-agnostic and cost-efficient attack framework. Through a component- and layer-wise analysis of attention mechanisms, we identify the value components in middle layers as critical vulnerabilities that strongly influence downstream language model behavior. VEV-UAP selectively targets these components to generate a single universal perturbation shared across images, without involving textual inputs or the language model during optimization. Experiments across multiple LVLMs and tasks show VEV-UAP achieves state-of-the-art attack success rates with reduced computational overhead. Moreover, a single VEV-UAP transfers across LVLMs sharing the same vision encoder, even when paired with different language models, making it a practical framework for scalable robustness evaluation. I Introduction Following the success of Large Language Models (LLMs), Large Vision-Language Models (LVLMs) [ 1 , 2 , 3 , 4 , 5 , 6 , 7 , 8 , 9 , 10 ] have recently emerged. These models integrate LLMs with vision encoders that map visual representations into the textual feature space, typically by leveraging pretrained vision-language models [ 11 , 12 ] as vision encoders with LLM modules [ 13 , 14 ] . LVLMs have demonstrated strong performance across a wide range of multimodal tasks that require joint visual and textual understanding, including image classification, image captioning, and visual question answering (VQA) [ 15 , 16 , 17 , 18 , 19 ] . Fig. 1: Overview of VEV-UAP. (a) Rather than treating the vision encoder as a monolithic attack surface, we show that adversarial vulnerability in LVLMs is structurally concentrated. By identifying and targeting the most vulnerable components within the vision encoder, we construct a perturbation that efficiently propagates to downstream language representations while keeping the model frozen. (b) A single universal perturbation generalizes across images, tasks, and LVLMs that share the same vision encoder, indicating that the vulnerability reflects an architecture-level property. However, LVLMs are known to be highly sensitive to small perturbations in the input image, where even imperceptible noise can severely degrade the LVLM responses [ 20 , 21 , 22 , 23 , 24 , 25 , 26 , 27 ] . As these models are increasingly deployed in real-world and safety-critical applications, concerns regarding their robustness, particularly against adversarial attacks, have become increasingly significant. Therefore, systematically evaluating LVLMs using adversarial perturbations that can potentially compromise their behavior is an essential step toward building robust LVLM systems. To assess robustness against such perturbations, prior studies have primarily focused on constructing adversarial attacks that target the output embeddings of the vision encoder [ 20 , 21 , 22 , 23 , 24 ] . This strategy exploits a key architectural characteristic of LVLMs: the vision encoder’s output is directly projected into the language model, allowing adversarial effects introduced at the visual level to propagate to the language space. Therefore, most existing approaches optimize perturbations against the entire vision encoder through its final output embeddings, implicitly treating the encoder as a uniform attack surface. Yet which internal components are most vulnerable, and how strongly that choice shapes downstream language behavior, has remained largely unexplored. Through systematic component- and layer-wise analysis, we find that not all attention components within the vision encoder are equally vulnerable to adversarial perturbations. Some components exhibit strong robustness, such that perturbing the entire vision encoder dilutes adversarial effects and fails to sufficiently shift the downstream LLM representations needed to disrupt LVLM outputs. This observation indicates that adversarial vulnerability in LVLM vision encoders is structurally concentrated rather than uniformly distributed. As a result, indiscriminately targeting all components of the vision encoder can be both ineffective and inefficient. Moreover, most prior methods rely on image-specific adversarial perturbations, leading to high computational cost and limited scalability when evaluating robustness over large image sets. To address these limitations, we propose a novel adversarial attack framework termed Vision Encoder Vulnerable-Component-Targeted Universal Adversarial Perturbation (VEV-UAP) . Instead of perturbing the entire vision encoder, VEV-UAP selectively targets components that are particularly susceptible to adversarial manipulation. Through this systematic analysis, we find that the value vectors in the middle layers of the vision encoder are especially sensitive to perturbations, inducing pronounced discrepancies in the language feature space between clean and adversarially perturbed images. Motivated by this finding, we design adversarial perturbations that explicitly maximize the divergence between original and perturbed value features at these vulnerable layers. Furthermore, rather than generating image-specific adversarial perturbations, we adopt a universal adversarial perturbation (UAP) strategy that learns a single perturbation shared across multiple images. Overall, this design eliminates the need for per-image optimization and task-specific textual inputs or supervision, substantially reducing computational overhead and enabling scalable robustness evaluation over large image sets. Extensive experiments show that VEV-UAP consistently outperforms existing LVLM attack baselines, achieving state-of-the-art attack success rates with lower computational overhead. Beyond these performance gains, VEV-UAP provides a practical and scalable framework for robustness assessment in LVLMs by eliminating the need for per-image and per-prompt optimization. Moreover, a single universal perturbation transfers effectively across multiple models that share the same vision encoder, even when paired with different language models. Our contributions are summarized as follows: • Identification of vulnerable components in LVLM vision encoders. We conduct a systematic component- and layer-wise analysis of vision encoders and identify the value vectors at the middle layers as a key vulnerability through which adversarial effects propagate to the language model. • Universal adversarial perturbation for LVLMs. We propose VEV-UAP , a universal adversarial perturbation optimized solely on the vulnerable components of the vision encoder, which effectively disrupts language model responses without requiring textual inputs, enabling low-cost and task-agnostic attacks. • Efficient and transferable robustness evaluation. Experiments across multiple models and tasks show that VEV-UAP outperforms existing LVLM attack baselines with higher efficiency and transfers effectively across LVLMs sharing the same vision encoder, even with different language models. II Related Work II-A Large Vision-Language Models LVLMs [ 1 , 2 , 3 , 4 , 5 , 6 , 7 , 8 , 9 , 10 ] integrate visual information into LLMs [ 13 , 14 ] by using vision encoders from vision-language pre-training models (VLPMs) [ 11 , 12 ] . In contrast to traditional VLPMs such as CLIP [ 11 ] , which process image and text modalities independently using separate encoders, LVLMs project the output of the vision encoder into the LLM. This architectural design enables tighter integration of visual and textual information for multimodal reasoning. LLaVA [ 4 ] obtains the visual features with the pre-trained CLIP [ 11 ] vision encoder, and then projects them into the LLM along with the text prompt. LLaVA-1.5 [ 5

Read the complete text