Adversarial-Guided Diffusion for Multimodal LLM Attacks

Chengwei Xia, Fan Ma, Ruijie Quan, Kun Zhan, Yi Yang1. School of Information Science and Engineering, Lanzhou University2. College of Computer Science and Technology, Zhejiang University3. College of Computing and Data Science, Nanyang Technological University https://github.com/kunzhan/AGD · 2025

Read Adversarial-Guided Diffusion for Multimodal LLM Attacks by Chengwei Xia, Fan Ma, Ruijie Quan, Kun Zhan, Yi Yang1. School of Information Science and Engineering, Lanzhou University2. College of Computer Science and Technology, Zhejiang University3. College of Computing and Data Science, Nanyang Technological University https://github.com/kunzhan/AGD (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-23202.txt.

Introduction

Xia and four co-authors built a trick in twenty twenty-five to make fake pics that fool vision-word models while staying close to the true pic. Stock tricks hide their noise in fine detail, where plain filters can wash it out. Their way bakes the fake sense into the maker's noise step.

Since that noise spans all detail bands, the fake sense does too. The end pic blends true pic and noise, so low-pass filters spare the fake part. Tests beat top past tricks on hit rate. The fakes also stood up to more guards, they report.

Catalog record

CREATORChengwei Xia, Fan Ma, Ruijie Quan, Kun Zhan, Yi Yang1. School of Information Science and Engineering, Lanzhou University2. College of Computer Science and Technology, Zhejiang University3. College of Computing and Data Science, Nanyang Technological University https://github.com/kunzhan/AGD
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-23202

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Adversarial-Guided Diffusion for Multimodal LLM Attacks Chengwei Xia, Fan Ma, Ruijie Quan, Kun Zhan, Yi Yang1. School of Information Science and Engineering, Lanzhou University2. College of Computer Science and Technology, Zhejiang University3. College of Computing and Data Science, Nanyang Technological University https://github.com/kunzhan/AGD Abstract This paper addresses the challenge of generating adversarial image using a diffusion model to deceive multimodal large language models (MLLMs) into generating the targeted responses, while avoiding significant distortion of the clean image. To address the above challenges, we propose an adversarial-guided diffusion (AGD) approach for adversarial attack MLLMs. We introduce adversarial-guided noise to ensure attack efficacy. A key observation in our design is that, unlike most traditional adversarial attacks which embed high-frequency perturbations directly into the clean image, AGD injects target semantics into the noise component of the reverse diffusion. Since the added noise in a diffusion model spans the entire frequency spectrum, the adversarial signal embedded within it also inherits this full-spectrum property. Importantly, during reverse diffusion, the adversarial image is formed as a linear combination of the clean image and the noise. Thus, when applying defenses such as a simple low-pass filtering, which act independently on each component, the adversarial image within the noise component is less likely to be suppressed, as it is not confined to the high-frequency band. This makes AGD inherently robust to variety defenses. Extensive experiments demonstrate that our AGD outperforms state-of-the-art methods in attack performance as well as in model robustness to some defenses. 1 Introduction Multimodal large language models (MLLMs) have achieved superior performance across various tasks [ 21 , 2 , 47 , 24 , 43 ] . However, recent studies have shown that the integration of image modality in MLLM increases their susceptibility to adversarial attacks. In particular, MLLM can be easily misled by adversarial image, which are injected by introducing imperceptible perturbations to the clean image [ 46 , 6 , 25 ] . These findings highlight the importance of studying the MLLM adversarial attack. Figure 1 : AGD injects the target information in a manner that is visually imperceptible, while also maintaining effectiveness against defense mechanisms. (a) Although AdvDiffVLM successfully attacks MLLM, the target (motorcycle) is easily detectable, as shown by the red bounding box. (b) In contrast to AdvDiffVLM, AGD successfully attacks MLLM while maintaining imperceptibility. (c) AdvDiffVLM is defended by a defense mechanism [ 27 ] and its target still easily detectable. (d) Under the same defense mechanism [ 27 ] , AGD not only successfully attacks MLLM but also effectively hides the target. It is natural to consider injecting imperceptible perturbations into the high-frequency components of the clean image [ 46 , 43 ] . Injecting target information into high-frequency components preserves essential visual content, avoiding significant distortion of the original image [ 29 ] . However, such perturbations are often vulnerable to simple low-pass filtering defenses, which can effectively remove high-frequency noise. This leads to suboptimal attack robustness and degraded performance, limiting the utility of these attack methods for evaluating robustness. Most existing diffusion-based adversarial attack [ 3 , 7 , 4 , 15 ] methods generate adversarial images with image fusion in all reverse-diffusion process, inducing significant perturbations that make the adversarial image overly noticeable to users, triggering defense mechanisms [ 27 ] as shown in Figure 1 . In this paper, the adversarial image is generated through a few adversarial-guided diffusion (AGD) steps of the reverse-diffusion process in a text-to-image generative diffusion model. Specifically, AGD guides the injection of target information into the clean image during the final few steps. By fully embedding the target information into the adversarial image, a momentum-based gradient update simulates the iterative denoising process to find the optimal adversarial direction. AGD ensures attack efficacy while minimizing perturbations. Moreover, AGD embeds targets across the all frequency bands, unlike conventional methods that focus on high-frequency components [ 29 ] , ensuring that the adversarial image of AGD is less likely to be smoothed out by defense mechanisms, thereby maintaining robustness. The contributions of this paepr are summarized as follows: • We propose an adversarial-guided diffusion (AGD) method to generate adversarial images by injecting targeted semantic information. AGD is effective not only in generating high-quality adversarial image close to the clean image but also in defending against defense mechanism. • Based on the key observation of previous attack, AGD ensures attack robustness while maintaining high fidelity by injecting target into noise, providing a novel perspective for performing targeted adversarial attacks on MLLMs. • Experiments conduct on several popular open-source MLLMs demonstrate that AGD outperforms previous state-of-the-art (SOTA) attack methods. Figure 2 : Flowchart of the proposed adversarial-guided diffusion process. We perform forward noise addition on the clean image. During the reverse diffusion process, we execute step-by-step denoising from step T to \Delta to reconstruct the original clean image, ensuring the constraint is largely satisfied. In the adversarial-guided diffusion process, we inject target information into noise from \Delta to 1. The resulting image closely approximates the clean image’s structure while injecting the target semantics. 2 Related Work Adversarial attack on MLLMs. Adversarial attacks [ 13 ] typically function by introducing imperceptible perturbations into clean images, result in misleading the targeted responses [ 13 , 20 , 10 ] . In the case of MLLMs, robustness of MLLMs is highly dependent on their most vulnerable input visual modality. Attackers can exploit the inherent weaknesses within the model’s visual structure to craft adversarial images. Adversarial attacks on MLLMs are generally categorized into two types: black-box [ 46 , 11 , 1 ] and white-box attacks [ 34 , 12 , 6 ] . According to the attack objectives, these can further be divided into untargeted [ 32 , 6 ] and targeted attacks [ 46 , 40 , 43 ] . Compared to the white-box access scenario, the scenario in which adversaries have only black-box access and seek to deceive the model into returning the targeted responses represents the most realistic and high-risk scenario. For the black-box access open-source MLLMs, AttackVLM [ 46 ] provides a comprehensive evaluation of the robustness of them to highlights the challenges of targeted adversarial attacks on MLLMs. CoA [ 43 ] enhances the generation of adversarial examples by a multi-modal semantic fusion strategy. But this pixel-based attack directly disturbs pixel space easily to be perceived and defended. Diffusion-based unrestricted adversarial attack. Due to the \ell_{p} -norm distance is inadequate to capture how human perceive perturbation accurately [ 3 , 33 , 44 ] , a number of unrestricted attack methods have been proposed to improve pixel-based attack methods. In recent, diffusion models have been introduced into adversarial attack research due to it’s [ 17 , 36 , 38 ] capable of generating natural and diverse outputs. Diffusion-based unrestricted methods such as AdvDiff [ 7 ] and AdvDiffVLM [ 15 ] incorporate adversarial guidance during the reverse-diffusion process by injecting adversarial gradients, enabling the generation of adversarial images. Similarly, AdvDiffuser [ 3 ] applies Projected Gradient Descent (PGD) [ 26 ] within the reverse-diffusion process. However, methods like and AdvDiffuser, which inject adversarial semantics at each step in the reverse-diffusion process, tend to significantly degrade the quality of the generated images. AdvDiffVLM adds adversarial

Read the complete text