UIBDiffusion: Universal Imperceptible Backdoor Attack for Diffusion Models
Yuning Han Bingyin Zhao Rui Chu Feng Luo Biplab Sikdar Yingjie Lao · 2024
Read UIBDiffusion: Universal Imperceptible Backdoor Attack for Diffusion Models by Yuning Han Bingyin Zhao Rui Chu Feng Luo Biplab Sikdar Yingjie Lao (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-11441.txt.
Introduction
Yuning Han and five co-authors present a 2024 attack on diffusion models, the AI systems that make images from noise. A backdoor attack plants a hidden trigger: when the trigger shows, the model makes a set target image. Past triggers, like a gray box or glasses, were easy to spot by eye and easy for defenses to catch.
The team's attack, UIBDiffusion, builds its trigger from the same kind of faint noise used to fool image classifiers. The noise is so slight that people cannot see it, yet it works as a trigger. One trigger served for all test images and for many model types. Attack success matched or beat older attacks at low poison rates, and image quality held up. The attack also slipped past two leading defense tools.
Catalog record
| CREATOR | Yuning Han Bingyin Zhao Rui Chu Feng Luo Biplab Sikdar Yingjie Lao |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-11441
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
UIBDiffusion: Universal Imperceptible Backdoor Attack for Diffusion Models Yuning Han Bingyin Zhao Rui Chu Feng Luo Biplab Sikdar Yingjie Lao Abstract Recent studies show that diffusion models (DMs) are vulnerable to backdoor attacks. Existing backdoor attacks impose unconcealed triggers (e.g., a gray box and eyeglasses) that contain evident patterns, rendering remarkable attack effects yet easy detection upon human inspection and defensive algorithms. While it is possible to improve stealthiness by reducing the strength of the backdoor, doing so can significantly compromise its generality and effectiveness. In this paper, we propose UIBDiffusion, the u niversal i mperceptible b ackdoor attack for diffusion models, which allows us to achieve superior attack and generation performance while evading state-of-the-art defenses. We propose a novel trigger generation approach based on universal adversarial perturbations (UAPs) and reveal that such perturbations, which are initially devised for fooling pre-trained discriminative models, can be adapted as potent imperceptible backdoor triggers for DMs. We evaluate UIBDiffusion on multiple types of DMs with different kinds of samplers across various datasets and targets. Experimental results demonstrate that UIBDiffusion brings three advantages: 1) Universality , the imperceptible trigger is universal (i.e., image and model agnostic) where a single trigger is effective to any images and all diffusion models with different samplers; 2) Utility , it achieves comparable generation quality (e.g., FID) and even better attack success rate (i.e., ASR) at low poison rates compared to the prior works; and 3) Undetectability , UIBDiffusion is plausible to human perception and can bypass Elijah and TERD, the SOTA defenses against backdoors for DMs. We will release our backdoor triggers and code. 1 Introduction Diffusion models (DMs) [ 1 , 2 , 3 ] have emerged as the state-of-the-art generative paradigm in recent years and achieved unprecedented success in image [ 4 , 5 ] , video [ 6 , 7 , 8 ] text [ 9 , 10 , 11 ] and audio [ 12 , 13 , 14 , 15 , 16 , 17 ] synthesis. The success is highly attributed to training the foundation model on large-scale datasets [ 5 ] . Such a practice places DMs at risk of being compromised by data poisoning attacks [ 18 , 19 , 20 ] , where adversaries contaminate the clean training dataset with a small fraction of malicious samples and undermine model performance. This imposes a critical security concern on the practical deployment of DMs. Backdoor attacks are emerging threats to DMs. Recent studies [ 21 , 22 , 23 ] show that DMs are vulnerable to such attacks, which implant backdoor into victim models by training them on poisoned datasets and manipulate their behavior through inputs stamped with predefined triggers. Existing backdoor attacks for DMs usually employ unconcealed triggers such as a gray box, an image of Hello Kitty, and eyeglasses in the forward and reversed (i.e., sampling) diffusion process, as shown in Fig. 1 . While such trigger designs achieve superior attack performance and preserve the decent generation ability of victim models, they are easy to detect via human inspection and advanced defensive algorithms as they have obvious patterns that can be precisely remodeled via reverse engineering [ 24 , 25 ] . Motivated by this observation, we aim to design a general, powerful yet stealthy trigger. However, even for the traditional backdoor attacks against discriminative models (e.g., image classifiers) [ 26 , 27 , 28 ] , it is challenging to acquire such a trigger since it either requires complex and carefully designed generators to generate image-specific or model-specific triggers [ 29 , 30 , 31 , 32 , 33 ] or suffers from a relatively low attack success rate (ASR) [ 34 , 35 ] , or fails to evade modern defenses [ 36 , 37 , 38 , 39 , 40 ] . This raises an interesting question in backdoor attacks against DMs: Is there a trigger simultaneously possessing generality, effectiveness, and stealthiness for backdoor attacks against DMs? Figure 1 : Illustrations of the forward diffusion process (top block with the yellow background) and backward diffusion process (bottom block with the blue background) of a clean diffusion model (blue dash line), VillanDiffusion [ 23 ] (red dash line) and UIBDiffusion (Ours, green dash line). The UIBDiffusion trigger ( \uptau ) is plausible to humans in all phases from data poisoning to forward diffusion and backward diffusion while the glasses trigger ( \mathbf{g} ) in prior works is perceptible. UIBDiffusion trigger is highly effective since it introduces a similar distribution shift as the glasses trigger, which secures the attack performance during the backward diffusion process. However, it is hard to detect as the trigger does not possess specific patterns and cannot be inverted by existing defensive algorithms. We empirically verify the effectiveness in Section 4 . Driving by the question, in this work, we propose UIBDiffusion, the universal imperceptible backdoor triggers for DMs that bring the following advantages: 1) Universality : the trigger is image-agnostic and model-agnostic so that it can be applied to arbitrary images and DMs; 2) Utility : the trigger can achieve high ASR while maintaining the generation capability of DMs; 3) Undetectability : the trigger is plausible to humans and capable of circumventing state-of-the-art defenses. Inspired by the adversarial perturbation [ 41 ] originally designed for attacking pre-trained image classifiers, we reveal that universal adversarial perturbations [ 42 ] (UAPs), a variant of adversarial perturbations, naturally hold the aforementioned properties and can be adapted as the UIBDiffusion triggers. First, UAPs are image-agnostic and model-agnostic. Second, we demonstrate that they are effective triggers because they introduce a similar distribution shift as prior works, yet they are stealthy because they do not possess clear patterns and are hard to estimate by existing trigger inversion algorithms. Moreover, they are trivial and imperceptible noises that humans can barely identify, as shown in Fig. 1 . Our contributions are summarized as follows: • To the best of our knowledge, UIBDiffusion is the first imperceptible backdoor attack against diffusion models. • We discover that adversarial perturbations designed for discriminative models can be adapted as backdoor triggers for generative models . We reveal why such triggers can achieve high ASR and evade SOTA defenses. • We propose a practical trigger generation approach adapted from UAP, which is specifically designed to enhance universality, attack effectiveness and accessibility of triggers. • We experimentally demonstrate that UIBDiffusion is highly effective towards multiple diffusion models with different samplers and achieves comparable generation quality on benign input compared to clean DMs and superior attack success rate and input stealthiness compared to prior works. Moreover, • While existing works face a trade-off between utility and undetectability, we empirically show that UIBDiffusion triggers are highly resistant to the SOTA trigger inversion-based defenses, effectively bypassing Elijah [ 24 ] and TERD [ 25 ] , the state-of-the-art defenses against backdoors on DMs. 2 Related Works 2.1 Diffusion Models Diffusion models are latent variable models composed of two processes. The forward diffusion process imposes Gaussian noise on input data in each time step along the Markov chain and progressively diffuses the data distribution to an isotropic Gaussian distribution. The backward diffusion process is a reversed Markov chain that gradually denoises the sampled