Anti-I2V: Safeguarding your photos from malicious image-to-video generation
Duc VuAnh NguyenChi TranAnh Tran, Qualcomm AI Research {ducvu, anng, chitran, anhtra}@qti.qualcomm.com · 2026
Read Anti-I2V: Safeguarding your photos from malicious image-to-video generation by Duc VuAnh NguyenChi TranAnh Tran, Qualcomm AI Research {ducvu, anng, chitran, anhtra}@qti.qualcomm.com (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-24570.txt.
Introduction
Vu and co-authors present Anti-I2V, a defence that protects personal photos from malicious image-to-video generation. Diffusion video models can animate a person's photo from a text prompt, enabling fake videos. Prior defences target image models or older UNet designs, leaving transformer models underexplored. Anti-I2V adds crafted noise in colour and frequency domains, focusing on salient pixels. It targets the layers that capture the sharpest semantic features at denoising. The defence applies across diverse diffusion backbones, the authors report.
Catalog record
| CREATOR | Duc VuAnh NguyenChi TranAnh Tran, Qualcomm AI Research {ducvu, anng, chitran, anhtra}@qti.qualcomm.com |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53815 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.24570
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Anti-I2V: Safeguarding your photos from malicious image-to-video generation Duc VuAnh NguyenChi TranAnh Tran, Qualcomm AI Research {ducvu, anng, chitran, anhtra}@qti.qualcomm.com Abstract Advances in diffusion-based video generation models, while significantly improving human animation, poses threats of misuse through the creation of fake videos from a specific person’s photo and text prompts. Recent efforts have focused on adversarial attacks that introduce crafted perturbations to protect images from diffusion-based models. However, most existing approaches target image generation, while relatively few explicitly address image-to-video diffusion models (VDMs), and most primarily focus on UNet-based architectures. Hence, their effectiveness against Diffusion Transformer (DiT) models remains largely under-explored, as these models demonstrate improved feature retention, and stronger temporal consistency due to larger capacity and advanced attention mechanisms. In this work, we introduce Anti-I2V, a novel defense against malicious human image-to-video generation, applicable across diverse diffusion backbones. Instead of restricting noise updates to the RGB space, Anti-I2V operates in both the L L * a a * b b * and frequency domains, improving robustness and concentrating on salient pixels. We then identify the network layers that capture the most distinct semantic features during the denoising process to design appropriate training objectives that maximize degradation of temporal coherence and generation fidelity. Through extensive validation, Anti-I2V demonstrates state-of-the-art defense performance against diverse video diffusion models, offering an effective solution to the problem. 0 0 footnotetext: \dagger Qualcomm AI Research is an initiative of Qualcomm Technologies, Inc. 1 Introduction Recent advances in Video Diffusion Models (VDMs) 5 ; 3 ; 17 ; 57 ; 7 ; 8 ; 23 ; 19 enable realistic and coherent video generation from text prompts, and many models 24 ; 2 ; 67 ; 17 ; 56 further support image-based animation that preserves fine visual details while generating motion aligned with text. Despite impressive capabilities, these models pose significant misuse risks, as a single reference image can be used to create deepfakes or harmful content. Adversarial attacks have been explored as a defense by subtly perturbing input images to disrupt diffusion models. However, existing methods primarily target text-to-image or image-to-image generation 54 ; 29 ; 30 ; 49 ; 64 ; 63 , typically by maximizing denoising loss or degrading Variational AutoEncoder (VAE) 14 features. These approaches are insufficient for image-to-video generation, where the input image serves as the first frame and the core challenge is disrupting temporal consistency. Moreover, video diffusion models are larger and more resistant to adversarial noise. In contrast, adversarial attacks for image-to-video generation remain underexplored. VGMShield 43 perturbs reference images by disrupting image and video encoder features in Stable Video Diffusion (SVD), but merely distorting embeddings fails to effectively corrupt fine-grained details (e.g., human features) and generalizes poorly beyond SVD. DORMANT 70 targets pose-driven human animation by disrupting appearance features using CLIP and ReferenceNet while enforcing frame incoherence loss; however, it requires pose guidance, limiting its applicability to pose-driven models 25 ; 62 . More recent methods, such as Vid-Freeze 10 and I2VGuard 18 , suppress attention outputs through optimization-based objectives, but require high-end GPUs for effective optimization. Although existing methods show strong performance on specific models, their effectiveness on recent large-scale image-to-video frameworks remains unclear. State-of-the-art models such as CogVideo-X 24 and Open-Sora 69 adopt Diffusion Transformer (DiT) or Multi-Modal DiT (MM-DiT) architectures with larger capacity and stronger temporal modeling, leading to more robust and higher-quality video generation. While Vid-Freeze 10 and I2VGuard 18 evaluate CogVideo-X, conventional DiT-based frameworks like Open-Sora remain underexplored. Hence, we identify two key limitations in current attacks: (1) Perturbation optimization space: Most existing methods optimize perturbations in RGB space, primarily altering pixel intensities rather than deeper representations, making them easy to remove during denoising. Image transformations and purification methods 39 ; 68 ; 6 can further suppress such noise while preserving semantic content. (2) Propagation of features through layers: Prior approaches 30 ; 29 typically target only the final outputs of components such as the text encoder, VAE, or denoiser, overlooking how features propagate across layers within the VAE and UNet or Transformer-based denoising modules. To address these challenges, we propose Anti-I2V , a defense framework designed to prevent unauthorized image usage in diverse image-to-video diffusion models. First, we explore the impact of updating perturbations in the L * a * b * color space, focusing on the decorrelated a * and b * channels, in combination with the frequency domain. This approach offers an effective alternative to the conventional reliance on spatial RGB space. Second, Anti-I2V disrupts semantic feature extraction and propagation within the denoising network, explicitly at intermediate layers containing high-level representations. Furthermore, unlike previous work 30 ; 29 focusing solely on the final encodings, we introduce layer-wise semantic disruption across both the VAE and denoising modules. Lastly, we evaluate Anti-I2V on a human-focused image-to-video benchmark, using various state-of-the-art video generation backbones, confirming the effectiveness and versatility of the proposed algorithm. Our main contributions are summarized below: • We introduce Anti-I2V , a method to effectively prevent unauthorized image usage in image-to-video generation across multiple varieties of diffusion models. • We are the first to update perturbations in both the L^{*}a^{*}b^{*} color space and frequency domain , demonstrating enhanced effectiveness and robustness. • We analyze the semantic representations at individual layers within the denoising and VAE modules and introduce two tailored objectives, Inter Representation Collapse (IRC) and Inter Representation Anchor (IRA) . These objectives disrupt the internal feature representations of the diffusion model throughout the denoising process, leading to effective degradation of temporal coherence and generation fidelity. 2 Related Works 2.1 Video Diffusion Model Diffusion models (DMs) 21 ; 47 have enhanced the quality and realism of image generation 44 ; 28 ; 36 ; 11 ; 37 ; 34 . In recent years, efforts have been made to extend these advancements to video diffusion models (VDMs), enabling the generation of high-fidelity and temporally coherent videos. Early UNet-based diffusion models operated directly in the pixel space by introducing a space-time factorization approach, which decouples intra-frame spatial feature extraction from inter-frame temporal modeling 22 . To improve computational efficiency, later research shifted towards latent space operations or hybrid pixel-latent methods 66 . Many of these initial text-to-video (T2V) models enhanced large, pre-trained text-to-image (T2I) models by adding (2+1)D attention layers to manage spatial and temporal information 4 ; 57 ; 7 ; 8 ; 67 . More recently, the introduction of Diffusion Transformers (DiT) and Multimodal Diffusion Transformers (MMDiT) leads to state-of-the-art models like CogVideoX and OpenSora 24 ; 69 . These larger, highly scalable models utilize 3D full or sparse attention and temporally aware autoencoders, resulting in significantly robust and improved video generation. Alongside text-to-video, image-to-video generation has emerged as a key area, using images as conditional guidance to achieve higher-quality results with more precise control over characters and backgrounds 61 ; 24 ; 67 ; 69 ; 31 ; 20 . While this has led to realistic animations, it also presents a serious threat of misuse. The ability to generate unauthorized or harmful videos of individuals from photos sourced from the Internet or public datasets 65 ; 12 underscores the urgent need for effective protective mechanisms against misuse. 2.2 Adversarial Attacks Image Cloaking. Image cloaking is an adversarial defense technique that