IP-Bench: Benchmark for Image Protection Methods in Image-to-Video Generation Scenarios

Xiaofeng Li Leyi Sheng Zhen Sun Zongmin Zhang Jiaheng Wei Xinlei He · 2026

Read IP-Bench: Benchmark for Image Protection Methods in Image-to-Video Generation Scenarios by Xiaofeng Li Leyi Sheng Zhen Sun Zongmin Zhang Jiaheng Wei Xinlei He (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-26154.txt.

Introduction

Li and co-authors introduce IPV-Bench, a benchmark for methods that protect images from video generation abuse. A single photo can now be animated into a fake video. Protection methods add noise to block that, but tests of them are scattered and narrow. The bench scores protection strength, image fidelity, and resistance to cleanup attacks in one protocol. Its dataset spans five misuse-prone domains. Five methods face four video generators. Most fail to disrupt generation beyond noise, the authors find.

Catalog record

CREATORXiaofeng Li Leyi Sheng Zhen Sun Zongmin Zhang Jiaheng Wei Xinlei He
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37398
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.26154

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

IP-Bench: Benchmark for Image Protection Methods in Image-to-Video Generation Scenarios Xiaofeng Li Leyi Sheng Zhen Sun Zongmin Zhang Jiaheng Wei Xinlei He Abstract With the rapid advancement of image-to-video (I2V) generation models, their potential for misuse in creating malicious content has become a significant concern. For instance, a single image can be exploited to generate a fake video, which can be used to attract attention and gain benefits. This phenomenon is referred to as an I2V generation misuse . Existing image protection methods suffer from the absence of a unified benchmark, leading to an incomplete evaluation framework. Furthermore, these methods have not been systematically assessed in I2V generation scenarios and against preprocessing attacks, which complicates the evaluation of their effectiveness in real-world deployment scenarios. To address this challenge, we propose IP-Bench (Image Protection Bench) , the first systematic benchmark designed to evaluate protection methods in I2V generation scenarios. This benchmark examines 6 representative protection methods and 5 state-of-the-art I2V models. Furthermore, our work systematically evaluates protection methods’ robustness with two robustness attack strategies under practical scenarios and analyzes their cross-model & cross-modality transferability. Overall, IP-Bench establishes a systematic, reproducible, and extensible evaluation framework for image protection methods in I2V generation scenarios. Introduction Figure 1 : IP-Bench benchmarks image protection methods in terms of protection effectiveness, visual fidelity, robustness against attacks, and cross-model & cross-modality transferability. The figure shows the overall pipeline of our benchmark. Image-to-Video (I2V) generation has experienced rapid progress in recent years [ 9 , 30 ] , driven by the development of diffusion-based models such as seeddance2.0 [ 4 ] , and hunyuanVideo [ 17 ] . Specifically, I2V generation transforms static images into temporally coherent videos, pushing generative models beyond single-image synthesis. By drastically lowering the barrier of video creation, this technology facilitates diverse applications in entertainment [ 38 , 2 ] , education [ 22 ] , and content generation [ 34 ] . Ultimately, the ability to produce high-quality videos from simple inputs democratizes production, empowering individual creators and reshaping creative industries. Despite being powerful, I2V models may also introduce significant security risks, including the generation of deepfakes [ 27 , 39 ] and the dissemination of misinformation [ 23 ] . To mitigate these threats, prior research has proposed various image protection methods designed to prevent unauthorized content generation by I2V models [ 45 ] . Most existing methods adopt perturbation-based strategies, such as I2VGuard [ 11 ] and VGMShield [ 24 ] . These methods build upon earlier studies that aim to protect images from unauthorized editing by Image-to-Image (I2I) diffusion models, including PhotoGuard [ 32 ] , Mist [ 18 ] , and EditShield [ 6 ] . Despite the emergence of these image protection methods, existing assessments are often limited to specific models or single metrics, making it difficult to fairly compare different protection strategies or assess their generalization capabilities [ 43 ] .While some studies, such as EditShield [ 6 ] and Mist [ 18 ] , incorporate preprocessing attacks to evaluate the robustness of protection methods, others do not, leading to a lack of unified standards for assessing defensive resilience. To address this gap, we introduce IP-Bench (Image Protection Bench), the first systematic benchmark for image protection methods in I2V generation scenarios. We assess 6 protection methods (including both I2V-specific and I2I-based approaches) across 5 widely used I2V models featuring distinct structures, such as DiT and U-Net [ 26 , 31 ] . As illustrated in Figure 1 , our benchmark offers a systematic assessment framework covering multiple dimensions, including protection effectiveness, visual fidelity preservation, and robustness against preprocessing attacks. Additionally, we examine cross-model and cross-modality generalization to demonstrate the transferability of protection methods across different I2V model architectures and across different generation scenarios. Our results reveal distinct performance profiles among existing methods. Mist [ 18 ] provides the strongest protection but exhibits poor visual quality, with a degradation rate of 0.048 on SVD [ 3 ] . In contrast, EditShield [ 6 ] emphasizes image fidelity at the expense of defensive strength, achieving a high PSNR of 38.31. I2VGuard [ 11 ] demonstrates notable robustness against preprocessing attacks, maintaining a degradation rate above 0.02 across most models. VGMShield [ 24 ] demonstrates strong performance on specific models such as WAN [ 37 ] , achieving a degradation rate of 0.036. PhotoGuard [ 32 ] achieves a balanced performance, with a moderate PSNR of 31.77 and a degradation rate of 0.041 on Skyreel [ 5 ] . Furthermore, no existing method transfers effectively across different architectures, but PhotoGuard and Mist show a remarkable cross-modality transferability. These findings underscore a fundamental trade-off in image protection between protection effectiveness and visual quality. To summarize, we make the following contributions: • We propose IP-Bench , the first systematic benchmark that evaluates image protection methods through protection effectiveness, visual fidelity, robustness against preprocessing attacks, and cross-architecture transferability. • Our benchmark over 6 image protection methods reveals a fundamental trade-off between defensive effectiveness and visual quality: methods that strongly degrade model performance often noticeably reduce image fidelity. We also find that most existing methods are highly sensitive to simple preprocessing attacks and fail to transfer effectively across different model architectures. These findings highlight specific challenges of robustness under common transformations and cross-architecture generalization, which could guide the design of next-generation protection frameworks. • We release an extensible code framework for evaluating and developing image protection methods. Our framework allows researchers to easily plug in new protection methods and attack strategies. Using this framework, we demonstrate that certain methods degrade significantly under common preprocessing attacks, highlighting the need for more robust and transferable protection techniques. Table 1 : Overview of protection methods evaluated in IP-Bench. We evaluate a diverse set of defensive strategies, spanning specialized I2V protection, I2I-based methods, and a baseline. These methods target various components of the generation pipeline, including VAE encoders, temporal attention blocks, and feature embeddings. Method Type Strategy Target I2VGuard [ 11 ] I2V Adversarial perturbation SVD Temporal Attention Block & VAE Encoder VGMShield [ 24 ] I2V Feature-space PGD SVD 1st Layer Embedder & 4th Layer Embedder EditShield [ 6 ] I2I EOT optimization InstructPix2Pix VAE Encoder MIST [ 18 ] I2I Fused adversarial loss SD VAE & U-Net PhotoGuard [ 32 ] I2I Encoder perturbation SD VAE RandomNoise Baseline Uniform noise ( L_{\infty} , \epsilon=16/255 ) Pixel-level Input Space Table 2 : Overview of I2V models used in IP-Bench. We evaluate protection methods across 5 representative architectures, covering both U-Net and Diffusion Transformer (DiT) paradigms to ensure a comprehensive assessment of cross-model robustness. Model Architecture Key Characteristics SVD [ 3 ] U-Net Strong baseline, image-conditioned LTX [ 12 ] DiT Efficient, prompt-guided Skyreel [ 5 ] DiT High temporal coherence CogVideoX [ 42 ] DiT Strong semantic understanding Wan2.2 [ 37 ] DiT Efficient High-Definition Hybrid TI2V Related Work Image-to-Video Generation Models. Recent advances in diffusion models have significantly accelerated the development of Image-to-Video (I2V) generation. Existing approaches mainly differ in their backbone architectures. Early methods, such as Stable Video Diffusion (SVD) [ 3 ] , adopt a U-Net-based framework with a 3D VAE to model spatiotemporal representations. More recent works increasingly employ Diffusion Transformers (DiT) [

Read the complete text