Video as Natural Augmentation: Towards Unified AI-Generated Image and Video Detection

Zhengcen Li, Chenyang Jiang, Liangxu Su, Tong Shao, Shiyang Zhou, Ming Tao, Jingyong Su · 2026

Read Video as Natural Augmentation: Towards Unified AI-Generated Image and Video Detection by Zhengcen Li, Chenyang Jiang, Liangxu Su, Tong Shao, Shiyang Zhou, Ming Tao, Jingyong Su (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-21977.txt.

Introduction

Zhengcen Li and co-authors tackle a failure of AI-generated image detectors on video frames, presenting Video as Natural Augmentation. Top image detectors often collapse on video frames, though a detector should hold up across sources, pipelines, and modalities. Their analysis traces the collapse, then builds VINA with video-frame augmentation and a cross-modal contrastive objective that aligns image and video representations under one real-or-fake boundary. Across 14 benchmarks spanning image, video, and in-the-wild data, VINA gains in both directions and leads nearly every setting.

Catalog record

CREATORZhengcen Li, Chenyang Jiang, Liangxu Su, Tong Shao, Shiyang Zhou, Ming Tao, Jingyong Su
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE66511
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.21977

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Video as Natural Augmentation: Towards Unified AI-Generated Image and Video Detection Zhengcen Li, Chenyang Jiang, Liangxu Su, Tong Shao, Shiyang Zhou, Ming Tao, Jingyong Su Abstract AI-generated content (AIGC) is rapidly improving, creating an urgent need for detectors that generalize across data sources, deployment pipelines, and visual modalities. A strongly generalizable detector should remain robust under distributional variations. However, we identify a consistent failure mode: SOTA AI-generated image detectors often collapse when applied to frames extracted from videos. Through systematic analysis, we show that this cross-modal gap arises from both entangled synthesis-agnostic video processing shifts, including color conversion, codec compression, resizing, and blur, and model-specific fingerprints introduced by modern video generators. Motivated by these findings, we propose VINA ( VI deo as N atural A ugmentation), a unified AIGC detection framework that jointly trains on image and video data. VINA uses video frames as physically grounded natural augmentations and further introduces a cross-modal supervised contrastive objective to align image and video representations under a shared real/fake decision boundary. Extensive experiments on 14 image, video, and in-the-wild benchmarks show that VINA delivers bidirectional gains, improves robustness and transferability, and achieves state-of-the-art performance across nearly all evaluated settings without complex augmentation or dataset-specific tuning. 1 Introduction Recent advances in AI-generated content (AIGC) have enabled diffusion models and large-scale transformers to produce highly realistic and semantically consistent images [ 14 ] and videos [ 2 ] . As generation quality improves, synthetic media increasingly blurs the boundary between authentic and generated content, lowering the cost of creating persuasive misinformation at scale and weakening public trust [ 55 ] . The broad availability of both image and video generation models and products therefore creates an urgent demand for accurate, robust, and broadly generalizable detectors that can operate reliably in diverse real-world settings. Figure 1 : Motivation and benchmark performance of unified AIGC detection. Left: Asymmetric cross-modal failures motivate VINA to learn from both image and video data. Right: Average accuracy across image, video, and in-the-wild AIGC benchmarks shows that image-based detectors degrade sharply on videos, while joint training improves cross-modal generalization. Generalization is the central challenge in AIGC detection. A practical detector must transfer across generators, data sources, and deployment pipelines, especially to in-the-wild media whose provenance and post-processing history are unknown. Existing AI-generated image (AIGI) detectors mainly exploit local pixel artifacts [ 50 ] , frequency-domain traces [ 31 ] , reconstruction behavior [ 8 ] , or high-level semantics [ 39 , 61 ] . Recent work further improves generalization through data alignment [ 7 ] , where diffusion or VAE models inject controlled synthetic traces into real images at the pixel [ 18 ] or frequency level [ 9 ] . Although these methods improve cross-generator and cross-dataset transfer, their performance still deteriorates under unseen generators [ 11 ] , real-world online samples [ 60 ] , and media subjected to heavy compression or platform degradation [ 30 ] . This indicates that current detectors remain vulnerable to shortcut cues and distribution shifts that are not tied to synthesis itself. In this paper, we identify a novel systematic failure mode: state-of-the-art AIGI detectors collapse when evaluated on video frames. As summarized in the left and right panels of Figure 1 , image-trained detectors that perform competitively on image benchmarks often drop sharply on AI-generated video (AIGV) benchmarks, with several methods approaching random guessing. This failure persists even for recent detectors designed for stronger cross-generator transfer, showing that the problem is not merely a matter of unseen generators. Meanwhile, dedicated AIGV detectors [ 5 , 63 , 56 ] remain relatively underexplored and often fail to preserve strong image-domain generalization. In practice, a AIGC detector cannot assume its input is a clean image; it may receive a frame extracted from a compressed video or an image after online platform degradation. These observations suggest that treating AIGI and AIGV detection as separate tasks leaves a fundamental cross-modal generalization gap. We analyze this failure from the properties of real video data. Video frames are not simply still images sampled from another generator distribution. They are produced by real acquisition, rendering, compression, and distribution pipelines. Compared with common image datasets, video frames contain stronger synthesis-agnostic shifts, including realistic imaging and motion blur, codec-induced frequency decay, limited-range color conversion, resizing, and repeated platform recompression. They also cover more diverse scenes and camera motions, while modern video generators introduce additional model-specific fingerprints related to temporal modules and motion synthesis. These factors suppress high-frequency micro-artifacts that image detectors often exploit as shortcuts, while introducing low- and mid-frequency statistics that are underrepresented in image-only training. We therefore view video frames as physically grounded natural augmentations: they expose detectors to realistic degradations that are difficult to reproduce with handcrafted JPEG, blur, or color perturbations. To address this gap, we propose VINA ( VI deo as N atural A ugmentation), a joint video–image training framework for unified AIGC detection. VINA augments existing image training sets [ 54 , 67 , 7 ] with AIGV detection data [ 5 , 33 ] and trains a single detector for both image and video inputs. Beyond binary supervision on mixed batches, we introduce a cross-modal supervised contrastive (CM-SupCon) loss that aligns image and video features with the same real/fake label while preserving the decision boundary. This regularizes the unified representation space, reduces reliance on modality- or source-specific shortcuts, and encourages the detector to use generative traces that remain discriminative across both clean images and degraded video frames. Extensive experiments show bidirectional gains: joint training substantially improves video detection while also improving image and in-the-wild performance. Without complex augmentation, explicit alignment, or dataset-specific tuning, VINA achieves strong state-of-the-art results across multiple backbones and data-source combinations, reaching 90.4% average accuracy on video benchmarks, 94.1% on image benchmarks, and 92.9% on in-the-wild benchmarks. Our contributions are summarized as follows. 1. We reveal that state-of-the-art AIGI detectors systematically fail on video benchmarks, formulate unified AIGC detection as a generalization problem, and show that training and evaluation should jointly cover AI-generated images and videos rather than treating them as isolated tasks. 2. We propose VINA, a joint video–image training framework with a CM-SupCon objective that regularizes image and video representations under a unified decision boundary, suppressing source- and modality-specific shortcut cues. 3. Extensive experiments across 14 image, video, and in-the-wild benchmarks show that VINA brings bidirectional gains for both videos and images, substantially improves in-the-wild robustness, and generalizes across multiple backbones and data sources without complex augmentation, explicit alignment, or dataset-specific tuning. 2 Related Work 2.1 Generative Models Image Generative Models. Image generation has evolved from GAN-based models [ 17 ] to VAE/VQ-VAE frameworks [ 25 , 53 ] and diffusion models [ 19 ] . Latent Diffusion Models (LDMs) [ 46 ] improve efficiency by denoising in a compressed latent space, while recent Diffusion Transformers (DiTs) [ 42 ] , autoregressive models [ 52 ] and unified models [ 12 ] further improve scalability with transformer-based architectures. Video Generative Models. Video generation extends image generation to the spatiotemporal domain. Early systems such as Make-A-Video [ 48 ] and Stable Video Diffusion [ 1 ] adapt image diffusion backbones with temporal modeling. Recent representative systems, including Sora [ 2

Read the complete text