MPF-Net: Exposing High-Fidelity AI-Generated Video Forgeries via Hierarchical Manifold Deviation and Micro-Temporal Fluctuations

Xinan He, Kaiqing Lin, Yue Zhou, Jiaming Zhong, Wei Ye, Wenhui Yi, Bing Fan, Feng Ding, Haodong Li, Bo Cao, Bin Li · 2026

Read MPF-Net: Exposing High-Fidelity AI-Generated Video Forgeries via Hierarchical Manifold Deviation and Micro-Temporal Fluctuations by Xinan He, Kaiqing Lin, Yue Zhou, Jiaming Zhong, Wei Ye, Wenhui Yi, Bing Fan, Feng Ding, Haodong Li, Bo Cao, Bin Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-21408.txt.

Introduction

Xinan He and ten co-authors build a detector for fake videos made by the newest generators. Tools like Veo and Wan now make clips so clean that the old giveaways are gone. Gross errors in meaning and flicker across frames no longer betray a fake.

The team hunts subtler traces instead. Their method reads how a clip sits on the learned manifold of real video, layer by layer. It also tracks tiny wobbles across time that humans miss. Finding reliable traces matters for news, courts, and platforms that must tell real footage from synthetic clips.

Catalog record

CREATORXinan He, Kaiqing Lin, Yue Zhou, Jiaming Zhong, Wei Ye, Wenhui Yi, Bing Fan, Feng Ding, Haodong Li, Bo Cao, Bin Li
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-21408

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MPF-Net: Exposing High-Fidelity AI-Generated Video Forgeries via Hierarchical Manifold Deviation and Micro-Temporal Fluctuations Xinan He, Kaiqing Lin, Yue Zhou, Jiaming Zhong, Wei Ye, Wenhui Yi, Bing Fan, Feng Ding, Haodong Li, Bo Cao, Bin Li Abstract With the rapid advancement of video generation models such as Veo and Wan, the visual quality of synthetic content has reached a level where macro-level semantic errors and temporal inconsistencies are no longer prominent. However, this does not imply that the distinction between real and cutting-edge high-fidelity fake is untraceable. We argue that AI-generated videos are essentially products of a manifold-fitting process rather than a physical recording. Consequently, the pixel composition logic of consecutive adjacent frames residual in AI videos exhibits a structured and homogenous characteristic. We term this phenomenon ‘Manifold Projection Fluctuations’ (MPF) . Driven by this insight, we propose a hierarchical dual-path framework that operates as a sequential filtering process. The first, the Static Manifold Deviation Branch , leverages the refined perceptual boundaries of Large-Scale Vision Foundation Models (VFMs) to capture residual spatial anomalies or physical violations that deviate from the natural real-world manifold (off-manifold). For the remaining high-fidelity videos that successfully reside on-manifold and evade spatial detection, we introduce the Micro-Temporal Fluctuation Branch as a secondary, fine-grained filter. By analyzing the structured MPF that persists even in visually perfect sequences, our framework ensures that forgeries are exposed regardless of whether they manifest as global real-world manifold deviations or subtle computational fingerprints. 1 Introduction Figure 1 : Proposed hierarchical dual-path forensic framework based on manifold and MPF Analysis. The recent surge in high-fidelity video generation models, exemplified by Sora2, Veo, and Wan, has pushed the quality boundaries of synthetic media to an unprecedented level. By achieving long-range temporal coherence and cinematic realism, synthetic content is now reaching a stage where macro-level semantic errors are no longer prominent, posing an immense challenge to digital forensics as fake videos become virtually indistinguishable from reality through content logic alone. Earlier forensic research ( 10 ; 25 ) primarily focused on identifying blatant physical law violations and semantic distortions resulting from the sparse fitting of generative models on the data manifold. However, we argue that the key to modern forensics lies not in these transient defects, which are easily ‘smoothed out’ through model scaling, but in the unavoidable intrinsic artifacts embedded within the generation process itself. The fundamental distinction between real-world content and AI-generated video: real-world content is an authentic recording of physical laws, while AI video is a computational mapping of a learned manifold. We project this discrepancy onto the frame residual features of consecutive frames to expose the forgery. In real videos, frame residuals maintain high pixel stability due to the constant photon counts on the sensor, yet remain subject to uncontrollable physical variables such as mechanical jitter and light refraction. Consequently, real-world frame residuals are unstructured and heterogeneous , characterized by high-entropy stochastic noise. In contrast, AI video generation relies on temporal conditioning and historical frame knowledge. Regardless of whether the content is on or off the natural manifold, the reconstruction logic is governed by fixed model weights, leading to structured and homogenous residual patterns. We define this phenomenon as Manifold Projection Fluctuations (MPF). However, the efficacy of probing these micro-temporal artifacts is highly correlated with the video’s frame rate (FPS) and generation quality. For ‘off-manifold’ videos, those characterized by low FPS, poor resolution, and significant high-level semantic distortions, the MPF signals are often obscured by catastrophic perturbations. Inspired by the findings of ( 27 ; 21 ) , we acknowledge that Large-Scale Vision Foundation Models (VFMs) possess an inherent sensitivity to the distribution of the real-world manifold. As the training data of a VFM becomes more extensive, its perceptual boundaries for identifying synthetic patterns become increasingly refined. These models can efficiently ‘deviate’ off-manifold samples by leveraging their dense internal projection of the natural world, even when temporal signals are corrupted. Figure 2 : T-SNE visualization of the hierarchical feature spaces. In Branch I (left), while off-manifold samples with significant distortions are clearly deviated, high-fidelity ‘on-manifold’ samples heavily overlap with the real-world distribution. In Branch II (right), the same on-manifold samples exhibit distinct, separable clustering when projected into the MPF-based feature space. Building upon these insights, we propose a hierarchical dual-path framework that operates as a sequential filtering process. We categorize the current landscape of AI videos into two distinct branches: 1. Branch I: Static Manifold Deviation . For low-quality, off-manifold samples exhibiting clear semantic or spatial anomalies, we deploy a branch that leverages the refined perceptual boundaries of scaled VFMs. This stage acts as a ‘sentinel’, efficiently capturing forgeries that deviate from the natural data distribution. 2. Branch II: Micro-Temporal Fluctuation . For high-fidelity, on-manifold samples that flawlessly emulate spatial realism, we introduce a second branch dedicated to MPF analysis. By scrutinizing the micro-temporal residuals for structured homogeneity, this ‘microscope’ stage exposes the deterministic computational DNA that spatial-only detectors fail to perceive. We validate this hierarchical logic through t-SNE visualizations of the feature spaces (ref to Fig. 2 ). In Branch I, while the VFM effectively isolates videos with obvious semantic distortions (off-manifold), there remains a significant overlap between high-fidelity synthetic samples and authentic data. In Branch II, however, the same high-fidelity samples when projected through our MPF-based feature space exhibit clear, separable clustering. 2 Related Work Figure 3 : Synthetic Videos that lies on Generator’s Coarse Manifold ( M_{Gen} ) but deviate from the structure of Real-World Manifold ( M_{real} ). Video forgery detection has evolved through several distinct paradigms, shifting from high-level visual inspection to the analysis of underlying physics. Detection via Semantic Distortions and Inconsistencies. Early forensic methodologies primarily focused on identifying spatial semantic distortions and temporal inconsistencies. DeCof ( 16 ) demonstrated that capturing temporal artifacts offers superior generalizability compared to purely spatial analysis. HumanSAM ( 14 ) further refined this by categorizing anomalies into spatial, appearance, and motion dimensions. To highlight spatial and temporal anomalies, AIGVDet ( 1 ) introduced optical flow analysis to expose motion incoherence, while Corvi et al. ( 6 ) utilized the 3D Fourier transform of video residuals to identify distinctive spectral peaks in synthetic content. Recent approaches have integrated Vision-Language Models (VLMs) to emulate human reasoning. For instance, Skyra ( 13 ) actively searches for intrinsic, physics-violating artifacts. However, with architectural innovations like Diffusion Transformers (DiTs) and the explosion of high-quality training data, models such as Wan and Veo have largely eliminated these macro-level semantic distortions, rendering content-based reasoning increasingly obsolete. Detection via Physical Constraints and Curvature. To move beyond fragile semantic features, researchers have begun investigating the intrinsic physical constraints that distinguish real-world captures from generative fits. NSG-VD ( 25 ) proposed the Normalized Spatiotemporal Gradient (NSG) based on the principle of probability flow conservation, utilizing pre-trained diffusion models to estimate discrepancies between spatial gradients and temporal density changes. Based on the ‘perceptual straightening’ hypothesis, ResTraV ( 10 ) calculates the geometric curvature and distance of temporal trajectories within the frozen DINOv2 feature space. The core philosophy of these methods is that AI fits statistical distributions rather than simulating the deterministic physical paths of light. Nevertheless, as generative models are trained on increasingly vast datasets, they have begun to statistically perfectly

Read the complete text