Rethinking Feature Conditioning for Robust Forged Media Detection in Edge AI Sensing Systems

Izaldein Al-Zyoud 1 , Member, IEEE, and Abdulmotaleb El Saddik 1 , Fellow, IEEE · 2026

Read Rethinking Feature Conditioning for Robust Forged Media Detection in Edge AI Sensing Systems by Izaldein Al-Zyoud 1 , Member, IEEE, and Abdulmotaleb El Saddik 1 , Fellow, IEEE (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-26387.txt.

Introduction

Al-Zyoud and El Saddik probe how feature conditioning shapes forged media detection at the frozen layer of a vision model. They run the first controlled study of this kind on DINOv3 ConvNeXt backbones. With the backbone, head, data, and training all fixed, they vary only how features are conditioned. On FaceForensics++ tests, conditioning alone shifts mean scores by 6.1 points and can flip which setup wins in new domains. Their results warn that the best in-domain choice may fail on outside data.

Catalog record

CREATORIzaldein Al-Zyoud 1 , Member, IEEE, and Abdulmotaleb El Saddik 1 , Fellow, IEEE
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE19401
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.26387

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Rethinking Feature Conditioning for Robust Forged Media Detection in Edge AI Sensing Systems Izaldein Al-Zyoud 1 , Member, IEEE, and Abdulmotaleb El Saddik 1 , Fellow, IEEE Abstract Generalization under manipulation and dataset shift remains a core challenge in forged media detection for AI - driven edge sensing systems. Frozen vision foundation models with linear probes are strong baselines, but most pipelines use default backbone outputs without testing conditioning at the frozen feature interface. We present the first controlled probing study on DINOv3 ConvNeXt and show that, without task-specific fine-tuning, linear probing alone yields competitive forged-media detection performance, indicating that ViT-7B self-supervised distillation transfers to security-critical vision workloads at edge - compatible inference cost. Backbone, head, data, and optimization are fixed while conditioning is varied; LN-Affine, the default ConvNeXt head output, is the natural baseline. On FaceForensics++ c23, five conditioning variants are evaluated under in - distribution testing, leave-one-manipulation-out (LOMO), and cross-dataset transfer to Celeb-DF v2 and DeepFakeDetection. In ConvNeXt-Tiny, conditioning alone changes LOMO mean AUC by 6.1 points and reverses ID-vs-OOD ranking: LN-Affine is strongest on external datasets, while LayerNorm is strongest in - distribution. In ConvNeXt-Base replication, the OOD winner becomes protocol-dependent, and ID-optimal selection still fails as a robust deployment rule. Results show that feature conditioning is a first-order design variable and should be selected with robustness-oriented validation, not ID accuracy alone. I Introduction The integrity of vision perception modules in AI-driven sensing systems depends on the authenticity of their visual inputs. In industrial inspection, smart-city surveillance, and intelligent connected vehicle (ICV) systems, vision-driven decisions are increasingly automated with limited human oversight. Forged synthetic media is therefore a direct operational threat: manipulated content can corrupt downstream decisions, weaken biometric verification, and reduce trust in AI-enabled security infrastructure [ 1 ] . Face deepfake video detection is a concrete, well-benchmarked instantiation of this broader forged-media threat. Yet generalization under distribution shift remains a core failure mode: methods that perform well in-distribution (ID) can degrade under unseen manipulations or external datasets [ 12 , 16 ] . Foundation-model pipelines with frozen backbones and linear probes are attractive for this setting because they are simple, scalable, and practical for edge deployment [ 9 , 10 , 14 ] , but they typically consume default backbone outputs without testing how post-pool conditioning affects robustness. This setting is operationally important because DINOv3 ConvNeXt can be deployed without task-specific fine-tuning: a linear probe over frozen features is already competitive, suggesting that ViT-7B-distilled representations transfer effectively to security-critical edge vision tasks. This paper isolates one variable: post-pool feature conditioning before a linear probe. The controlled setup keeps backbone, data protocol, and training recipe fixed. Figure 1 shows the pipeline. Fig. 1: Controlled probing framework for assessing robustness of frozen Vision Foundation Models under distribution shift. The core research questions are: Does inherited conditioning help or hurt robustness under shift? Can conditioning alter ranking between ID and OOD protocols? We answer these using a controlled probing framework on FaceForensics++ c23 with transfer to Celeb-DF v2 and DFD. Our main findings are: (1) conditioning materially changes robustness under shift, (2) ID-optimal ranking does not reliably transfer to OOD, and (3) robust choice can be protocol-dependent at higher backbone capacity. This supports treating feature conditioning as a primary design variable. II Related Work The DINO line introduced self-distillation without labels in a teacher–student framework and showed that self-supervised ViT features can encode strong semantic structure [ 4 ] . DINOv2 scaled this recipe through curated large-scale data and stronger frozen-feature transfer [ 10 ] . DINOv3 further scales to a ViT-7B teacher trained on LVD-1689M and adds Gram anchoring to stabilize dense feature quality over long training schedules [ 14 ] . It also provides heterogeneous distillation into ConvNeXt students (Tiny/Small/Base/Large), enabling lower inference-cost CNN backbones while preserving teacher-aligned representations. CLIP and DINO families have made frozen-feature probing practical at scale [ 11 , 4 , 10 , 14 ] , and deepfake-focused CLIP studies report strong transfer potential [ 9 , 17 ] . However, these studies typically use default frozen embeddings and do not isolate post-extraction conditioning as an independent variable. To our knowledge, no prior work has applied DINOv3 ConvNeXt backbones to forged media detection. In forged-media benchmarks, FaceForensics++ and DeepfakeBench show that high in-distribution performance can coexist with weak cross-manipulation robustness [ 12 , 16 ] . Methods based on artifact localization, reconstruction, and augmentation improve specific regimes but do not remove shift sensitivity [ 7 , 3 , 13 , 15 ] , while Celeb-DF further highlights realism-driven generalization gaps [ 8 ] . LayerNorm and BatchNorm are established normalization modules [ 2 , 5 ] , and PCA whitening is a classic retrieval transform [ 6 ] . The methodological gap addressed here is therefore isolation of post-extraction feature conditioning under fixed backbone, data protocol, and optimizer settings, rather than changing architecture or loss design. III Methodology III-A Backbone Architecture: DINOv3 ConvNeXt The frozen backbones in this study are DINOv3 ConvNeXt models. Relative to DINOv2, DINOv3 scales self-distillation to larger data and model regimes, including pretraining on LVD-1689M (about 1.7B images) with a ViT-7B teacher under a no-label objective [ 10 , 14 ] . The ConvNeXt student family (ConvNeXt-Tiny, ConvNeXt-Small, ConvNeXt-Base, ConvNeXt-Large; 29M–198M parameters) is obtained through heterogeneous distillation from that teacher. DINOv3 also introduces Gram anchoring to stabilize dense feature learning over long training schedules, improving patch-level representation consistency. For compact table and figure captions, we abbreviate ConvNeXt-Tiny and ConvNeXt-Base as CNX-Tiny and CNX-Base. Architecturally, the ConvNeXt students retain hierarchical convolutional stages with LayerNorm and inverted bottleneck-style blocks, while the ViT teacher uses global token interactions via self-attention. Distillation aligns these cross-architecture representations at lower inference cost. DINOv3 ConvNeXt models are distilled from a ViT-7B teacher into efficient CNN backbones explicitly designed for on-device deployment [ 14 ] , making them natural candidates for edge AI sensing pipelines. In our frozen-backbone pipeline, only a linear probe is trained on 768-d (ConvNeXt-Tiny) or 1024-d (ConvNeXt-Base) descriptors. To our knowledge, no prior work has applied DINOv3 ConvNeXt backbones to forged media detection; this work establishes conditioning baselines, and absolute AUC comparisons to fine-tuned ViT-based detectors are outside scope. III-B Probing Framework An overview of the controlled probing pipeline is shown in Fig. 1 . To ensure reproducible and fair evaluation of frozen VFMs for forged media detection, we use a controlled framework spanning data engineering, feature engineering, model training and evaluation, and performance analysis. The pipeline starts with protocol definition and split control. We define ID, LOMO, and cross-dataset protocols, fix train/val/test splits, and freeze split manifests and seeds with integrity checks. Frames are loaded by video decode or frame manifests, with stochastic augmentation during training and deterministic preprocessing for validation/test. For FaceForensics++ c23 (ID), fixed splits are train 107,967 real / 91,891 fake (199,858 total), validation 20,949 / 17,877 (38,826 total), and test 21,096 / 17,909 (39,005 total). For cross-dataset test-only evaluation, Celeb-DF v2 has 178 real and 178 fake videos (356 total), and DFD has 363 real and 363 fake videos (726 total). Feature engineering extracts spatial features from the frozen backbone, pools global or token features into frame-level vectors, and applies conditioning before probing. Conditioning includes normalization and

Read the complete text