FeatDistill: A Feature Distillation Enhanced Multi-Expert Ensemble Framework for Robust AI-generated Image Detection

Zhilin TuKemou LiFengpeng LiJianwei FeiJiamin Zhang, Haiwei Wu School of Computer Science and Engineering, University of Electronic Science and Technology of China State Key Laboratory of Internet of Things for Smart City, University of Macau PRADA Lab, King Abdullah University of Science and Technology Department of Information Engineering, University of Florence · 2026

Read FeatDistill: A Feature Distillation Enhanced Multi-Expert Ensemble Framework for Robust AI-generated Image Detection by Zhilin TuKemou LiFengpeng LiJianwei FeiJiamin Zhang, Haiwei Wu School of Computer Science and Engineering, University of Electronic Science and Technology of China State Key Laboratory of Internet of Things for Smart City, University of Macau PRADA Lab, King Abdullah University of Science and Technology Department of Information Engineering, University of Florence (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-21939.txt.

Introduction

Tu and co-authors build FeatDistill, a detector for AI-generated images built for messy real-world conditions. The system runs four Vision Transformer experts, drawn from CLIP and SigLIP lines, so their forensic cues complement. Training data was widened, and a degradation model mimics the quality drops seen online. A second stage distills features inside the model to align representations. Final calls average the four experts' probabilities. Built for the NTIRE challenge, it stayed strong on unseen generators while using about 10 GB of GPU memory.

Catalog record

CREATORZhilin TuKemou LiFengpeng LiJianwei FeiJiamin Zhang, Haiwei Wu School of Computer Science and Engineering, University of Electronic Science and Technology of China State Key Laboratory of Internet of Things for Smart City, University of Macau PRADA Lab, King Abdullah University of Science and Technology Department of Information Engineering, University of Florence
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35529
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.21939

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

FeatDistill: A Feature Distillation Enhanced Multi-Expert Ensemble Framework for Robust AI-generated Image Detection Zhilin TuKemou LiFengpeng LiJianwei FeiJiamin Zhang, Haiwei Wu School of Computer Science and Engineering, University of Electronic Science and Technology of China State Key Laboratory of Internet of Things for Smart City, University of Macau PRADA Lab, King Abdullah University of Science and Technology Department of Information Engineering, University of Florence Abstract The rapid iteration and widespread dissemination of deepfake technology have posed severe challenges to information security, making robust and generalizable detection of AI-generated forged images increasingly important. In this paper, we propose FeatDistill, an AI-generated image detection framework that integrates feature distillation with a multi-expert ensemble, developed for the NTIRE Challenge on Robust AI-Generated Image Detection in the Wild. The framework explicitly targets three practical bottlenecks in real-world forensics: degradation interference, insufficient feature representation, and limited generalization. Concretely, we build a four-backbone Vision Transformer (ViT) ensemble composed of CLIP and SigLIP variants to capture complementary forensic cues. To improve data coverage, we expand the training set and introduce comprehensive degradation modeling, which exposes the detector to diverse quality variations and synthesis artifacts commonly encountered in unconstrained scenarios. We further adopt a two-stage training paradigm: the model is first optimized with a standard binary classification objective, then refined by dense feature-level self-distillation for representation alignment. This design effectively mitigates overfitting and enhances semantic consistency of learned features. At inference time, the final prediction is obtained by averaging the probabilities from four independently trained experts, yielding stable and reliable decisions across unseen generators and complex degradations. Despite the ensemble design, the framework remains efficient, requiring only about 10 GB peak GPU memory. Extensive evaluations in the NTIRE challenge setting demonstrate that FeatDistill achieves strong robustness and generalization under diverse “in-the-wild” conditions, offering an effective and practical solution for real-world deepfake image detection. † † footnotetext: 🖂 Corresponding author: Haiwei Wu ([email protected]). 1 Introduction GenAI, represented by GANs 7 and diffusion models 11 , has advanced rapidly. While boosting innovation in entertainment, malicious AI-generated content (AIGC) can trigger cognitive mislead and trust crisis 16 ; 19 . To address this problem, numerous forensics 25 ; 32 ; 29 ; 30 ; 20 ; 12 ; 13 ; 2 ; 28 , especially those based on zero-/few-shot paradigms, have been proposed in recent years to better defend against the emerging new GenAI. Currently, generalizable AIGC detection methods increasingly aim to reduce dependence on generator-specific supervision by learning transferable forensic representations across synthesis families. Representative directions include universal detectors trained for cross-model transfer 21 , zero-shot/open-set forensic formulations 1 , and representation learning strategies grounded in large pre-trained vision–language models such as CLIP 22 . In parallel, diffusion-era detection has shifted toward process-aware evidence, where reconstruction and denoising dynamics are explicitly exploited to infer authenticity 11 ; 27 ; 23 ; 20 . These developments indicate a clear transition from handcrafted fingerprint cues to mechanism-aware and representation-centric forensics. To provide an intuitive overview of our target problem, Fig. 1 summarizes the robust AI-generated image detection task in realistic deployment. In practice, both real and AI-generated images may be corrupted by diverse in-the-wild perturbations ( e.g. , blur, noise, compression, resizing, color distortion, lens distortion, and social-media reposting artifacts), while detectors must remain reliable under unseen generators and domain shifts. The objective is therefore to output stable probabilities and accurate real-vs.-AI decisions in open-world scenarios. Figure 1 : Illustration of the robust AI-generated image detection task in the wild. Real and AI-generated images are both exposed to complex perturbations encountered in practical media pipelines, including motion blur, Gaussian noise, JPEG compression, resizing, color adjustment, lens distortion, filtering, and screenshot/social-media reposting effects. These factors induce severe domain shifts and interactions with unseen generators. A practical detector should therefore produce calibrated probabilities and robust real/AI predictions under open-world deployment constraints. Despite this progress, existing methods still face three critical limitations in real-world deployment. First, domain and distribution shifts remain severe: detectors trained on a fixed generator pool or curated benchmarks can degrade substantially when encountering new content domains, post-processing pipelines, or unseen generators 35 ; 21 . Second, prediction stability under image corruption and perturbation is still insufficient, which is problematic in practical media channels where compression, blur, and transmission noise are ubiquitous 8 ; 9 . Third, open-set and zero-shot settings are intrinsically sensitive to reference priors and decision calibration, often leading to unstable false-positive/false-negative trade-offs under challenging “in-the-wild” conditions 1 ; 21 . From a deployment perspective, a practical detector should satisfy three requirements simultaneously: (1) stable generalization under degradation and distribution shift, (2) consistent representation learning that is less sensitive to superficial artifacts, and (3) efficient inference for large-scale screening. This observation motivates us to move beyond single-model optimization and design a unified framework that improves robustness at the data, feature, and decision levels in a coordinated manner. To address the above limitations, we propose a robust detection framework, named FeatDistill , which shifts the focus from plain binary classification toward learning degradation-invariant and semantically consistent representations. Specifically, we combine a heterogeneous CLIP–SigLIP multi-expert ensemble with extensive data expansion and a two-stage distillation paradigm that enforces structured feature alignment. The resulting system explicitly couples complementary backbone priors, richer in-the-wild data exposure, and dense representation regularization, thereby improving robustness against unseen generators and complex corruption patterns while maintaining practical efficiency. Contributions of this work can be summarized as follows: 1. We design a high-performance heterogeneous ensemble that integrates CLIP ViT-L/14 and SigLIP So400M experts, leveraging complementary pre-training characteristics to improve robustness and discrimination while preserving an efficient inference footprint of approximately 10 GB. 2. We improve resilience to in-the-wild distribution shift through joint data expansion and degradation modeling, incorporating state-of-the-art diffusion/adversarial samples and diversified corruption operators (blur, noise, compression, and digital distortions) to better approximate real deployment conditions. 3. We propose a two-stage optimization strategy with dense feature-level self-distillation, which regularizes representation learning beyond vanilla classification, mitigates overfitting to limited benchmark distributions, and yields more consistent feature structures across unseen generation methods. Organization. The rest of this paper is organized as follows. Section 2 reviews related works on AI-generated image detection. Section 3 introduces the experimental data used in the NTIRE 2026 Robust AI-Generated Image Detection in the Wild competition. Section 4 describes our proposed FeatDistill, including training and inference phases. Section 5 reports experimental results and ablations. Finally, Section 6 concludes the paper. 2 Related Works 2.1 Deepfake and Image Forgery Detection Early deepfake and image-forgery research established the core benchmarks and forensic paradigms for manipulation detection. FaceForensics++ 24 and the DFDC dataset 3 significantly advanced large-scale evaluation by providing diverse manipulated samples and realistic compression settings. Meanwhile, early generalized detectors showed that synthetic imagery contains exploitable spectral and upsampling artifacts. Representative studies demonstrated strong discriminative signals in both spatial and frequency domains, including CNN artifact analysis and Fourier-spectrum inconsistencies 26 ; 5 ; 6 . Recent work further extends forensic cues to robust font watermark consistency and editing-fingerprint learning with self-augmentation 28 ; 31 . These works laid the foundation for moving from identity-specific deepfake detection toward broader synthetic-image forensics. 2.2 Detection in the Diffusion Era With diffusion models becoming dominant generative engines 11 , detection methods have increasingly

Read the complete text