Frequency-Aware Semantic Fusion with Gated Injection for AI-generated Image Detection DOI: XXXXXXX.XXXXXXX Conference: the 34rd ACM International Conference on Multimedia; November 10–14, 2026; Rio de Janeiro, Brazil DOI: XXXXXXX.XXXXXXX ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Computing methodologies Computer vision CCS: Security and privacy Social aspects of security and privacy

Shuchang Zhou, Shangkun Wu, Jiwei Wei, Ke Liu, Ran Ran, Caiyan Qin, Yang Yang · 2026

Read Frequency-Aware Semantic Fusion with Gated Injection for AI-generated Image Detection DOI: XXXXXXX.XXXXXXX Conference: the 34rd ACM International Conference on Multimedia; November 10–14, 2026; Rio de Janeiro, Brazil DOI: XXXXXXX.XXXXXXX ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Computing methodologies Computer vision CCS: Security and privacy Social aspects of security and privacy by Shuchang Zhou, Shangkun Wu, Jiwei Wei, Ke Liu, Ran Ran, Caiyan Qin, Yang Yang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-27875.txt.

Introduction

Zhou and six colleagues hunt fake pictures with a net joining scene meaning to fine ripple clues. They blame two faults: a lean toward marks tied to one maker, and a clash between high-level meaning and low-level ripple patterns. Their FGINet masks ripple bands to widen trusted clues, then feeds gated ripple cues step by step into the vision backbone. A compactness rule with a cosine margin pulls same-kind shots tight and apart from other kinds, and tests show top scores that carry to new sets.

Catalog record

CREATORShuchang Zhou, Shangkun Wu, Jiwei Wei, Ke Liu, Ran Ran, Caiyan Qin, Yang Yang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39926
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.27875

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Frequency-Aware Semantic Fusion with Gated Injection for AI-generated Image Detection DOI: XXXXXXX.XXXXXXX Conference: the 34rd ACM International Conference on Multimedia; November 10–14, 2026; Rio de Janeiro, Brazil DOI: XXXXXXX.XXXXXXX ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Computing methodologies Computer vision CCS: Security and privacy Social aspects of security and privacy Shuchang Zhou, Shangkun Wu, Jiwei Wei, Ke Liu, Ran Ran, Caiyan Qin, Yang Yang Abstract . AI-generated images are becoming increasingly realistic and diverse, posing significant challenges for generalizable detection. While Vision Foundation Models (VFMs) provide rich semantic representations and frequency-based methods capture complementary artifact cues, existing approaches that combine these modalities still suffer from limited generalization, with notable performance degradation on unseen generative models. We attribute this limitation to two key factors: frequency shortcut bias toward easily distinguishable cues associated with specific generators and cross-domain representation conflict between high-level semantics and low-level frequency patterns. To address these issues, we propose a Frequency-aware Gated Injection Network (FGINet) to improve generalization. Specifically, we design a Band-Masked Frequency Encoder (BMFE) that applies cross-band masking in the frequency domain to reduce reliance on generator-specific patterns and encourage more diverse and generalizable representations. We further introduce a Layer-wise Gated Frequency Injection (LGFI) mechanism to progressively inject frequency cues into the VFM backbone with adaptive gating, aligning with its hierarchical abstraction and alleviating representation conflict. Moreover, we propose a Hyperspherical Compactness Learning (HCL) framework with a cosine margin objective to learn compact and well-separated representations. Extensive experiments demonstrate that FGINet achieves state-of-the-art performance and strong generalization across multiple challenging datasets. 1. Introduction The rapid evolution of AI-generated images ( 13 ; 14 ; 10 ; 33 ; 27 ) has enabled the creation of highly realistic and diverse visual content, posing significant challenges to the reliability of digital media. In response, AI-generated image detection has attracted increasing attention. Vision Foundation Models (VFMs), such as DINOv3 ( 36 ) , have recently demonstrated strong potential due to their powerful open-set semantic representation capability. Meanwhile, prior studies ( 12 ; 38 ; 11 ; 8 ) reveal that generative processes inevitably introduce subtle yet systematic artifacts in the frequency domain, providing complementary cues for distinguishing real and synthetic images. Existing frequency-based detection methods can be broadly categorized into three paradigms. The first directly exploits statistical patterns or high-frequency components as discriminative cues ( 12 ; 38 ; 21 ) . The second leverages frequency reconstruction discrepancies to capture deviations from natural image formation ( 40 ; 47 ; 8 ) . More recently, a third line of work integrates frequency modeling into VFMs ( 41 ; 7 ; 45 ) , aiming to combine high-level semantic consistency with low-level artifact cues. By leveraging the strong generalization capability of VFMs and the sensitivity of frequency signals to generative artifacts, these approaches have the potential to better distinguish visually realistic yet statistically inconsistent images. Figure 1. (a) Randomly masking frequency bands narrows the performance gap between seen and unseen generators, revealing a shortcut tendency toward generator-specific frequency cues. (b) Saliency visualization of BMFE. During training (top), models lacking BMFE rely on specific frequency cues, whereas BMFE encourages more diverse patterns. During testing (bottom), such models exhibit diffuse and unstable evidence under distribution shifts, while BMFE produces more concentrated and consistent evidence. (c) t-SNE visualization. Direct fusion produces mixed representations with unclear class separation (top), while LGFI yields more compact and well-separated representations (bottom), improving detection performance. However, existing methods still exhibit limited cross-generator generalization: they perform well on seen generators but degrade significantly on unseen ones. We attribute this issue to two key limitations. (1) Frequency Shortcut Bias. During training, models tend to rely on easily distinguishable frequency cues associated with specific generators, which do not generalize well across sources and lead to degraded performance under distribution shifts. To investigate this, we randomly mask frequency bands during training to perturb frequency cues. As shown in Figure 1 (a), masking slightly reduces seen performance but improves unseen performance and narrows the gap, revealing a shortcut tendency toward generator-specific frequency cues. (2) Cross-Domain Representation Conflict. Existing dual-stream frameworks typically adopt direct fusion strategies, such as concatenation or cross-attention, to combine frequency cues with semantic representations from VFMs. However, these features reside in inherently different representation spaces: frequency features capture low-level statistical irregularities, while VFM features encode high-level semantic abstractions. This mismatch leads to mixed representations under direct fusion, degrading detection performance. To address these challenges, we propose a F requency-aware G ated I njection N etwork ( FGINet ), which aims to learn generalizable frequency representations and integrate them with semantic features in a structure-aware and hierarchical manner. We first design a Band-Masked Frequency Encoder ( BMFE ), which applies cross-band independent masking to reduce reliance on generator-specific cues and encourage more diverse and generator-invariant frequency representations. As shown in Figure 1 (b), during training, the model without BMFE exhibits attention concentrated along specific structures, whereas BMFE leads to a more balanced distribution covering richer frequency patterns. At test time, without BMFE, the model exhibits diffuse and unstable evidence under distribution shifts, while BMFE produces more concentrated and consistent evidence. To further mitigate cross-modal representation conflict, we introduce a Layer-wise Gated Frequency Injection ( LGFI ) mechanism. Instead of direct fusion, LGFI progressively injects frequency cues into the VFM backbone following its hierarchical feature abstraction, with a learnable gating function dynamically controlling the contribution at each layer. This design preserves the pretrained semantic structure while enabling effective cross-modal interaction. As shown in Figure 1 (c), direct fusion leads to entangled representations with unclear class separation (top), whereas LGFI produces more compact and well-separated joint representations (bottom). Moreover, we introduce a Hyperspherical Compactness Learning ( HCL ) framework based on the CosFace objective ( 39 ) . By constraining features onto a normalized hypersphere with a cosine margin, HCL enforces intra-class compactness and inter-class separability, encouraging compact and well-separated representations and improving generalization to unseen generative models. The main contributions of this paper are as follows: • We propose a Frequency-aware Gated Injection Network (FGINet) that addresses frequency shortcut bias and semantic-frequency representation conflict via a Band-Masked Frequency Encoder (BMFE) and a Layer-wise Gated Frequency Injection (LGFI) mechanism. • We introduce a Hyperspherical Compactness Learning (HCL) with cosine margin constraints to enforce compact and well-separated representations, improving generalization to unseen generators. • Extensive cross-domain experiments show that FGINet achieves state-of-the-art performance and superior generalization across multiple challenging datasets. 2. Related Work 2.1. High-Frequency Artifact-based Detection Due to the intrinsic mechanisms of generative models, synthesized images often exhibit distinct high-frequency artifacts that deviate from natural image statistics ( 12 ; 38 ; 11 ; 20 ; 29 ) . Frequency-based works usually exploit this property using shallow convolutional networks, which are particularly effective at capturing local high-frequency patterns in a computationally efficient manner. Methods such as SAFE ( 21 ) , NPR ( 38 ) , and MesoNet ( 1 ) adopt lightweight architectures and achieve strong performance across multiple benchmarks. Li et al. ( 21 ) suggested applying data augmentation to the training of shallow frequency models, which effectively improves generalization. Reconstruction-based approaches, such as DIRE ( 40 ) , leverage reconstruction residuals to expose frequency discrepancies, while MRCL ( 47 ) extends this idea with

Read the complete text