HiMix: Hierarchical Artifact-aware Mixup for Generalized Synthetic Image Detection DOI: XXXXXXX.XXXXXXX Conference: the 34rd ACM International Conference on Multimedia; November 10–14, 2026; Rio de Janeiro, Brazil DOI: XXXXXXX.XXXXXXX ISBN: 978-1-4503-XXXX-X/2018/06 1232 CCS: Computing methodologies Computer vision CCS: Security and privacy Social aspects of security and privacy
Shuchang Zhou, Kaiwen Shen, Jiwei Wei, Yuyang Zhou, Peng Wang, Yang Yang · 2026
Read HiMix: Hierarchical Artifact-aware Mixup for Generalized Synthetic Image Detection DOI: XXXXXXX.XXXXXXX Conference: the 34rd ACM International Conference on Multimedia; November 10–14, 2026; Rio de Janeiro, Brazil DOI: XXXXXXX.XXXXXXX ISBN: 978-1-4503-XXXX-X/2018/06 1232 CCS: Computing methodologies Computer vision CCS: Security and privacy Social aspects of security and privacy by Shuchang Zhou, Kaiwen Shen, Jiwei Wei, Yuyang Zhou, Peng Wang, Yang Yang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-27903.txt.
Introduction
Zhou and five colleagues build HiMix, a frame for spotting synthetic pictures that holds up on unseen makers. Its mixup arm blends real and fake shots into in-between samples, covering shaky zones and sharpening sense for low-level fake marks. Its artifact arm pools fake marks from whole-image and fine-detail levels through cross-layer links, pulling out sharp forgery signs. Across many test sets HiMix posts top scores, with well-spread logits that help it catch forgeries it never trained on.
Catalog record
| CREATOR | Shuchang Zhou, Kaiwen Shen, Jiwei Wei, Yuyang Zhou, Peng Wang, Yang Yang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40327 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.27903
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
HiMix: Hierarchical Artifact-aware Mixup for Generalized Synthetic Image Detection DOI: XXXXXXX.XXXXXXX Conference: the 34rd ACM International Conference on Multimedia; November 10–14, 2026; Rio de Janeiro, Brazil DOI: XXXXXXX.XXXXXXX ISBN: 978-1-4503-XXXX-X/2018/06 1232 CCS: Computing methodologies Computer vision CCS: Security and privacy Social aspects of security and privacy Shuchang Zhou, Kaiwen Shen, Jiwei Wei, Yuyang Zhou, Peng Wang, Yang Yang Abstract . The rapid evolution of generative models has enabled the creation of highly realistic and diverse synthetic images, posing significant challenges to reliable and generalizable Synthetic Image Detection (SID). However, existing detectors are typically trained on limited and biased datasets, resulting in poor generalization to unseen generators. To address this issue, we propose HiMix, a unified framework that enhances generalization by expanding the training distribution and promoting artifact-aware representations. Specifically, the Mixup-driven Distributional Augmentation (MDA) module constructs continuous transitional samples between real and fake images, improving coverage of low-confidence regions and exposing the model to more challenging samples, while the pixel-wise mixup operation smoothly perturbs semantics to enhance sensitivity to low-level artifacts. Moreover, the Hierarchical Artifact-aware Representation (HAR) module aggregates artifact information from both global and local levels through cross-layer integration and coarse-to-fine feature fusion, enabling the extraction of discriminative forgery representations under diverse distributions. Extensive experiments across multiple benchmarks demonstrate that HiMix achieves state-of-the-art performance, establishing well-separated logits for improved generalization to unseen forgeries. 1. Introduction Recently, advances in generative models such as Generative Adversarial Networks (GANs) ( 8 ; 17 ) and Diffusion Models (DMs) ( 20 ; 11 ) have enabled the low-cost creation of high-quality images, but also raised concerns about misinformation, identity forgery, privacy leakage, and financial fraud ( 1 ; 40 ; 7 ) . As synthetic images become increasingly realistic and diverse, Synthetic Image Detection (SID), which aims to distinguish natural from synthetic images, has become an essential task. Developing SID methods that are both reliable and generalizable remains a key challenge for research and real-world deployment. Figure 1. Comparison between traditional training and HiMix. (a) Training on limited sources yields clear separation within seen domains but induces source-overfitted distributions. As a result, fakes from unseen generators tend to fall into low-confidence regions ( gray dashed ellipses ). (b) The logit distributions of AIDE ( 44 ) on unseen VQDM ( 9 ) / ADM ( 5 ) fakes exhibit less distinguishable predictions and dispersed logits, leading to degraded generalization. (c) In contrast, mixup-driven training constructs transitional samples that enrich low-confidence regions ( orange dashed ellipses ), improving coverage of unseen-source fakes. (d) HiMix produces more compact and well-separated logits, demonstrating improved generalization to unseen generators. Early studies have explored image forgery detection using pixel-level features ( 49 ; 38 ; 41 ; 34 ) or frequency-domain cues ( 6 ; 27 ; 37 ; 44 ; 4 ) . Pixel-level methods exploit inter-pixel correlations ( 49 ) or local upsampling artifacts ( 38 ) , while frequency-based approaches capture subtle yet distinctive spectral differences between real and fake images. Although effective under matched training and testing sources, these methods rely on source-specific cues, leading to limited generalization. As illustrated in Figure 1 (a), training on limited sources induces source-overfitted distributions. Under distribution shift, unseen fake samples are often not well aligned with the learned fake distribution and lie in low-confidence regions, leading to degraded generalization. This phenomenon is further illustrated in Figure 1 (b), where logits produced by AIDE ( 44 ) become more dispersed and less distinguishable on unseen domains, revealing the limitations of prior methods. Building on this observation, recent SID studies ( 29 ; 19 ; 25 ; 2 ) have leveraged pretrained models to extract generic representations to improve detection performance on unseen generators. However, the extracted features mainly capture semantics tied to image content or category rather than intrinsic forgery cues ( 10 ; 49 ) , causing the detector to learn content-biased rather than generalizable patterns. Moreover, task-irrelevant components within these representations can obscure discriminative cues. To mitigate these issues, semantic perturbation strategies such as patch shuffling ( 10 ) and masking ( 23 ) have been introduced to weaken semantics and strengthen texture awareness, while task-oriented regularizations ( 47 ; 3 ) aim to suppress redundant information and emphasize forgery-relevant signals. Nevertheless, pretrained model-based approaches remain constrained at both the data and representation levels. From the data distribution perspective, training on limited generators leads to insufficient coverage of low-confidence regions. From the representation perspective, aggressive perturbations or regularization may disrupt consistent forgery patterns or introduce training-specific biases, ultimately compromising generalization. To address these limitations, we propose a H ierarchical Art i fact-aware Mix up method for Synthetic Image Detection, termed HiMix , which improves generalization from both data and representation perspectives. The Mixup-driven Distributional Augmentation (MDA) module constructs continuous transitional samples between real and fake images, effectively improving coverage of low-confidence regions where misclassification is most likely (Figure 1 (c)). By increasing the coverage of these regions and exposing the model to hard samples, MDA improves separability and generalization to unseen distributions. Meanwhile, the pixel-wise mixup operation achieves smooth semantic interpolation, reducing high-level semantic influence and highlighting fine-grained artifact cues for reliable detection. In parallel, the Hierarchical Artifact-aware Representation (HAR) module is designed to extract discriminative and robust forgery cues by aggregating artifact information from global and local perspectives. Through cross-layer integration and coarse-to-fine fusion, it captures complementary artifact patterns in complex mixed samples. As illustrated in Figure 1 (d), our method produces compact within-class (real/fake) and clearly separated between-class (real vs. fake) logit distributions, demonstrating enhanced generalization to unseen generators. The main contributions of this paper include: • We propose HiMix, a unified detection framework composed of a Mixup-driven Distributional Augmentation (MDA) module and a Hierarchical Artifact-aware Representation (HAR) module, which jointly enhance generalization from both data and representation perspectives. • We introduce a distributional augmentation strategy that improves coverage of low-confidence regions while reducing the dominance of high-level semantics, coupled with a hierarchical fusion mechanism that captures complementary global and local artifact cues for robust representations. • Extensive experiments across multiple benchmarks demonstrate state-of-the-art performance, validating the cross-source generalization ability of our approach. 2. Related Work 2.1. Pixel-based Detection Pixel-based detection methods directly operate in the spatial domain, aiming to identify forgery traces from local spatial patterns ( 49 ; 34 ; 13 ; 24 ; 28 ; 26 ) . Early work by Wang et al. ( 41 ) showed that a standard CNN trained on a single generator, with proper data augmentation, can generalize effectively to unseen generators. Later, Tan et al. ( 38 ) introduced NPR to capture structural inconsistencies caused by up-sampling operations. More recently, Li et al. ( 23 ) proposed the SAFE detector, approaching the problem from an image transformation perspective. Meanwhile, Jia et al. ( 13 ) exploited the statistical uniformity of color distributions, integrating it with image features for improved synthetic image discrimination. Despite these advances, pixel-based methods often rely on generator-specific artifacts or local statistics, which may not generalize well under distribution shifts. 2.2. Frequency-based Detection Frequency-based detection methods exploit spectral artifacts, often from operations like up-sampling, by analyzing images in the frequency domain ( 6 ; 27 ; 15 ; 18 ; 22 ;