SFLD: Reducing the content bias for AI-generated Image Detection
Seoyeon Gye Junwon Ko Hyounguk Shon Minchan Kwon Junmo Kim · 2025
Read SFLD: Reducing the content bias for AI-generated Image Detection by Seoyeon Gye Junwon Ko Hyounguk Shon Minchan Kwon Junmo Kim (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-17105.txt.
Introduction
Seoyeon Gye and co-authors published a 2025 paper on spotting images made by artificial intelligence. Reliable detectors matter for the safe use of image generators. Existing detectors tend to lean on what an image shows, or on faint fingerprints left by the generator. The first habit makes them biased toward new content. The second breaks when an image is simply compressed.
Their method, SFLD, mixes both kinds of clues. It shuffles small patches of the image at several scales, forcing the detector to use texture and meaning together. The team also built a new test set, TwinSynths. It pairs real photos with fake versions that look nearly the same, fixing weak spots in older test sets. Across many kinds of fakes, from older generators to diffusion models, SFLD beat rival detectors. It also held up best on generators it had never seen.
Catalog record
| CREATOR | Seoyeon Gye Junwon Ko Hyounguk Shon Minchan Kwon Junmo Kim |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-17105
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SFLD: Reducing the content bias for AI-generated Image Detection Seoyeon Gye Junwon Ko Hyounguk Shon Minchan Kwon Junmo Kim Abstract Identifying AI-generated content is critical for the safe and ethical use of generative AI. Recent research has focused on developing detectors that generalize to unknown generators, with popular methods relying either on high-level features or low-level fingerprints. However, these methods have clear limitations: biased towards unseen content, or vulnerable to common image degradations, such as JPEG compression. To address these issues, we propose a novel approach, SFLD, which incorporates PatchShuffle to integrate high-level semantic and low-level textural information. SFLD applies PatchShuffle at multiple levels, improving robustness and generalization across various generative models. Additionally, current benchmarks face challenges such as low image quality, insufficient content preservation, and limited class diversity. In response, we introduce TwinSynths, a new benchmark generation methodology that constructs visually near-identical pairs of real and synthetic images to ensure high quality and content preservation. Our extensive experiments and analysis show that SFLD outperforms existing methods on detecting a wide variety of fake images sourced from GANs, diffusion models, and TwinSynths, demonstrating the state-of-the-art performance and generalization capabilities to novel generative models. The TwinSynths dataset is publicly available at https://huggingface.co/datasets/koooooooook/TwinSynths . 1 Introduction (a) UnivFD [ 32 ] (b) SFLD (ours) Figure 1 : Class-wise detection accuracy for StyleGAN-{ bedroom, car, cat } class categories. The bedroom class does not appear at training, while car and cat does. UnivFD [ 32 ] catastrophically fails to identify synthetic bedroom images, which hints at model bias towards high-level image content. (a) Examples of the conventional benchmark. (b) Examples of proposed TwinSynths benchmark. Figure 2 : Comparison of benchmarks. (a) Real images and fake GAN images are sampled from the test ProGAN set in the ForenSynths [ 49 ] . Fake diffusion images are sampled from benchmark of Ojha et al . [ 32 ] , each from LDM, GLIDE and DALL-E dataset. (b) Real images are sampled from ImageNet dataset, and corresponding fake images are generated by each model. The rapid advancement of AI image generation technologies has brought significant achievements but also growing social concern, as these technologies are increasingly misused for the creation of fake news, malicious defamation, and other forms of digital deception. In response, AI-generated image detection is receiving more attention. There is a wide variety of generative models, along with commercial models with unknown internal architectures. This highlights the need for a generalized detector capable of distinguishing between real and fake images, regardless of the generative model structure. In this context, early research focused on identifying the characteristic fingerprints of generated images. Recent work, NPR [ 46 ] shows that pixel-level features, induced by the upsampling layers commonly found in current generative models, can serve as cues for detection. However, there are clear practical limitations to relying on low-level fingerprints. First, the approach is vulnerable to simple image degradations, such as JPEG compression or blurring, which are common in real-world online environments [ 49 ] . Additionally, the model may become biased toward the specific fakeness seen at training in cases where generalization to novel generators is not sufficiently considered [ 32 , 56 ] . For instance, a detector trained on GAN-generated images may learn the characteristics of GANs as the fake features, while mistakenly perceiving images generated by diffusion models as real. This bias limits the detector’s generalizability across different types of generative models. To tackle these limitations, UnivFD [ 32 ] utilizes a robust, pre-trained image encoder. This image embedding is task-agnostic, enabling it to capture high-level semantic information from images. However, we found that UnivFD exhibits a bias towards the observed content in the training images, learning another specific fakeness . Fig. 1 shows that UnivFD misclassifies most GAN-generated images of a novel class (StyleGAN- bedroom ) as real . The bedroom class is absent from the training set, which may lead the detector to mistakenly classify most images as real, demonstrating the detector’s reliance on seen content during training. We propose a novel technique called PatchShuffle , which is the core of our fake image detection model, SFLD (pronounced “shuffled”). PatchShuffle divides the image into non-overlapping patches and randomly shuffles them. This procedure disrupts the high-level semantic structure of the image while preserving low-level textural information. This allows the detection model to better focus on both context and texture. SFLD utilizes an ensemble of classifiers at multiple levels of PatchShuffle, leveraging hierarchical information across various patch sizes. This approach ensures that the model leverages both the semantic and textural aspects of the image to improve fake image detection. The results demonstrate that SFLD achieves superior performance with enhanced robustness and better generalization. Furthermore, we observe that previous benchmarks have three limitations: (1) low image quality. The previous benchmarks contain a significant portion of low-quality images that lag behind the capabilities of current generative models. As a result, the practical usefulness of these benchmarks is significantly reduced. (2) lack of content preservation. Some subsets—particularly foundation generative models—lack access to the training data used for the checkpoints. Consequently, the content of the generated and real images often differs significantly, making it difficult to determine whether a detector focuses on real/fake discriminative features or other irrelevant features. (3) limited class diversity. Existing benchmarks primarily focus on expanding the variety of generative models without considering the generated class diversity and scalability among generative models. As shown in Fig. 1 , this makes it difficult to identify detection bias towards certain classes, as well as hard to represent the in-the-wild performance of the detector due to limited class diversity. To address these challenges, we propose a new benchmark generation methodology and corresponding benchmark, TwinSynths . It consists of synthetic images that are visually near-identical to paired real images for practical and fair evaluations. TwinSynths constructs image pairs that preserve both quality and content while retaining the architectural characteristics of each generative model. Also, TwinSynths enables flexible class expansion by generating synthetic images tailored to the real image. Using this benchmark, we evaluate the performance of our proposed SFLD method as well as existing detection models. Our main contributions are summarized as follows: • We propose SFLD, a novel AI-generated image detection method that integrates semantic and texture artifacts on generated images, achieving state-of-the-art performance. • We propose a new approach on benchmarks and the subset of generated images that can ensure the quality and content of generated images. • We validate our method through extensive experiments and analysis that support our hypothesis. 2 Method Figure 3 : Architecture of the proposed fake image detector (SFLD). z_{s_{i}} refers to the logit score generated from an input image processed via s_{i}\text{×}s_{i} patch size. \Sigma indicates weighted sum. 2.1 Patch Shuffling Fake Detection Backbone. We utilize the visual encoder of CLIP ViT-L/14 [ 13 , 36 ] to leverage the pre-trained feature space. This choice is based on Ojha et al . [ 32 ] , which showed that it outperforms other models such as CLIP:ResNet-50, ImageNet:ResNet-50, and ImageNet:ViT-B/16 in distinguishing real from fake images. The results indicated that both the architecture and the pre-training data are crucial. Based on this insight, we chose the ViT model for our