OmniDFA: A Unified Framework for Open Set Synthesis Image Detection and Few-Shot Attribution

ShiyuWu Shuyan Li Jing Li Jing Liu Yequan Wang Institute of Automation, Chinese Academy of Sciences, Beijing, China Beijing Academy of Artificial Intelligence, Beijing, China University of Chinese Academy of Sciences, Beijing, China School of EEECS, Queen’s University Belfast, Northern Ireland, UK H · 2025

Read OmniDFA: A Unified Framework for Open Set Synthesis Image Detection and Few-Shot Attribution by ShiyuWu Shuyan Li Jing Li Jing Liu Yequan Wang Institute of Automation, Chinese Academy of Sciences, Beijing, China Beijing Academy of Artificial Intelligence, Beijing, China University of Chinese Academy of Sciences, Beijing, China School of EEECS, Queen’s University Belfast, Northern Ireland, UK H (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-25682.txt.

Introduction

Telling whether an image is machine-made is no longer enough; investigators want to know which generator made it, even one never seen before. Shiyu Wu and co-authors define that harder task as few-shot attribution: name the unseen source from only a handful of examples. To study it they built OmniFake, a dataset of 1.17 million images from forty-five generators, sorted with care.

Their baseline system, OmniDFA, both judges authenticity and attributes origin. In tests it handled the few-shot task well and reached state-of-the-art generalisation on plain detection of synthetic images. Because closed-set classifiers need retraining for every new generator, the authors pitch few-shot attribution as the practical path for keeping up with fast-moving image technology. Data and code are public.

Catalog record

CREATORShiyuWu Shuyan Li Jing Li Jing Liu Yequan Wang Institute of Automation, Chinese Academy of Sciences, Beijing, China Beijing Academy of Artificial Intelligence, Beijing, China University of Chinese Academy of Sciences, Beijing, China School of EEECS, Queen’s University Belfast, Northern Ireland, UK H
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-25682

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

OmniDFA: A Unified Framework for Open Set Synthesis Image Detection and Few-Shot Attribution ShiyuWu Shuyan Li Jing Li Jing Liu Yequan Wang Institute of Automation, Chinese Academy of Sciences, Beijing, China Beijing Academy of Artificial Intelligence, Beijing, China University of Chinese Academy of Sciences, Beijing, China School of EEECS, Queen’s University Belfast, Northern Ireland, UK Harbin Institute of Technology, Shenzhen, China Abstract AI-generated image (AIGI) detection and source model attribution remain central challenges in combating deepfake abuses, primarily due to the structural diversity of generative models. Current detection methods are prone to overfitting specific forgery traits, whereas source attribution offers a robust alternative through fine-grained feature discrimination. However, synthetic image attribution remains constrained by the scarcity of large-scale, well-categorized synthetic datasets, limiting its practicality and compatibility with detection systems. In this work, we propose a new paradigm for image attribution called open-set, few-shot source identification. This paradigm is designed to reliably identify unseen generators using only limited samples, making it highly suitable for real-world application. To this end, we introduce OmniDFA (Omni Detector and Few-shot Attributor), a novel framework for AIGI that not only assesses the authenticity of images, but also determines the synthesis origins in a few-shot manner. To facilitate this work, we construct OmniFake, a large class-aware synthetic image dataset that curates 1.17 1.17 M images from 45 45 distinct generative models, substantially enriching the foundational resources for research on both AIGI detection and attribution. Experiments demonstrate that OmniDFA exhibits excellent capability in open-set attribution and achieves state-of-the-art generalization performance on AIGI detection. Our dataset and code will be made available. 1 Introduction Generative models now forge photorealistic images that defy visual scrutiny, collapsing the boundary between authentic and synthetic. The growing threat of widespread misuse requires operational methods to not only distinguish AI-generated images (AIGI) from real ones but also trace their generative origins, which is critical for understanding model-specific vulnerabilities. However, existing tools for detecting and analyzing synthetic content struggle to match the pace of advancing generation methods. This poses a challenge to such countermeasures in an open-set scenario, where they must handle data from generative models unseen during training, necessitating robust generalization ability and strong fine-grained discrimination capability. Current detection methods aim to extract universal artifacts as discriminative features, yet a common practice ( Zhu et al. 2023 ) of training on data from a single generator leads to overfitting on model-specific biases and ignores feature diversity, ultimately impairing the generalization ability. The coarse-grained nature of the binary classification task fundamentally limits its ability to capture the rich variety of features. In contrast, image attribution presents itself as a broader and more fine-grained task for forgery analysis. However, it remains in its early stages and far from settled, primarily due to two limitations. First, large-scale, well-categorized attribution datasets are still scarce. Existing synthetic image datasets ( Wang et al. 2020 ; Bird & Lotfi 2024 ) either originate from a relatively small number of generators, or categorize images based on non-architectural characteristics, which are unsuitable for model attribution. Second, current image attribution paradigms lack practicality. The two commonly used tasks each have significant shortcomings: closed-set identification can only trace images back to generators seen during the training phase, while open-set rejection simply categorizes all samples from unknown sources into a single unknown class, which impedes further investigation into the distinctions among them. Overall, existing AIGI attribution methods are constrained to identifying only known generator types. Adapting these approaches to incorporate new categories necessitates retraining the entire network, which is resource-intensive and consequently makes them impractical for real-world deployment. Figure 1: Comparison of task-specific pipelines for synthetic analysis. Our new attribution paradigm (d) offers dramatically improved scalability over previous works (b) and (c). In this work, we investigate image attribution from a novel perspective by identifying the sources of generated images in an open-set scenario. We observe that generative models produce images with pronounced and model-specific biases, which can be effectively learned from a minimal number of support samples. To leverage this insight, we introduce the task of open-set few-shot identification, as depicted in Figure 1 (d). This task establishes a new paradigm for image attribution, which challenges models to identify the specific biases of unknown generators using only a few reference samples. We argue that this out-of-distribution identification task is more reliable and robust for evaluating model generalization, precisely because it demands the model to quantify, rather than merely identify, model-specific biases. The few-shot-based setting makes this new paradigm highly applicable and scalable. Its traceability for new generative models requires only a minimal number of samples, which significantly reduces the operational costs. Table 1: Comparison with existing AIGI datasets. “Distinct” indicates that each generator in the dataset has a distinct architecture. AIGI Dataset Generators Fake Images Distinct CNNSpot 11 362 K ✓ DiffusionForensics 11 439 K ✓ GenImage 8 1.33 M ✗ UniversalFakeDetect 19 400 K ✗ Artifact 25 2.49 M ✗ AIGCBenchmark 17 360 K ✗ ImagiNet 8 100 K ✓ WildFake 23 2.55 M ✗ DRCT-2M 16 2.00 M ✗ OmniFake 45 1.17 M ✓ To facilitate our work, we begin by addressing the lack of a suitable dataset. To this end, we propose OmniFake, a large-scale, class-aware dataset specifically designed for multi-class attribution. We collect generated images from 45 distinct generative models spanning GANs, diffusion models, autoregressive models, and hybrid architectures. We maintain a substantial collection of synthetic images for each class, ensuring comprehensive coverage and diversity. OmniFake significantly surpasses prior datasets ( Zhu et al. 2023 ; Zhong et al. 2024 ) in both model diversity and up-to-date coverage, with a clear comparison presented in Table 1 . The defining feature of OmniFake is its strict enforcement of model heterogeneity. In contrast to previous datasets, where differences in weights, sampling steps, or adaptation modules often resulted in highly similar forgery clues, our dataset effectively supports the critical task of image attribution. This significant advancement substantially enriches the fundamental resources available for both AIGI detection and attribution research. Leveraging our comprehensive dataset, we propose OmniDFA (Omni Detector and Few-shot Attributor), an innovative framework that simultaneously addresses authenticity detection and open-set few-shot identification. We adopt a dual-path architecture that captures image characteristics from both low-level and high-level perspectives to effectively capture fine-grained details while maintaining global representations. We employ supervised contrastive learning ( Khosla et al. 2020 ) to effectively isolate and quantify model-specific biases. This approach encourages the learning of a more comprehensive forgery subspace that incorporates shared fake features, thereby improving generalization capability. To constrain the position of authentic data within the feature space, we specifically process the real images by employing center loss ( Wen et al. 2016 ) to establish a compact centroid and learning a decision boundary that optimally encloses the data. Experimental results show that OmniDFA achieves state-of-the-art performance on our proposed OmniFake dataset, surpassing previous method by 5.83 % in authenticity detection accuracy. Additionally, it exhibits robust zero-shot detection performance across various benchmarks, confirming the generalizability and effectiveness of our approach. Our contributions are summarized as follows: • We establish open-set few-shot identification as a previously unexplored task for evaluating model generalization, which better matches practical constraints. • We construct the OmniFake dataset, a large-scale, class-aware

Read the complete text