AI-Generated Image Detection: An Empirical Study and Future Research Directions
Nusrat Tasnim, Kutub Uddin, Khalid Mahmood Malik · 2025
Read AI-Generated Image Detection: An Empirical Study and Future Research Directions by Nusrat Tasnim, Kutub Uddin, Khalid Mahmood Malik (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-02791.txt.
Introduction
Fake images made by AI are eroding trust in photos and video. Nusrat Tasnim, Kutub Uddin, and Khalid Mahmood Malik benchmark the tools meant to catch them in a 2025 study. Earlier comparisons suffered from mixed data sets, uneven training rules, and narrow scoring, so no one could tell which detectors truly hold up.
Their unified framework tests ten leading forensic methods on seven public data sets, covering both GAN and diffusion images. Training modes include scratch, frozen, and fine-tuned. Scoring spans accuracy, precision, and class-wise sensitivity, plus heat maps that show where each model looks. Some methods shone on familiar data but failed to transfer to new generators. The study charts where robust, explainable detectors still fall short.
Catalog record
| CREATOR | Nusrat Tasnim, Kutub Uddin, Khalid Mahmood Malik |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-02791
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
AI-Generated Image Detection: An Empirical Study and Future Research Directions Nusrat Tasnim, Kutub Uddin, Khalid Mahmood Malik Abstract The threats posed by AI-generated media, particularly deepfakes, are now raising significant challenges for multimedia forensics, misinformation detection, and biometric system resulting in erosion of public trust in the legal system, significant increase in frauds, and social engineering attacks. Although several forensic methods have been proposed, they suffer from three critical gaps: (i) use of non-standardized benchmarks with GAN- or diffusion-generated images, (ii) inconsistent training protocols (e.g., scratch, frozen, fine-tuning), and (iii) limited evaluation metrics that fail to capture generalization and explainability. These limitations hinder fair comparison, obscure true robustness, and restrict deployment in security-critical applications. This paper introduces a unified benchmarking framework for systematic evaluation of forensic methods under controlled and reproducible conditions. We benchmark ten SoTA forensic methods (scratch, frozen, and fine-tuned) and seven publicly available datasets (GAN and diffusion) to perform extensive and systematic evaluations. We evaluate performance using multiple metrics, including accuracy, average precision, ROC-AUC, error rate, and class-wise sensitivity. We also further analyze model interpretability using confidence curves and Grad-CAM heatmaps. Our evaluations demonstrate substantial variability in generalization, with certain methods exhibiting strong in-distribution performance but degraded cross-model transferability. This study aims to guide the research community toward a deeper understanding of the strengths and limitations of current forensic approaches, and to inspire the development of more robust, generalizable, and explainable solutions. AI-Generated Image Detection: An Empirical Study † † email: [email protected] † † email: [email protected] † † email: [email protected] † † affiliation: School of Electronics and Information Engineering Korea Aerospace University Goyang, South Korea † † affiliation: College of Innovation & Technology University of Michigan-Flint, Michigan, USA 1 Introduction In recent times, the proliferation of AI-generated content, particularly deepfakes [ Uddin et al.(2024)Uddin, Jeong, and Oh ] , has overwhelmed social media [ Agarwal and Farid(2020) ] and news platforms [ Chesney and Citron(2019) ] . These deepfake contents are often used to mislead audiences by fabricating events or impersonating individuals, thereby undermining public trust. Moreover, deepfakes have emerged as critical threats to society, especially in security-sensitive domains. For instance, they can compromise biometrics used for face recognition and identification [ Yi et al.(2019)Yi, Liu, Zhang, and Tan , Uddin et al.(2019)Uddin, Yang, and Oh ] , surveillance systems [ Korshunov and Marcel(2018) ] , and mislead perception modules in autonomous driving [ Fridman et al.(2020)Fridman, Brown, and Mericli , Tasnim and Baek(2023) ] . Additionally, deepfakes pose significant risks in the Internet of Things (IoT) ecosystem [ Choo(2019) , Tasnim et al.(2020)Tasnim, Islam, and Baek ] and remote authentication systems [ Yang et al.(2019)Yang, Li, and Lyu , Tasnim and Baek(2022) ] , where identity integrity is crucial. As the quality and realism of AI-generated content continue to improve, the ability to detect deepfake media has become increasingly challenging and making it imperative to develop robust and generalizable techniques. Current statistics highlight the urgent need to verify deepfake content in domains such as social media, journalism, finance, the legal system, and governance. Across industries, deepfake fraud has become alarmingly common. Nearly 92% of companies have reported financial losses due to deepfake scams [ CFO.com(2024) ] . On average, businesses lose approximately $450,000 per incident, with the financial sector bearing even heavier losses, averaging $600,000 per organization, and in some cases exceeding $1 million [ Globe Newswire(2024) ] . In one notable incident, a Hong Kong employee was tricked into transferring $25 million after fraudsters used a deepfake video call to impersonate the company’s CFO [ Eftsure(2024) ] . Globally, deepfake-enabled fraud caused over $200 million in losses during the first quarter of 2025 alone, indicating a rapidly escalating threat [ eSecurityPlanet.com(2025) ] . The cryptocurrency sector saw an even more dramatic impact, with deepfake-related scams increasing by 456% between May 2024 and April 2025, culminating in more than $10.7 billion in damages in 2024 [ Reddit r/SocialEngineering(2025) ] . Market projections suggest that generative AI-related fraud losses could rise to $40 billion by 2027, up from $12.3 billion in 2023 [ Eftsure(2025) ] . Beyond financial harm, the reputational damage from deepfakes is equally concerning. Victims often suffer from long-term erosion of trust, reputational fallout, and brand damage. In one instance, a fabricated image of an explosion near the Pentagon, generated by AI, caused a temporary dip in the Dow Jones index, highlighting how deepfakes can disrupt public confidence and financial stability [ Reality Defender(2023) ] . These statistics emphasize the urgent need for generalized forensic methods to detect deepfake content, thereby protecting individuals, institutions, and the public at large. Several methods [ Wang et al.(2020)Wang, Wang, Zhang, Owens, and Efros , Frank et al.(2020)Frank, Eisenhofer, Schönherr, Fischer, Kolossa, and Holz , Uddin et al.(2023)Uddin, Yang, Jeong, and Oh , Tan et al.(2024b)Tan, Zhao, Wei, Gu, Liu, and Wei , Ojha et al.(2023)Ojha, Li, and Lee ] have been developed using deep learning [ Wang et al.(2020)Wang, Wang, Zhang, Owens, and Efros ] and hybrid [ Ojha et al.(2023)Ojha, Li, and Lee ] approaches to ensure media integrity. Some approaches [ Wang et al.(2020)Wang, Wang, Zhang, Owens, and Efros , Tan et al.(2024b)Tan, Zhao, Wei, Gu, Liu, and Wei ] incorporate preprocessing and data augmentation techniques to enhance generalization, while others [ Ojha et al.(2023)Ojha, Li, and Lee ] leverage SoTA foundation models for robust feature extraction to ensure better generalizability. The major drawbacks of these methods [ Wang et al.(2020)Wang, Wang, Zhang, Owens, and Efros , Frank et al.(2020)Frank, Eisenhofer, Schönherr, Fischer, Kolossa, and Holz , Tan et al.(2024b)Tan, Zhao, Wei, Gu, Liu, and Wei , Ojha et al.(2023)Ojha, Li, and Lee ] are specific to datasets [ Wang et al.(2020)Wang, Wang, Zhang, Owens, and Efros ] , generative models [ Frank et al.(2020)Frank, Eisenhofer, Schönherr, Fischer, Kolossa, and Holz , Uddin et al.(2025b)Uddin, Tasnim, Saeed, and Malik ] , or training strategies [ Tan et al.(2024b)Tan, Zhao, Wei, Gu, Liu, and Wei , Uddin et al.(2025a)Uddin, Khan, Farooq, and Malik ] . Although many benchmark datasets [ Tan et al.(2024b)Tan, Zhao, Wei, Gu, Liu, and Wei ] are now publicly available for evaluating a model’s effectiveness and generalizability, most existing approaches [ Wang et al.(2020)Wang, Wang, Zhang, Owens, and Efros , Frank et al.(2020)Frank, Eisenhofer, Schönherr, Fischer, Kolossa, and Holz , Tan et al.(2024b)Tan, Zhao, Wei, Gu, Liu, and Wei , Ojha et al.(2023)Ojha, Li, and Lee ] consider only one or two datasets for evaluation, leaving many others unexplored. Furthermore, these methods are not assessed within a unified framework, which hinders the reproducibility of results and limits future research. In this article, we conduct an empirical study of generalizable and explainable deepfake detection. The major contributions are listed as follows: • We propose a unified benchmarking framework that systematically evaluates the generalization capabilities of SoTA forensic methods across benchmark datasets, generative models, and training paradigms. • We conduct an extensive empirical study involving ten SoTA detection methods (scratch, frozen, and finetuned) and seven publicly available deepfake datasets (GAN and Diffusion) that offer a comprehensive and reproducible evaluation setup. • We incorporate explainability techniques (confidence, ROC curves, and GradCAM) to interpret model predictions and highlight the decisions made by them. • We provide