DFBench: Benchmarking Deepfake Image Detection Capability of Large Multimodal Models DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; October 27–31, 2025; Dublin, Ireland ISBN: 978-1-4503-XXXX-X/2018/06 48 CCS: Information systems
Jiarui Wang 1 , Huiyu Duan 1 , Juntong Wang 1 , Ziheng Jia 1 , Woo Yi Yang 1 , Xiaorong Zhu 1 , Yu Zhao 1 , Jiaying Qian 1 , Yuke Xing 1 , Guangtao Zhai 1 , Xiongkuo Min 1∗ 1 Shanghai Jiao Tong University, Shanghai, China. · 2025
Read DFBench: Benchmarking Deepfake Image Detection Capability of Large Multimodal Models DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; October 27–31, 2025; Dublin, Ireland ISBN: 978-1-4503-XXXX-X/2018/06 48 CCS: Information systems by Jiarui Wang 1 , Huiyu Duan 1 , Juntong Wang 1 , Ziheng Jia 1 , Woo Yi Yang 1 , Xiaorong Zhu 1 , Yu Zhao 1 , Jiaying Qian 1 , Yuke Xing 1 , Guangtao Zhai 1 , Xiongkuo Min 1∗ 1 Shanghai Jiao Tong University, Shanghai, China. (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-03007.txt.
Introduction
Jiarui Wang and co-authors build a half-million-image test of whether big multimodal models can spot deepfakes in this 2025 paper. Fake images have grown hard to tell from real ones, and older test sets cover too few generators to keep up. The large models, strong at many vision tasks, had never been graded on this one.
Their benchmark mixes real, edited, and fully generated images, with fakes from twelve current generators. It also grades in both directions: detectors for catching fakes, and generators for evading them. On top of it the team built a mixture-of-agents detector that pools several models' probability judgments. The pool reached the best score on the board. The authors release the data and code, and argue that big general models, properly combined, are now serious deepfake hunters.
Catalog record
| CREATOR | Jiarui Wang 1 , Huiyu Duan 1 , Juntong Wang 1 , Ziheng Jia 1 , Woo Yi Yang 1 , Xiaorong Zhu 1 , Yu Zhao 1 , Jiaying Qian 1 , Yuke Xing 1 , Guangtao Zhai 1 , Xiongkuo Min 1∗ 1 Shanghai Jiao Tong University, Shanghai, China. |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-03007
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DFBench: Benchmarking Deepfake Image Detection Capability of Large Multimodal Models DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; October 27–31, 2025; Dublin, Ireland ISBN: 978-1-4503-XXXX-X/2018/06 48 CCS: Information systems Multimedia databases CCS: Information systems Multimedia streaming CCS: Information systems Multimedia content creation Jiarui Wang 1 , Huiyu Duan 1 , Juntong Wang 1 , Ziheng Jia 1 , Woo Yi Yang 1 , Xiaorong Zhu 1 , Yu Zhao 1 , Jiaying Qian 1 , Yuke Xing 1 , Guangtao Zhai 1 , Xiongkuo Min 1∗ 1 Shanghai Jiao Tong University, Shanghai, China. Abstract . With the rapid advancement of generative models, the realism of AI-generated images has significantly improved, posing critical challenges for verifying digital content authenticity. Current deepfake detection methods often depend on datasets with limited generation models and content diversity that fail to keep pace with the evolving complexity and increasing realism of the AI-generated content. Large multimodal models (LMMs), widely adopted in various vision tasks, have demonstrated strong zero-shot capabilities, yet their potential in deepfake detection remains largely unexplored. To bridge this gap, we present DFBench , a large-scale D eep F ake Bench mark featuring (i) broad diversity , including 540,000 images across real, AI-edited, and AI-generated content, (ii) latest model , the fake images are generated by 12 state-of-the-art generation models, and (iii) bidirectional benchmarking and evaluating for both the detection accuracy of deepfake detectors and the evasion capability of generative models. Based on DFBench, we propose MoA-DF , M ixture o f A gents for D eep F ake detection, leveraging a combined probability strategy from multiple LMMs. MoA-DF achieves state-of-the-art performance, further proving the effectiveness of leveraging LMMs for deepfake detection. Database and codes are publicly available at https://github.com/IntMeGroup/DFBench . Figure 1. We present the DFBench, a large dataset for benchmarking deepfake image detection capabilities. (a) 45K real and 15K AI-edited images are collected from 8 sources. (b) 480K fake images are generated using 12 state-of-the-art generation models based on 40K prompts from Flickr8k. (c) The database enables evaluation for both detection models and generation models. 1. Introduction Table 1. An overview of fake image detection datasets. Dataset Image Content AI Generation Category Public Avalibility Database Real Sources AI Models Fake Images Total Images Fully AI Generation Partial AI Editing UADFV ( Yang et al. 2019 ) Face ✓ ✗ ✗ Real face 1 252 493 FakeSpotter ( Wang et al. 2019 ) Face ✓ ✓ ✗ CelebA, FFHQ 8 5,000 11,000 DFFD ( Dang et al. 2020 ) Face ✓ ✗ ✓ CelebA, FFHQ, FaceForensics++ 4 240,336 299,039 DeepFakeFace ( Song et al. 2023 ) Face ✓ ✗ ✓ IMDB-WIKI 3 90,000 120,000 APFDD ( Gandhi and Jain 2020 ) Face ✓ ✗ ✗ CelebA 1 5,000 10,000 DeepArt ( Wang et al. 2023b ) Art ✓ ✗ ✓ LAION-5B 5 73,411 137,890 IEEE VIP Cup ( Verdoliva et al. 2022 ) General ✓ ✗ ✗ FFHQ, Imagenet, COCO, LSUN 5 7,000 14,000 DE-FAKE ( Sha et al. 2022 ) General ✓ ✗ ✗ MSCOCO, Flickr30k 2 60,000 80,000 CiFAKE ( Bird and Lotfi 2023 ) General ✓ ✗ ✓ CIFAR 1 60,000 120,000 SID-Set ( Huang et al. 2025 ) General ✓ ✓ ✓ COCO, Flickr30k, MagicBrush 1 200,000 300,000 DFBench (Ours) General ✓ ✓ ✓ 8 Datasets 12 495,000 540,000 The rapid advancement of generative models ( Li et al. 2024a ; Chen et al. 2024a ; Team 2024b ; Labs 2024 ; Esser et al. 2024 ; Wu et al. 2024 ; Zhao et al. 2024 ; Arkhipkin et al. 2024 ) has significantly improved the ability to generate highly realistic images. However, these advancements raise serious concerns of the generated images regarding misinformation, social manipulation, and erosion of public trust. These concerns have driven the development of deepfake detection models ( Chang et al. 2023 ; Frank and Holz 2021 ; Frank et al. 2020 ; Ju et al. 2022 ; Liu et al. 2020 ; Ojha et al. 2023 ; Tan et al. 2023 ; Bi et al. 2023 ) . These models are typically trained on datasets containing real and fake images ( Yang et al. 2019 ; Song et al. 2023 ; Gandhi and Jain 2020 ; Sha et al. 2022 ; Bird and Lotfi 2023 ) , with the goal of distinguishing between real and fake content. Thus, the generalization ability of these deepfake image detection models remains questionable. Existing deepfake detection datasets and benchmarks ( Wang et al. 2019 ; Dang et al. 2020 ; Song et al. 2023 ; Gandhi and Jain 2020 ; Wang et al. 2023b ) exhibit several critical limitations: (1) Limited generative models : most datasets ( Yang et al. 2019 ; Song et al. 2023 ; Gandhi and Jain 2020 ; Sha et al. 2022 ; Bird and Lotfi 2023 ) rely on a small number of generative methods. Detection models trained on such datasets tend to learn model-specific artifacts, rather than generalizable features indicative of image manipulation. Moreover, many of the generative models ( Karras et al. 2017 ; Brock et al. 2018 ; Nichol et al. 2021 ; Gu et al. 2022 ; Dhariwal and Nichol 2021 ) used in earlier datasets are now outdated, often producing images with visible distortions, unnatural textures, or structural inconsistencies ( Wang et al. 2023a ; Wang et al. 2025d ; Wang et al. 2025b ; Wang et al. 2025e ; Wang et al. 2025c ; Xu et al. 2025 ; Wang et al. 2025a ; Chen et al. 2024b ) , which makes detection relatively easy for modern detectors and hinder the generalization of detection models to newer and more complex fakes generated by state-of-the-art models ( Li et al. 2024a ; Chen et al. 2024a ; Team 2024b ; Labs 2024 ) . (2) Limited content diversity : existing datasets for deepfake detection focus mainly on facial imagery ( Yang et al. 2019 ; Wang et al. 2019 ; Dang et al. 2020 ; Song et al. 2023 ; Gandhi and Jain 2020 ; Yang et al. 2025 ) , overlooking the growing threat of non-facial manipulations. In addition, most datasets include either fully real or fully fake images ( Verdoliva et al. 2022 ; Wang et al. 2023b ; Sha et al. 2022 ) , lacking examples of partially AI-edited content where only specific regions are manipulated ( Qian et al. 2025 ; Couairon et al. 2022 ) . Furthermore, the real images in current datasets are often clean and undistorted ( Plummer et al. 2015 ; Lin et al. 2014 ) , making detection easier. In real scenarios, authentic images frequently contain compression artifacts, motion blur, or other imperfections ( Sheikh et al. 2006 ; Duan et al. 2025 ; Ponomarenko et al. 2015 ; Lin et al. 2019 ) . Including these natural distortions is important to improve the robustness of detection benchmarks. (3) Limited evaluation scope : current benchmarks mainly focus on evaluating the performance of dedicated deepfake detection models. Large multimodal models (LMMs) have demonstrated strong zero-shot capabilities in vision tasks, yet their potential in deepfake detection remains largely unexplored. DFBench is specifically