CorrDetail: Visual Detail Enhanced Self-Correction for Face Forgery Detection

Binjia Zhou, Hengrui Lou, Lizhe Chen, Haoyuan Li, Dawei Luo, Shuai Chen, Jie Lei, Zunlei Feng, Yijun Bei · 2025

Read CorrDetail: Visual Detail Enhanced Self-Correction for Face Forgery Detection by Binjia Zhou, Hengrui Lou, Lizhe Chen, Haoyuan Li, Dawei Luo, Shuai Chen, Jie Lei, Zunlei Feng, Yijun Bei (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-05302.txt.

Introduction

Binjia Zhou and co-authors present a face forgery detector that corrects its own detail claims. Their 2025 framework aims at clear, checkable reasons, not just a fake-or-real label. Visual-only tools give few reasons, while text-paired tools can invent details.

Guided questions push the model to fix wrong detail claims rather than hallucinate fresh ones. A detail-boost module sharpens the visual proof the model works from. A fusion step then merges visual backup and bias checks for hard cases. Tests show top scores against recent rivals. Detail calls stay accurate, and the method holds up on fresh data types. The authors stress trust as much as raw accuracy.

Catalog record

CREATORBinjia Zhou, Hengrui Lou, Lizhe Chen, Haoyuan Li, Dawei Luo, Shuai Chen, Jie Lei, Zunlei Feng, Yijun Bei
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-05302

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CorrDetail: Visual Detail Enhanced Self-Correction for Face Forgery Detection Binjia Zhou, Hengrui Lou, Lizhe Chen, Haoyuan Li, Dawei Luo, Shuai Chen, Jie Lei, Zunlei Feng, Yijun Bei Abstract With the swift progression of image generation technology, the widespread emergence of facial deepfakes poses significant challenges to the field of security, thus amplifying the urgent need for effective deepfake detection. Existing techniques for face forgery detection can broadly be categorized into two primary groups: visual-based methods and multimodal approaches. The former often lacks clear explanations for forgery details, while the latter, which merges visual and linguistic modalities, is more prone to the issue of hallucinations. To address these shortcomings, we introduce a visual detail enhanced self-correction framework, designated CorrDetail , for interpretable face forgery detection. CorrDetail is meticulously designed to rectify authentic forgery details when provided with error-guided questioning, with the aim of fostering the ability to uncover forgery details rather than yielding hallucinated responses. Additionally, to bolster the reliability of its findings, a visual fine-grained detail enhancement module is incorporated, supplying CorrDetail with more precise visual forgery details. Ultimately, a fusion decision strategy is devised to further augment the model’s discriminative capacity in handling extreme samples, through the integration of visual information compensation and model bias reduction. Experimental results demonstrate that CorrDetail not only achieves state-of-the-art performance compared to the latest methodologies but also excels in accurately identifying forged details, all while exhibiting robust generalization capabilities. † † footnotetext: * Corresponding author. Email: [email protected] 1 Introduction The rapid advancement of generative technologies, exemplified by Artificial Intelligence Generated Content (AIGC) Cao et al. 2023 , has profoundly liberated societal productivity, enabling innovative applications across diverse sectors such as news, literature, entertainment, education, and industry. However, the capability of AIGC to produce high-quality content from simple prompts and guidance has simultaneously lowered the barriers for malicious actors to fabricate deceptive information Zhao et al. 2023 . This ease of content falsification has introduced significant challenges in verifying identity information, resulting in an increase in financial fraud, misinformation dissemination, and identity theft, thereby posing severe threats to societal security. Figure 1: The illustration for CorrDetail , which is designed to correct authentic forgery details ("eyes look asymmetrical…") when provided with error-guided questioning ("nose look unnatural…") with the assistance of visual fine-grained detail enhancement. To address the security threats posed by the facial image forgery technologies, researchers have focused on identifying visual artifacts inherent in forged facial images by analyzing the images themselves. Current approaches Cao et al. 2022a ; Dong et al. 2022 ; Qian et al. 2020 ; Wang et al. 2022 ; Corvi et al. 2023 involve forensic detection from various perspectives, including the network architectures of forgery methods (such as GANs, autoregressive models, and diffusion models) and the domain-specific features of these methods (encompassing both frequency and spatial domains). These techniques have demonstrated commendable performance in facial authentication tasks. However, concentrating solely on forgery detection within a single visual modality encapsulates the forgery process as a black box. Models that rely on a single visual modality typically yield only binary forgery classification results, lacking the provision of critical visual cues necessary for understanding the basis of the discrimination. Consequently, this leads to a significant deficiency in the interpretability of the forgery detection process. To enhance the interpretability and informational depth of facial image forgery detection models, researchers have endeavored to incorporate textual information, thereby developing multimodal deepfake detection frameworks. Leveraging established text-image encoding technologies such as CLIP Radford et al. 2021 and BLIP Li et al. 2022 , a bridge for feature interaction between the image modality and the text modality has been constructed. Within the field, two primary approaches have emerged: text-image information interaction and the application of large-scale visual language models (VLMs). The first approach involves integrating corresponding textual information with forged facial image data to augment the dimensionality of feature extraction for forgery detection. The second approach builds upon this foundation by replacing traditional neural network models with more extensive and comprehensively pre-trained VLMs. Through a question-and-answer dialogue mechanism, VLMs can provide detailed semantic information during the deepfake detection process, including specifics about the forged regions, methods employed, and the overall forgery framework Chang et al. 2024 ; Zhang et al. 2025 . However, within the domain, the training and inference mechanisms of VLMs are susceptible to hallucination phenomena, which not only degrade model performance but also risk supplying erroneous forgery cues. This poses significant challenges to the reliability and accuracy of multimodal deepfake detection. To address these challenges, we propose a visually enhanced self-correction framework, denoted as CorrDetail . By providing error-guided questions, CorrDetail establishes a corrective question-and-answer mechanism that cultivates the ability to identify forged details and rectifies training environments prone to hallucinations. In addition, a visual fine-grained detail enhancement module is integrated to furnish CorrDetail with more precise visual forgery cues. Finally, we devise a fused decision strategy that combines visual information compensation with model bias reduction, further strengthening the model’s ability to discriminate extreme samples. Our specific contributions are as follows: • We propose a multimodal forgery detail self-correction framework, alongside the creation of a Self-Correction Visual Question Answering (SCVQA) dataset tailored for facial forgery detection. This framework seamlessly combines a self-correction strategy with a cross-model forgery detail enhancement module, aimed at identifying authentic forgery characteristics and producing intelligible, explanatory text-based forgery clues. • We introduce a novel inference decision mechanism that merges a dual-round question-answering process with multi-scale visual feature interactions, effectively correcting biases inherent in large models. This mechanism entails the construction of multi-expert reasoning decisions, thereby bolstering the reliability and precision of the forgery detection process. • Extensive comparative, ablation, and visualization experiments demonstrate that our approach not only achieves state-of-the-art performance but also delivers precise and accurate forgery details, showcasing remarkable generalization capabilities. 2 Related Works 2.1 Face Forgery Technology GAN-based and autoregressive-based models were pioneers in the field of image generation. Driven by these models, realistic facial modification techniques such as BigGAN Brock et al. 2018 and StarGAN Choi et al. 2017 emerged, enabling traditional facial forgery methods to be categorized into face swapping, face editing, and face reenactment. With the rapid advancement of AIGC technologies, prompt-guided facial image generation methods have become widely accessible, allowing for the creation of diverse facial images with minimal input, such as textual descriptions or sketches. Notable products like Midjourney Midjourney 2022 and Stable Diffusion Stability.ai 2023 have surged in popularity by integrating prompts into the AIGC generation process (e.g., diffusion models), thereby facilitating guided and procedural content generation. This prompt-guided AIGC generation approach starkly contrasts with traditional task-oriented methods Bei et al. 2024 , significantly increasing the difficulty of developing generalized facial forgery detection models. Figure 2: Framework of the proposed CorrDetail . During training, the self-correction Q&A strategy is employed to enhance the forgery clue extraction ability of the VLM, while the visual branch integrates a dual-stream architecture (CLIP + ViT) with the Cross-Model Forgery Detail Enhancement (CFDE) module to provide detailed visual features. In the inference phase, the input image and dual-round prompts are initially processed through the CFDE module for feature alignment and concentration. Subsequently, the final detection outcome is generated through a dual-decision strategy. 2.2 Vision-based Face

Read the complete text