TruthLens : Explainable DeepFake Detection for Face Manipulated and Fully Synthetic Data
Rohit Kundu, Athula Balachandran, Amit K. Roy-Chowdhury · 2025
Read TruthLens : Explainable DeepFake Detection for Face Manipulated and Fully Synthetic Data by Rohit Kundu, Athula Balachandran, Amit K. Roy-Chowdhury (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-15867.txt.
Description
Abstract Detecting DeepFakes has become a crucial research area as the widespread use of AI image generators enables the effortless creation of face-manipulated and fully synthetic content, yet existing methods are often limited to binary classification (real vs. fake) and lack interpretability.
Catalog record
| CREATOR | Rohit Kundu, Athula Balachandran, Amit K. Roy-Chowdhury |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-15867
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
TruthLens : Explainable DeepFake Detection for Face Manipulated and Fully Synthetic Data Rohit Kundu, Athula Balachandran, Amit K. Roy-Chowdhury Abstract Detecting DeepFakes has become a crucial research area as the widespread use of AI image generators enables the effortless creation of face-manipulated and fully synthetic content, yet existing methods are often limited to binary classification (real vs. fake) and lack interpretability. To address these challenges, we propose TruthLens , a novel and highly generalizable framework for DeepFake detection that not only determines whether an image is real or fake but also provides detailed textual reasoning for its predictions. Unlike traditional methods, TruthLens effectively handles both face-manipulated DeepFakes and fully AI-generated content while addressing fine-grained queries such as “Does the eyes/nose/mouth look real or fake?” The architecture of TruthLens combines the global contextual understanding of multimodal large language models like PaliGemma2 with the localized feature extraction capabilities of vision-only models like DINOv2. This hybrid design leverages the complementary strengths of both models, enabling robust detection of subtle manipulations while maintaining interpretability. Extensive experiments on diverse datasets demonstrate that TruthLens outperforms state-of-the-art methods in detection accuracy (by 2-14%) and explainability, in both in-domain and cross-data settings, generalizing effectively across traditional and emerging manipulation techniques. Figure 1 : Illustration of Explanations : Comparison of explanations generated by the pretrained PaLiGemma2 [ 53 ] multimodal large language model (MLLM) and our proposed TruthLens framework on a face-manipulated image (from the FaceForensics++ [ 47 ] dataset) and a fully AI-generated image (produced by StableVideoDiffusion [ 8 ] and sourced from the DVF [ 52 ] dataset). The pretrained MLLM fails to detect subtle inconsistencies in the manipulated images, resulting in incorrect explanations. In contrast, TruthLens provides accurate predictions along with detailed, fine-grained reasoning for the detected manipulations. 1 Introduction With the advent of synthetic media generation technology [ 30 , 46 ] hyper-realistic manipulated images can be created with minimal technical knowledge, which can even deceive humans. Until recently, DeepFakes only referred to manipulations of faces [ 32 , 58 , 23 ] using techniques like face-swapping [ 22 , 23 , 48 ] or lip syncing [ 6 , 43 , 15 ] . However, state-of-the-art image-to-video (I2V) and text-to-video (T2V) models [ 60 , 46 , 72 ] enable malicious actors to manipulate beyond faces, generating entire images/videos. While several DeepFake detection frameworks [ 14 , 54 , 64 , 29 ] have been proposed, most of them focus on face-manipulated content and are limited to binary real vs. fake classification. These methods lack explicit, interpretable explanations for their predictions, which is a critical requirement in scenarios requiring human understanding. Explainability fosters trust and transparency in AI systems, making it an essential component of robust DeepFake detection frameworks. Thus, there is a pressing need for a highly generalizable DeepFake detection framework that can effectively handle both traditional face-manipulated content and fully AI-generated media and can go beyond simple binary classification by offering easy-to-understand, human-interpretable results. This would enable accurate detection as well as actionable insights into the nature and location of manipulations, addressing the dual challenges of generalization and explainability in DeepFake detection. Recently, multimodal large language models (MLLMs) have demonstrated remarkable problem-solving capabilities across diverse tasks [ 4 , 69 , 73 ] , driven by their ability to learn powerful multimodal representations. These models hold significant potential for addressing the explainability challenge in DeepFake detection. Some methods [ 28 , 50 ] have explored leveraging pretrained MLLMs like GPT-4V [ 1 ] and Gemini-1.0 [ 56 ] for this purpose. However, pretrained MLLMs are typically optimized for general-purpose tasks, such as image captioning [ 56 , 36 ] , visual question answering [ 12 , 31 , 13 ] , etc., and lack the domain-specific adaptation required to reliably generate explanations for DeepFake detection [ 11 ] . This limitation is evident in our evaluation of the pretrained PaliGemma2 [ 53 ] MLLM (example in Fig. 1 , results in Table 3 ), which highlights the need for task-specific fine-tuning to achieve reliable and interpretable outputs in this domain. To address this challenge, we propose TruthLens , a comprehensive DeepFake explainability framework that goes beyond binary classification to provide detailed textual reasoning for its predictions. Designed to be highly generalizable, TruthLens handles both face-manipulated and fully AI-generated content, answering nuanced queries such as “ Does the eyes/nose/mouth look real or fake? ” This flexibility enables deeper insights into manipulations, enhancing its utility in diverse scenarios. Existing DeepFake explainability methods [ 11 , 70 , 52 ] rely solely on fine-tuning Vision-Language Models (VLMs), which often miss subtle manipulations. In face-manipulated images, alterations are confined to small pixel regions, unlike fully synthetic content where the entire frame is manipulated. VLMs can only provide global context [ 59 ] , so \mathcal{X}^{2} -DFD [ 11 ] and DD-VQA [ 70 ] crop faces as a preprocessing step. However, this approach fails to generalize when full frames need analysis, as in fully synthetic content. Similarly, methods like MM-Det [ 52 ] which are tailored for fully-synthetic content explanatoin fail to capture localized inconsistencies in face-manipulated data. To address these limitations, TruthLens integrates features from both PaliGemma2 [ 53 ] MLLM and DINOv2 [ 41 ] vision-only model (VOM). PaliGemma2 provides global context through vision-language capabilities, enabling a holistic image content understanding, while DINOv2 captures localized inconsistencies by extracting fine-grained features from image patches. This hybrid approach ensures comprehensive detection of manipulations by leveraging both global and local feature representations. The contributions of this work are as follows. • We propose TruthLens , a novel and highly generalizable framework for DeepFake detection. Unlike existing methods that are often restricted to face-manipulated content, TruthLens is designed to effectively handle both face-manipulated DeepFakes and fully AI-generated content. This versatility ensures its applicability across a diverse range of DeepFake scenarios, addressing the growing complexity of manipulation techniques. • TruthLens goes beyond simple real vs. fake classification by providing detailed textual reasoning for its predictions. By generating human-readable explanations, TruthLens enhances transparency and supports informed decision-making. • Moving beyond naive MLLM fine-tuning, we design a robust approach where TruthLens integrates features from both the PaliGemma2 [ 53 ] MLLM and the DINOv2 [ 41 ] VOM. This hybrid design leverages the global context provided by the MLLM and the localized detail captured by the VOM, enabling accurate detection of subtle manipulations while maintaining interpretability. • We show that TruthLens generalizes well across traditional face manipulations and fully AI-generated content, outperforming state-of-the-art methods in detection accuracy and explainability across several diverse datasets. Figure 2 : The overall framework for TruthLens utilizes the PaliGemma2 [ 53 ] MLLM, which combines the SigLIP-So400m/14 [ 3 ] vision encoder and the Gemma2 [ 57 ] LLM. Since SigLIP features are already compatible with Gemma2, we directly use them, but DINOv2 features require compatibility adaptation. Thus, in Stage-1 (Sec. 3.4.1 ), we train an adapter using the LCS-558K [ 36 ] image-captioning dataset to align DINOv2 features with Gemma2. In Stage-2 (Sec. 3.4.2 ), we fine-tune the adapter and Gemma2 LLM with DD-VQA [ 70 ] and DVF [ 52 ] language annotated datasets, enabling explainable DeepFake detection on both face-manipulated and fully synthetic