Face2Parts: Exploring Coarse-to-Fine Inter-Regional Facial Dependencies for Generalized Deepfake Detection

KUTUB UDDIN 1, NUSRAT TASNIM 1 , AND BYUNG TAE OH. 1 · 2026

Read Face2Parts: Exploring Coarse-to-Fine Inter-Regional Facial Dependencies for Generalized Deepfake Detection by KUTUB UDDIN 1, NUSRAT TASNIM 1 , AND BYUNG TAE OH. 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-26036.txt.

Introduction

Uddin, Tasnim, and Oh present Face2Parts, a deepfake detector that reads faces from coarse to fine. Past detectors each focus on one region, like lips or eyes. Face2Parts extracts features from the full frame, the face, and key parts separately. It then models how those regions relate to each other. A channel-attention step and triplet learning capture the links. On the FF++ benchmark, the method scores an AUC of 98.42 percent. Scores stay strong across eight datasets and many manipulation types, the authors report.

Catalog record

CREATORKUTUB UDDIN 1, NUSRAT TASNIM 1 , AND BYUNG TAE OH. 1
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57395
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.26036

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Face2Parts: Exploring Coarse-to-Fine Inter-Regional Facial Dependencies for Generalized Deepfake Detection KUTUB UDDIN 1, NUSRAT TASNIM 1 , AND BYUNG TAE OH. 1 Abstract Multimedia data, particularly images and videos, is integral to various applications, including surveillance, visual interaction, biometrics, evidence gathering, and advertising. However, amateur or skilled counterfeiters can simulate them to create deepfakes, often for slanderous motives. To address this challenge, several forensic methods have been developed to ensure the authenticity of the content. The effectiveness of these methods depends on their focus, with challenges arising from the diverse nature of manipulations. In this article, we analyze existing forensic methods and observe that each method has unique strengths in detecting deepfake traces by focusing on specific facial regions, such as the frame, face, lips, eyes, or nose. Considering these insights, we propose a novel hybrid approach called Face2Parts based on hierarchical feature representation ( H ​ F ​ R HFR ) that takes advantage of coarse-to-fine information to improve deepfake detection. The proposed method involves extracting features from the frame, face, and key facial regions (i.e., lips, eyes, and nose) separately to explore the coarse-to-fine relationships. This approach enables us to capture inter-dependencies among facial regions using a channel-attention mechanism and deep triplet learning. We evaluated the proposed method on benchmark deepfake datasets in both intra-, inter-dataset, and inter-manipulation settings. The proposed method achieves an average AUC of 98.42% on FF++, 79.80% on CDF1, 85.34% on CDF2, 89.41% on DFD, 84.07% on DFDC, 95.62% on DTIM, 80.76% on PDD, and 100% on WLDR, respectively. The results demonstrate that our approach generalizes effectively and achieves promising performance to outperform the existing methods. † † history: Date of publication xxxx 00, 0000, date of current version xxxx 00, 0000. † † doi: 10.1109/ACCESS.2017.DOI † † address: School of Electronics and Information Engineering, Korea Aerospace University, Goyang, South Korea (e-mail: [email protected], [email protected], [email protected]) † † titlenote: This work was supported by the IITP(Institute of Information & Communications Technology Planning & Evaluation)-ICAN(ICT Challenge and Advanced Network of HRD) grant funded by the Korea government(Ministry of Science and ICT)(IITP-2026-RS-2024-00437857) and by the 2025 Korea Aerospace University AIRBUS Foundation Research Grant. † † corresponding: Corresponding author: Kutub Uddin (e-mail: [email protected]). I Introduction Modern cameras have become more affordable and user-friendly, allowing anyone, regardless of technical expertise, to capture images and videos. As a result, they are now widely used in various fields, including visual communication, biometrics, evidence collection, surveillance systems, and election campaigns [ 1 ] . Additionally, people frequently share and post images and videos with family and colleagues on social media platforms like Facebook, LinkedIn, and Instagram. However, these images and videos can be altered or generated [ 8 ] by both amateur and professional counterfeiters using editing software or artificial intelligence (AI) techniques [ 3 ] for unethical purposes [ 6 , 32 ] . AI technologies, particularly generative adversarial networks (GANs) [ 8 , 2 ] , are highly adept at creating realistic deepfakes, capable of deceiving even the human eye. According to Surfshark [ 4 ] , there were 22 reported deepfake incidents involving globally recognized individuals from 2017 to 2022. Remarkably, this number nearly doubled in just one year, reaching 42 cases in 2023. The trend escalated rapidly, with 150 cases in 2024 and 179 in 2025, marking an approximate increase of 257% and 326% compared to 2022, respectively. These significant threats to multimedia content, especially images and videos, have made deepfakes increasingly effective at deceiving human perception. Despite their impressive capabilities, GAN-generated deepfakes leave behind subtle artifacts that can reveal their synthetic nature [ 3 , 65 ] to distinguish from authentic content. (a) (b) Fig. 1: Key concepts of the proposed method: (a) The conventional deepfake detection, which relies solely on facial artifact analysis. (c) In contrast, the proposed method, which leverages hierarchical information across multiple levels, coarse (frame), medium (face), and fine-grained (lips, left eye, right eye, and nose), aims to improve deepfake detection performance. Several methods [ 5 ] have been proposed to detect unnatural patterns in deepfakes. However, detecting deepfakes is highly dependent on the type of manipulations involved [ 7 ] , requiring specialized approaches for each manipulation. For example, a method trained on a dataset designed for face-swapping may not generalize well to other types, such as expression alteration. This limitation arises because most state-of-the-art (SoTA) methods rely on analyzing the face region alone to identify deepfake artifacts. While a few methods [ 10 , 66 ] have attempted to identify common properties across different types of deepfakes to enable generalization, their effectiveness is often constrained by specific assumptions. It exhibits less performance when applied to diverse manipulations [ 9 ] . Some methods are considered anti-forensic attacks [ 12 , 13 , 59 ] and countermeasures [ 11 , 52 ] to provide robust deepfake detection. This highlights the need for more effective, generalized, and robust approaches to address the evolving challenges of deepfake detection. To address these gaps, we propose a novel hybrid approach based on hierarchical feature representation ( HFR ) as illustrated in Figure 1 to enhance generalization. Unlike conventional methods [ 5 , 10 ] that primarily focus on the face region alone (Figure 1 (a)), the proposed approach extracts multi-level features (Figure 1 (b)), capturing coarse-, medium-, and fine-grained information. The proposed framework consists of three hierarchical levels of feature extraction: (a) level-1 (frame), which captures global features from the entire frame and provides coarse-grained information; (b) level-2 (face), which focuses on the cropped face region to capture medium-grained information; and (c) level-3 (left eye, right eye, lips, and nose), which extracts fine-grained information. This hierarchical approach ensures comprehensive detection by leveraging both global and local contexts, thereby significantly improving overall performance across unseen datasets. The key insights of the article are summarized as follows: • We analyze SoTA methods and identify their unique strengths in detecting deepfake traces by focusing on specific facial regions such as the frame, face, lips, eyes, or nose, depending on the type of manipulation. • To enhance generalization, we propose a novel hybrid approach based on HFR that extracts features from the frame, face, and key facial regions (left eye, right eye, lips, and nose), while capturing their inter-dependencies through a channel-attention mechanism within a deep triplet learning framework. • We demonstrate the effectiveness of the proposed HFR through extensive evaluations on benchmark datasets, achieving promising performance in intra-dataset, inter-dataset, and inter-manipulation scenarios. II Related Study This section presents a detailed review of SoTA deepfake detection methods, grouped into conventional, deep learning-based, and hybrid approaches as shown in Figure 2 . II-A Conventional Deepfake Detection Conventional approaches primarily rely on hand-crafted patterns, such as pixel correlations, facial asymmetries, or textures, to detect deepfakes using traditional machine learning techniques as depicted in Figure 2 (a). For instance, Matern et al. [ 14 ] utilized correlation features between the left and right eyes for deepfake detection. However, this method is fully dependent on color information from the eyes and does not account for other facial regions. Guarnera et al. [ 15 ] explored pixel correlations to extract convolutional traces, employing machine learning techniques for classification. However, methods focusing solely on pixel relationships

Read the complete text