Detecting Localized Deepfake Manipulations Using Action Unit-Guided Video Representations

Tharun Anand, Siva Sankar, Pravin Nair · 2025

Read Detecting Localized Deepfake Manipulations Using Action Unit-Guided Video Representations by Tharun Anand, Siva Sankar, Pravin Nair (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-22121.txt.

Description

Small, local edits to a face are the hardest deepfakes to catch, and Tharun Anand and co-authors present a detector built for them in a 2025 paper. New generation methods can raise eyebrows, alter eye shapes, or modify mouth expressions, rather than swapping a whole face. Existing detectors struggle with such fine, localized changes, since most of the frame stays real.

The method uses spatiotemporal representations guided by facial action units. A cross-attention fusion joins features learned from pretext tasks, such as random masking and action unit detection. The resulting embedding encodes subtle local changes well. The authors state this is the first approach designed to generalize to localized edits. Evaluations span several deepfake generation methods.

Catalog record

CREATORTharun Anand, Siva Sankar, Pravin Nair
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE49 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-22121

Browse the full library · About the Tower of Babel