Detecting Localized Deepfake Manipulations Using Action Unit-Guided Video Representations
Tharun Anand, Siva Sankar, Pravin Nair · 2025
Read Detecting Localized Deepfake Manipulations Using Action Unit-Guided Video Representations by Tharun Anand, Siva Sankar, Pravin Nair (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-22121.txt.
Description
Small, local edits to a face are the hardest deepfakes to catch, and Tharun Anand and co-authors present a detector built for them in a 2025 paper. New generation methods can raise eyebrows, alter eye shapes, or modify mouth expressions, rather than swapping a whole face. Existing detectors struggle with such fine, localized changes, since most of the frame stays real.
The method uses spatiotemporal representations guided by facial action units. A cross-attention fusion joins features learned from pretext tasks, such as random masking and action unit detection. The resulting embedding encodes subtle local changes well. The authors state this is the first approach designed to generalize to localized edits. Evaluations span several deepfake generation methods.
Catalog record
| CREATOR | Tharun Anand, Siva Sankar, Pravin Nair |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-22121