Rethinking Vision-Language Model in Face Forensics: Multi-Modal Interpretable Forged Face Detector

Xiao Guo, Xiufeng Song, Yue Zhang, Xiaohong Liu, Xiaoming Liu · 2025

Read Rethinking Vision-Language Model in Face Forensics: Multi-Modal Interpretable Forged Face Detector by Xiao Guo, Xiufeng Song, Yue Zhang, Xiaohong Liu, Xiaoming Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-20188.txt.

Description

Xiao Guo and four colleagues built a deepfake detector that not only flags forged faces but explains itself in words. Earlier tools gave a bare yes or no, or an explanation, rarely both. Their system pairs the vision-language model CLIP with a large language model.

Special prompt learning tunes CLIP to forgery clues, helping it catch fakes it never saw in training. The language model then describes which subtle cues drove the verdict. On tests of both detection and explanation quality, the system reached state-of-the-art results. Explainable detection matters when a flagged video could damage a real person's reputation.

Catalog record

CREATORXiao Guo, Xiufeng Song, Yue Zhang, Xiaohong Liu, Xiaoming Liu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-20188

Browse the full library · About the Tower of Babel