Rethinking Vision-Language Model in Face Forensics: Multi-Modal Interpretable Forged Face Detector
Xiao Guo, Xiufeng Song, Yue Zhang, Xiaohong Liu, Xiaoming Liu · 2025
Read Rethinking Vision-Language Model in Face Forensics: Multi-Modal Interpretable Forged Face Detector by Xiao Guo, Xiufeng Song, Yue Zhang, Xiaohong Liu, Xiaoming Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-20188.txt.
Description
Xiao Guo and four colleagues built a deepfake detector that not only flags forged faces but explains itself in words. Earlier tools gave a bare yes or no, or an explanation, rarely both. Their system pairs the vision-language model CLIP with a large language model.
Special prompt learning tunes CLIP to forgery clues, helping it catch fakes it never saw in training. The language model then describes which subtle cues drove the verdict. On tests of both detection and explanation quality, the system reached state-of-the-art results. Explainable detection matters when a flagged video could damage a real person's reputation.
Catalog record
| CREATOR | Xiao Guo, Xiufeng Song, Yue Zhang, Xiaohong Liu, Xiaoming Liu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-20188