Fine-Grained Frame Modeling in Multi-head Self-Attention for Speech Deepfake Detection
Phuong Tuan Dat, Duc-Tuan Truong, Long-Vu Hoang, Nguyen Thi Thu Trang · 2026
Read Fine-Grained Frame Modeling in Multi-head Self-Attention for Speech Deepfake Detection by Phuong Tuan Dat, Duc-Tuan Truong, Long-Vu Hoang, Nguyen Thi Thu Trang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-04702.txt.
Description
Tuan Dat Phuong and 3 co-authors refine how transformers spot fake speech in a 2026 paper on deepfake detection. Spoofing artifacts often hide in brief, localized stretches of audio, so attention at the level of individual frames matters greatly.
Their method first selects the most informative frames through a voting module that pools judgments across attention heads. A refinement module then sharpens those selections across network layers, helping the model learn subtle spoofing cues. The approach beat its baseline model on three standard datasets. Error rates fell to low levels on two studio-quality collections and remained competitive on harder in-the-wild recordings. The results support fine-grained frame modeling for robust audio deepfake detection.
Catalog record
| CREATOR | Phuong Tuan Dat, Duc-Tuan Truong, Long-Vu Hoang, Nguyen Thi Thu Trang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 17 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-04702