Fine-Grained Frame Modeling in Multi-head Self-Attention for Speech Deepfake Detection

Phuong Tuan Dat, Duc-Tuan Truong, Long-Vu Hoang, Nguyen Thi Thu Trang · 2026

Read Fine-Grained Frame Modeling in Multi-head Self-Attention for Speech Deepfake Detection by Phuong Tuan Dat, Duc-Tuan Truong, Long-Vu Hoang, Nguyen Thi Thu Trang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-04702.txt.

Description

Tuan Dat Phuong and 3 co-authors refine how transformers spot fake speech in a 2026 paper on deepfake detection. Spoofing artifacts often hide in brief, localized stretches of audio, so attention at the level of individual frames matters greatly.

Their method first selects the most informative frames through a voting module that pools judgments across attention heads. A refinement module then sharpens those selections across network layers, helping the model learn subtle spoofing cues. The approach beat its baseline model on three standard datasets. Error rates fell to low levels on two studio-quality collections and remained competitive on harder in-the-wild recordings. The results support fine-grained frame modeling for robust audio deepfake detection.

Catalog record

CREATORPhuong Tuan Dat, Duc-Tuan Truong, Long-Vu Hoang, Nguyen Thi Thu Trang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE17 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-04702

Browse the full library · About the Tower of Babel