Deepfake Audio Detection Using Self-supervised Fusion Representations

Khalid Zaman, Qixuan Huang, Muhammad Uzair, Masashi Unoki · 2026

Read Deepfake Audio Detection Using Self-supervised Fusion Representations by Khalid Zaman, Qixuan Huang, Muhammad Uzair, Masashi Unoki (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-03420.txt.

Description

Khalid Zaman, Qixuan Huang, Muhammad Uzair, and Masashi Unoki describe a challenge entry for detecting deepfakes separately in speech and in background sound. In the CompSpoofV2 data, either component can be faked alone, so a single real-or-fake verdict is not enough.

Their dual-branch system pairs a speech model with an environmental sound model, then exchanges information through cross-attention and a matching head that compares the two representations. A final classifier outputs verdicts for the whole clip, the speech, and the environment. On the test set it beat the baseline, with solid F1 and environmental error scores.

Catalog record

CREATORKhalid Zaman, Qixuan Huang, Muhammad Uzair, Masashi Unoki
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE19 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.03420

Browse the full library · About the Tower of Babel