AT-ADD: All-Type Audio Deepfake Detection Challenge Evaluation Plan DOI: XXXXXXX.XXXXXXX Conference: Proceedings of the 33rd ACM International Conference on Multimedia; November 10–14, 2026; Rio de Janeiro, Brazil ISBN: 978-1-4503-XXXX-X/2018/06

Yuankun Xie, Haonan Cheng, Jiayi Zhou, Xiaoxuan Guo, Tao Wang, Jian Liu, Weiqiang Wang, Ruibo Fu, Xiaopeng Wang, Hengyan Huang, Xiaoying Huang, Long Ye, Guangtao Zhai · 2026

Read AT-ADD: All-Type Audio Deepfake Detection Challenge Evaluation Plan DOI: XXXXXXX.XXXXXXX Conference: Proceedings of the 33rd ACM International Conference on Multimedia; November 10–14, 2026; Rio de Janeiro, Brazil ISBN: 978-1-4503-XXXX-X/2018/06 by Yuankun Xie, Haonan Cheng, Jiayi Zhou, Xiaoxuan Guo, Tao Wang, Jian Liu, Weiqiang Wang, Ruibo Fu, Xiaopeng Wang, Hengyan Huang, Xiaoying Huang, Long Ye, Guangtao Zhai (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-08184.txt.

Introduction

Xie and 12 colleagues present the AT-ADD plan for all-type audio deepfake detection. Rapid progress in Audio Large Language Models enabled cheap, high-fidelity generation and manipulation of speech and non-speech audio, including sound effects and music. While these powers foster creativity and content production, they also raise security challenges, since realistic audio deepfakes now spread at scale. Existing countermeasures and benchmarks stay largely speech-centric, relying on speech-specific artifacts with limited robustness to real-world distortions and narrow generalization to varied audio and new spoofing techniques.

Catalog record

CREATORYuankun Xie, Haonan Cheng, Jiayi Zhou, Xiaoxuan Guo, Tao Wang, Jian Liu, Weiqiang Wang, Ruibo Fu, Xiaopeng Wang, Hengyan Huang, Xiaoying Huang, Long Ye, Guangtao Zhai
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38715
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.08184

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

AT-ADD: All-Type Audio Deepfake Detection Challenge Evaluation Plan DOI: XXXXXXX.XXXXXXX Conference: Proceedings of the 33rd ACM International Conference on Multimedia; November 10–14, 2026; Rio de Janeiro, Brazil ISBN: 978-1-4503-XXXX-X/2018/06 Yuankun Xie, Haonan Cheng, Jiayi Zhou, Xiaoxuan Guo, Tao Wang, Jian Liu, Weiqiang Wang, Ruibo Fu, Xiaopeng Wang, Hengyan Huang, Xiaoying Huang, Long Ye, Guangtao Zhai Abstract . The rapid advancement of Audio Large Language Models (ALLMs) has enabled cost-effective, high-fidelity generation and manipulation of both speech and non-speech audio, including sound effects, singing voices, and music. While these capabilities foster creativity and content production, they also introduce significant security and trust challenges, as realistic audio deepfakes can now be generated and disseminated at scale. Existing audio deepfake detection (ADD) countermeasures (CMs) and benchmarks, however, remain largely speech-centric, often relying on speech-specific artifacts and exhibiting limited robustness to real-world distortions, as well as restricted generalization to heterogeneous audio types and emerging spoofing techniques. To address these gaps, we propose the All-Type Audio Deepfake Detection (AT-ADD) Grand Challenge for ACM Multimedia 2026, designed to bridge controlled academic evaluation with practical multimedia forensics. AT-ADD comprises two tracks: (1) Robust Speech Deepfake Detection , which evaluates detectors under real-world scenarios and against unseen, state-of-the-art speech generation methods; and (2) All-Type Audio Deepfake Detection , which extends detection beyond speech to diverse, unknown audio types and promotes type-agnostic generalization across speech, sound, singing, and music. By providing standardized datasets, rigorous evaluation protocols, and reproducible baselines, AT-ADD aims to accelerate the development of robust and generalizable audio forensic technologies, supporting secure communication, reliable media verification, and responsible governance in an era of pervasive synthetic audio. 1. Introduction (a) Figure 1. AT-ADD challenge overview. Recent advances in audio generation technologies, particularly Audio Large Language Models (ALLMs), have significantly improved the realism, scalability, and accessibility of synthetic audio. Modern generative systems are now capable of producing high-fidelity audio across a wide range of content types, including speech, environmental sounds, singing voices, and music. While these developments greatly benefit content creation and multimedia applications, they also introduce serious security and trust risks, as audio deepfakes can be generated and disseminated at scale with increasing realism. Despite growing research efforts in audio deepfake detection (ADD), existing methods and benchmarks remain largely focused on speech and are typically evaluated under relatively controlled conditions. Consequently, current countermeasures (CMs) often rely on speech-specific artifacts and exhibit limited robustness when deployed in real-world scenarios involving channel variability, environmental noise, compression, replay attack and other distortions. Furthermore, their generalization capability remains insufficient when faced with emerging generation paradigms, such as ALLM-based synthesis and neural codec-driven generation, as well as diverse non-speech audio types. To address these challenges, we introduce the AT-ADD (All-Type Audio Deepfake Detection) Grand Challenge at ACM Multimedia 2026. The goal of AT-ADD is to bridge the gap between idealized research settings and real-world multimedia forensics by systematically evaluating both robustness under realistic conditions and generalization across audio types and unseen generation methods. Track 1: Robust Speech Deepfake Detection. This track focuses on robustness in real-world speech deepfake detection. We construct a large-scale dataset (AT-ADD Track 1) covering more than 40 state-of-the-art speech generation models, spanning vocoder-based, neural codec-based, and diffusion-based paradigms, with particular emphasis on emerging ALLM-driven synthesis. The real speech data are collected from multiple public datasets and in-the-wild recordings, covering diverse languages, recording devices (e.g., smartphones, in-vehicle systems, wearable devices), and acoustic environments. To simulate realistic deployment conditions, we further introduce a wide range of degradations, including background noise, reverberation, replay attack, compression, resampling, and speed perturbation. This track aims to evaluate the robustness and cross-domain generalization of detection systems under complex real-world conditions, encouraging models to move beyond reliance on narrow artifact cues toward learning more fundamental and transferable forensic representations. Track 2: All-Type Audio Deepfake Detection. Building upon Track 1, this track extends the detection task from speech to all types of audio, including environmental sounds, singing voices, and music. We construct a new dataset (AT-ADD Track 2) covering more than 70 audio generation models across different generation mechanisms. Unlike Track 1, no additional signal-level perturbations are introduced in this track, allowing for a more controlled investigation of cross-type generalization. Real audio is collected from multiple public datasets, while synthetic audio is generated under a unified framework without introducing additional distortions. Participants are required to design type-agnostic CMs capable of distinguishing real and fake audio under unseen audio categories. This track encourages models to capture shared synthesis artifacts across different audio types, promoting the development of universal audio deepfake detection methods. Together, the two tracks form a progressive evaluation framework: Track 1 emphasizes robustness under realistic conditions within the speech domain, while Track 2 focuses on generalization across audio types and domains. This design reflects the evolving landscape of audio deepfake threats—from speech-centric manipulation to open-domain audio generation—and provides a structured benchmark for advancing robust and generalizable audio forensic technologies. 2. Challenge Tasks The AT-ADD challenge is organized into two complementary and progressively structured tracks under a closed setting . This design aims to assess which types of CMs can achieve stronger generalization and robustness under limited data conditions. Participants are required to train their CMs strictly using only the data provided by the organizers, thereby ensuring a fair and controlled comparison across methods. 2.1. Track 1: Robust Speech Deepfake Detection Goal. Track 1 aims to bridge the gap between existing benchmarks and real-world deployment scenarios for speech deepfake detection. It evaluates whether a detector can remain reliable under realistic domain shifts and practical post-processing effects, while maintaining strong performance against modern high-fidelity synthesis systems. Task definition. Given an input speech utterance, participants are required to predict whether the input is real or fake . In this task, fake refers specifically to deepfake speech generated using deep neural network-based methods, while real refers to non-deepfake speech. It should be noted that signal distortions or transformations, such as compression, resampling, speed perturbation, and pitch shifting, as well as replay-based attacks, do not change the original real/fake label in this task. The training and development data are fully provided by the organizers, and the use of external data is not allowed under the closed setting. The evaluation set includes deepfake samples generated by methods that are unseen during training and reflect recent state-of-the-art generation techniques. Meanwhile, the real speech in the evaluation set is collected under realistic conditions, involving variations in recording devices, acoustic environments, languages, and other real-world factors. Long-term research target. Track 1 is designed to promote the development of practically deployable CMs that generalize across unseen generators and real-world recording conditions. By combining controlled training data with an evaluation set featuring both unseen deepfake methods and significant domain shifts, this track encourages advances in robustness, generalization, and reliability beyond conventional clean-benchmark settings. 2.2. Track 2: All-Type Audio Deepfake Detection Goal. Track 2 targets universal audio deepfake detection across heterogeneous audio types and aims to develop type-agnostic detectors that generalize across both audio types and unseen generation methods. Task definition. Given an input audio clip of unknown type, participants are required to determine whether it is real or fake . In this task, fake denotes deepfake audio generated by deep neural network-based methods, whereas real denotes non-deepfake audio.

Read the complete text