STOPA: A Dataset of S ystematic Varia T ion O f Dee P fake A udio for Open-Set Source Tracing and Attribution
Anton, Manasi, Jagabandhu, Vishwanath Pratap, Tomi H, Kamil · 2025
Read STOPA: A Dataset of S ystematic Varia T ion O f Dee P fake A udio for Open-Set Source Tracing and Attribution by Anton, Manasi, Jagabandhu, Vishwanath Pratap, Tomi H, Kamil (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-19644.txt.
Introduction
Anton Firc and co-authors release in 2025 a large data set for tracing fake speech back to the system that made it. Knowing which model built a synthetic voice helps forensic work and deepfake detection. Progress has stalled, though, for lack of a dedicated, well labeled collection built for that task.
Their collection varies the recipe in a controlled way: eight speech models, six voice-shaping models, and many settings, across about seven hundred thousand samples from thirteen synthesis tools. Each sample carries rich labels about how it was made. That care lets researchers test whether a tracer can name the right speech model, the right voice model, or the training weights behind a clip. The authors argue that such control raises the trust of source tracing, and supports both detection work and openness about how voice models are built.
Catalog record
| CREATOR | Anton, Manasi, Jagabandhu, Vishwanath Pratap, Tomi H, Kamil |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-19644
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
STOPA: A Dataset of S ystematic Varia T ion O f Dee P fake A udio for Open-Set Source Tracing and Attribution Anton, Manasi, Jagabandhu, Vishwanath Pratap, Tomi H, Kamil Abstract A key research area in deepfake speech detection is source tracing — determining the origin of synthesised utterances. The approaches may involve identifying the acoustic model (AM), vocoder model (VM), or other generation-specific parameters. However, progress is limited by the lack of a dedicated, systematically curated dataset. To address this, we introduce STOPA, a systematically varied and metadata-rich dataset for deepfake speech source tracing, covering 8 AMs, 6 VMs, and diverse parameter settings across 700k samples from 13 distinct synthesisers. Unlike existing datasets, which often feature limited variation or sparse metadata, STOPA provides a systematically controlled framework covering a broader range of generative factors, such as the choice of the vocoder model, acoustic model, or pretrained weights, ensuring higher attribution reliability. This control improves attribution accuracy, aiding forensic analysis, deepfake detection, and generative model transparency. Firc Chhibber Mishra Singh Kinnunen Malinka Brno University of TechnologyCzech Republic University of Eastern FinlandFinland keywords source tracing, dataset, anti-spoofing, synthetic speech, deepfake † † email: [email protected], [email protected], [email protected], [email protected], [email protected], [email protected] 1 Introduction The proliferation of deepfakes has led to increasingly realistic synthetic speech, posing significant threats to humans and speaker recognition. Malicious actors exploit deepfake speech for impersonation or fraud, with AI-generated voices even used to initiate fraudulent financial transactions [ 1 ] . Various detection approaches, from handcrafted feature-based to deep learning, have been developed to counter these threats [ 2 , 3 ] . While substantial progress has been made, they provide limited insight into how or who generated given speech. Unlike deepfake detection, which determines whether an utterance is real or fake, source tracing (or attack attribution) assumes this classification has already been made. The aim is to identify the entity or system responsible for generating the speech. These methods thus offer deeper insights into the generation process, thereby enhancing forensic investigations [ 4 , 5 ] . Despite recent progress, the lack of specialized datasets limits source tracing research. Existing datasets (reviewed in Section 2.2 ) focus on detection but lack systematic variation in acoustic models, vocoders, and other generative parameters. For example, the widely-adopted ASVspoof dataset series [ 2 , 3 , 6 ] is collected through semi-controlled crowdsourcing, where attack crafting (i.e. text-to-speech or voice conversion system development) follows a common generation protocol—but with lot of flexibility methods and their implementations, chosen by the data contributors. Although this design suits deepfake detection tasks, it prevents systematic analysis of attack characteristics essential for source tracing. To address this research gap, we introduce STOPA 1 1 1 https://doi.org/10.5281/zenodo.15462919 , a new dataset specifically designed for source tracing in deepfake audio detection. Our dataset features a systematic variation of key generative components, allowing researchers to analyze the impact of different model choices. For example, we include four distinct attacks generated using Tacotron2 [ 7 ] : • Pairs of attacks share the same Tacotron2 implementation but differ in their vocoder choice. • Tacotron2 models vary in architecture parameters (e.g., the number of attention heads) and pretrained weights. While much of the recent focus has been on newer text-to-speech (TTS) models, legacy systems like Tacotron2 remain relevant due to their stable implementations, widespread availability, and ability to produce high-quality speech [ 8 ] . If detection systems fail to handle these well-established models, they present an attractive option for attackers. A key difference of STOPA compared to existing datasets and most of the published methodology literature relies on the evaluation protocols design, intended to promote development of source tracing methods for ‘open-world’ settings. To elaborate, the majority of the source-tracing literature approaches the task as a multiclass task [ 4 , 5 , 9 , 10 , 11 ] assuming known attacks during training and handling unknown attacks via an additional fallback class with a dedicated out-of-distribution classifier. Whereas this treatment leads to class priors dependencies in performance metrics, extra classifiers further complicate system design and evaluation. Inspired by the established principles of the speaker detection evaluation benchmarks coordinated by NIST [ 12 ] , we frame source tracing as an open-world detection task that unifies source tracing and ’detecting the unknown’ under a simple and coherent evaluation framework. A test instance is evaluated against a hypothesized spoofing attack, vocoder, or acoustic model. The task is to answer whether or not the test instance originates from the hypothesized source generator (null hypothesis) or not (alternative hypothesis). Similar to NIST SREs, designed to support ’continual growing’ of a speaker database, our protocol forbids the use of other attacks for training or testing purposes: a decision must solely be made by comparing the hypothesized model against a single test instance. This mindset intends to promote the design of deepfake profiling approaches where the database of deepfake ’signatures’ (similar to databases of computer viruses or malware) is allowed to grow dynamically during the lifespan of the profiling system. A ’fixed’ dataset of deepfake generators, addressed as a multiclass task, requires re-training the profiling system whenever a new deepfake generator is encountered. STOPA’s main contributions include : (1) a scalable evaluation protocol enabling open-world source tracing by integrating new attack signatures without retraining, (2) systematic variation in spoofed speech with diverse acoustic models, vocoders, and hyperparameters, and (3) extensive metadata for fine-grained analysis and benchmarking of synthetic speech. The benchmark results and code base are available at https://github.com/Manasi2001/STOPA . Table 1: Overview of related datasets. Column Var. indicates whether the dataset systematically varies acoustic models (AMs) and vocoders (VMs) to facilitate source tracing. Dataset #Utt. #Sys. #Spk. #AM #VM Var. Avail. ASVspoof19 LA [ 2 ] 121K 19 107 19 11 ✗ Pub. ASVspoof21 DF [ 6 ] 593K 100+ 93 19+ 11+ ✗ Pub. ASVspoof5 [ 3 ] 1.2M 32 1,922 22 N/A ✗ Pub. SemaFor [ 13 ] 17K 11 25 11 N/A ✗ Pub. MLAAD [ 14 ] 154K 82 N/A 13 6 ✗ Pub. TIMIT-TTS [ 15 ] 79K 12 37 12 2 ✗ Pub. [ 16 ] 1.8K 5+ 9 N/A N/A ✗ Int. [ 5 ] 63K 8 692 1 8 ✗ Int. [ 17 ] N/A 17 N/A 3 14 ✓ Int. STOPA (ours) 699K 13 107 8 6 ✓ Pub. 2 Related work 2.1 Speech synthesis and voice conversion Speech synthesis typically follows a two-stage pipeline: an acoustic model (AM) generates a spectrogram, which a vocoder model (VM) converts into an audible waveform [ 18 ] . AMs fall into two main categories: text-to-speech (TTS) and voice conversion (VC) [ 1 ] . TTS models transform the text into a speech representation. Relevant AMs include autoregressive models (e.g., Tacotron2 [ 7 ] ), non-autoregressive models (e.g., FastPitch [ 19 ] ), flow-based models (e.g., GlowTTS [ 20 , 21 ] ), and diffusion-based models (e.g., DiffGAN-TTS [ 22 ] ). In contrast, VC algorithms generate speech by combining linguistic content from one input with the vocal characteristics of another. These models may use representation learning techniques (e.g., SpeechSplit [ 23 ] ) or diffusion-based methods (e.g., Diff-VC [ 24 ] ). Most commonly used vocoders include