Text-Dependent Speaker Verification (TdSV) Challenge 2024: Team Naïve System Report
Amir Mohammad Rostami, Pourya Jafarzadeh · 2026
Read Text-Dependent Speaker Verification (TdSV) Challenge 2024: Team Naïve System Report by Amir Mohammad Rostami, Pourya Jafarzadeh (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-14896.txt.
Introduction
Rostami and Jafarzadeh present a system entered in the 2024 Text-Dependent Speaker Verification contest, achieving a minimum detection cost of 0.0461 with an equal error rate of 1.3 percent. Adapted ResNet-TDNN and NeXt-TDNN networks, originally trained on VoxCeleb, suit the short challenge duration and limited resources. A lightweight EfficientNet-A0 model trained on challenge data strengthens the ensemble. Advanced architectures, extensive data augmentation, and optimised hyperparameters combine in the system, with multi-model ensemble learning claimed effective for both speaker and phrase verification.
Catalog record
| CREATOR | Amir Mohammad Rostami, Pourya Jafarzadeh |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 28039 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.14896
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Text-Dependent Speaker Verification (TdSV) Challenge 2024: Team Naïve System Report Amir Mohammad Rostami, Pourya Jafarzadeh Abstract This paper presents a system for the 2024 Text-Dependent Speaker Verification (TdSV) Challenge. The system achieved a Minimum Detection Cost Function (MinDCF) of 0.0461 and an Equal Error Rate (EER) of 1.3%. Our approach focused on adapting existing state-of-the-art neural networks, ResNet-TDNN and NeXt-TDNN, originally trained on the VoxCeleb dataset. This strategy was chosen because of the limited challenge duration and the available resources at the time. In addition, we designed a lightweight and resource-efficient model, EfficientNet-A0, trained specifically on the challenge dataset to improve adaptation and strengthen the ensemble approach. Our system combines advanced neural architectures, extensive data augmentation, and optimised hyperparameters. These components helped achieve strong performance in text-dependent speaker verification. The results also demonstrate the effectiveness of multi-model ensemble learning for both speaker and phrase verification. † † address: 1 Self-Organized and Independent Participants † † email: [email protected] [email protected] 1 Introduction Figure 1: Naïve team text-dependent speaker verification system architecture. The system consists of three Speaker Embedding Extractors (SEEs), a wav2vec 2.0 Phrase Classifier (PhC), individual scorers, and a score fusion mechanism. Text-Dependent Speaker Verification (TdSV) plays a crucial role in biometric security systems, particularly in applications where both speaker identity and the spoken content are essential for authentication. Unlike Text-Independent Speaker Verification (TiSV), where the verification task can be performed with arbitrary speech content, TdSV mandates the speaker to pronounce specific or prompted phrases. This introduces an additional challenge, as the system must accurately recognise the speaker’s identity while also verifying the correctness of the spoken phrase, thereby integrating speaker recognition and speech content verification in tandem [ 15 , 6 ] . The primary advantage of TdSV systems is their ability to enhance security through the fusion of both speaker characteristics and linguistic content. This dual requirement makes TdSV systems more robust against spoofing attacks and phrase-based replay attacks, a key advantage over TiSV methods [ 9 ] . However, this task is inherently more complex due to the need for precise modelling of both voice and phrase-specific patterns, leading to a more demanding requirement for feature extraction and model design [ 3 ] . The 2024 Text-Dependent Speaker Verification (TdSV) Challenge [ 13 ] provided an opportunity to push the boundaries of current state-of-the-art systems. The challenge encouraged participants to explore innovative methods for handling the intricacies of both speaker identification and phrase detection, leveraging recent advances in deep learning, speaker embedding techniques, and data augmentation strategies. In recent years, architectures such as Time Delay Neural Networks (TDNNs) [ 8 ] , convolutional neural networks (CNNs) [ 5 ] , and transformer-based models [ 2 ] have become pivotal in achieving high accuracy in speaker verification tasks. The integration of these techniques has further improved the ability of TdSV systems to generalise across different recording conditions and linguistic variations [ 11 ] . In this paper, we present the text-dependent speaker verification system of the Naïve team, which combines several state-of-the-art neural network architectures for robust speaker verification. Due to the challenge constraints, including a limited timeline of nine weeks and no dedicated GPU access, we focused on adapting pretrained models. Our approach used two pretrained neural networks, ResNet-TDNN and NeXt-TDNN, trained on the VoxCeleb dataset to make the best use of the available resources and limited time. In parallel, we trained a lightweight and resource-efficient model, EfficientNet-A0, on the challenge dataset to improve adaptation to the challenge requirements and strengthen the ensemble performance in low-resource settings. This combination of fine-tuning pretrained models and introducing a lightweight model allowed the ensemble approach to perform well across different verification tasks. As shown in Figure 1 , the system is designed to verify speakers by analysing both the speaker’s voice characteristics and the spoken content. The verification process consists of two main tasks: speaker verification and phrase verification. The system integrates three different deep neural networks, NeXt-TDNN-SEE [ 4 ] , ResNet-TDNN-SEE [ 10 ] , and EfficientNet-A0-SEE [ 7 ] , where each model acts as a Speaker Embedding Extractor (SEE). These models process the trial audio and generate high-dimensional speaker embeddings (1xV) that capture the unique characteristics of a speaker’s voice. The generated embeddings are then passed to a dedicated Scorer module, which compares the trial embeddings with the enrolled speaker identity stored in a database of enrollment embeddings. The Scorer module, illustrated in Figure 2 , plays a pivotal role in the verification process. It computes the similarity between the enrollment and trial embeddings using cosine similarity, a widely adopted metric in speaker verification that measures the angle between two vectors in the embedding space, providing a normalised measure of proximity between the embeddings. To further refine the scoring process, the system applies S-norm normalisation, which adjusts the raw similarity score based on the distribution of speaker embeddings in the training database. The normalised score is computed as follows: \text{Score}_{\text{S-norm}}(e,t)=\frac{\text{Score}(e,t)-\mu_{\text{trial}}}{\sigma_{\text{trial}}}\\ +\frac{\text{Score}(e,t)-\mu_{\text{enroll}}}{\sigma_{\text{enroll}}} (1) where: • \text{Score}(e,t) is the raw cosine similarity between the enrollment embedding e and the trial embedding t . • \mu_{\text{trial}} and \sigma_{\text{trial}} represent the mean and standard deviation of the trial scores obtained against a cohort of enrollment embeddings from the training dataset. • \mu_{\text{enroll}} and \sigma_{\text{enroll}} represent the mean and standard deviation of the enrollment scores obtained against a cohort of trial embeddings from the training dataset. This scoring mechanism ensures that the final similarity score is robust, compensating for potential variations in speaker representations caused by different environmental conditions, such as noise or varying recording settings. In addition to speaker verification, the system incorporates a Phrase Verification module, which verifies that the spoken phrase matches the enrolled target phrase. This is achieved through the Wav2vec-PhC (Phrase Classifier) module. The wav2vec 2.0 [ 1 ] model serves as a powerful feature extractor for the spoken content, and the extracted features are fed into fully connected layers for classification of the phrase into predefined categories. The phrase score is then combined with the speaker score within a multi-task verification framework. The scores from the speaker verification module and the phrase verification module are fused to generate the final decision score. This score fusion ensures that the system makes decisions based on both who is speaking and what is being said, significantly enhancing its reliability in text-dependent speaker verification tasks. The system’s architecture capitalises on the complementary strengths of each model in the ensemble and the robust scoring mechanism to improve overall performance. By leveraging the ensemble learning approach, the system benefits from the individual strengths of the NeXt-TDNN, ResNet-TDNN, and EfficientNet models, yielding improved generalisation across various speaker verification scenarios. The proposed system offers a comprehensive solution that integrates multi-model speaker verification with content verification, making it particularly well-suited for text-dependent speaker verification tasks. The use of advanced deep learning architectures, a robust scoring mechanism, and scoring fusion techniques led to strong performance in this challenging domain. Figure 2: Scorer module architecture, showing the cosine similarity calculation between enrollment and trial embeddings, with S-norm normalisation based on the training embedding database. 2 Dataset The evaluation dataset for this challenge was derived from the DeepMine corpus [ 14 , 12 ] , a versatile and