Enhancing Age-Related Robustness in Children Speaker Verification

Vishwas M. Shetty, Jiusi Zheng, Steven M. Lulich, Abeer Alwan · 2025

Read Enhancing Age-Related Robustness in Children Speaker Verification by Vishwas M. Shetty, Jiusi Zheng, Steven M. Lulich, Abeer Alwan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-10511.txt.

Introduction

Vishwas Shetty and colleagues improve child speaker verification against age-related voice change. Their 2025 arXiv paper addresses a core problem in child speech systems. Children's voices shift greatly as they grow each year. A system trained one year may fail the next. Long-term speech data to measure that drift are scarce.

Two fixes are proposed in the work. An adapter module blends local patterns into global voice features. Synthetic audio augmentation adds variety to the training data. A new longitudinal dataset measures performance across year gaps. Combined methods cut error rates at one, two, and three year gaps. Gains were largest for the shortest gap tested. The work supports safer voice tools for children over time.

Catalog record

CREATORVishwas M. Shetty, Jiusi Zheng, Steven M. Lulich, Abeer Alwan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-10511

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Enhancing Age-Related Robustness in Children Speaker Verification Vishwas M. Shetty, Jiusi Zheng, Steven M. Lulich, Abeer Alwan Abstract One of the main challenges in children’s speaker verification (C-SV) is the significant change in children’s voices as they grow. In this paper, we propose two approaches to improve age-related robustness in C-SV. We first introduce a Feature Transform Adapter (FTA) module that integrates local patterns into higher-level global representations, reducing overfitting to specific local features and improving the inter-year SV performance of the system. We then employ Synthetic Audio Augmentation (SAA) to increase data diversity and size, thereby improving robustness against age-related changes. Since the lack of longitudinal speech datasets makes it difficult to measure age-related robustness of C-SV systems, we introduce a longitudinal dataset to assess inter-year verification robustness of C-SV systems. By integrating both of our proposed methods, the average equal error rate was reduced by 19.4%, 13.0%, and 6.1% in the one-year, two-year, and three-year gap inter-year evaluation sets, respectively, compared to the baseline. † † address: 1 Department of Electrical and Computer Engineering, University of California, Los Angeles, USA 2 Speech Language and Hearing Sciences, Indiana University, Bloomington, Indiana, USA { shettyvishwas, zheng94 } @ucla.edu, [email protected], [email protected] 1 Introduction With the advent of online learning, the number of children using online learning applications has increased exponentially. Speaker verification can enable personalized experiences for children in educational applications, virtual assistants, and interactive learning tools by recognizing individual voices. This can enhance engagement and tailor learning materials to each child. The current state of the art speaker verification systems [ 1 , 2 , 3 , 4 ] have achieved significant success on various benchmark datasets [ 5 , 6 , 7 , 8 ] . While speaker verification for adults has seen significant improvements in accuracy due to large datasets and optimized model architectures, speaker verification for children faces greater difficulties. The challenges in children speaker verification are more pronounced compared to adults in the following aspects. First, the limited availability of children’s speech datasets makes it difficult for models to reach their full potential, particularly because insufficient data can lead to overfitting, which in turn reduces the model’s robustness. Many studies have addressed this issue in children’s speaker verification by employing various data augmentation techniques, including SpecAug [ 9 ] , Speed Perturbation [ 10 ] , Noise and RIR [ 11 , 12 ] , Voice Conversion [ 13 , 14 , 15 ] , and a combination of several signal processing approaches [ 16 ] . Second, the anatomical changes in children’s vocal tracts during growth lead to more pronounced variations in their voices [ 17 , 18 , 19 ] , compared to the relatively stable vocal characteristics of adults [ 20 ] . Due to the scarcity of longitudinal speech datasets, research on the impact of age-related changes on the performance of speaker verification systems is limited [ 21 ] , with a few studies addressing inter-year C-SV. However, understanding and improving age robustness in children’s speaker verification systems is crucial in practical applications because children’s voices can change significantly over short periods, leading to potential degradation in verification accuracy over time. Addressing this issue is essential to ensure consistent and reliable performance of these systems in real-world scenarios where a child may use the verification system over several years. In this paper, we propose techniques to improve the inter-age C-SV through two approaches. Drawing inspiration from recent advancements in feature adapters [ 22 , 23 ] , we first propose the Feature Transform Adapter (FTA) which aggregates the original local features at different time scales and resolutions to eliminate disturbances caused by age-related changes in the speaker’s audio characteristics, thereby forming more robust features. We then present a data augmentation method using HiFi-GAN [ 24 ] to generate in-domain synthetic audio from speech spectrograms. Although this approach has been previously applied in other fields [ 25 , 26 ] , we have adapted this data augmentation technique for the children SV task. As a final step, we introduce a longitudinal children’s speech dataset designed to support the evaluation of age-related speech changes and to advance the development and testing of robust speaker processing systems for children. A comprehensive set of ablation studies is conducted to validate the efficacy of the proposed methods. 2 Method 2.1 Feature Transform Adapter Different from inter-year speaker verification for adult speech [ 21 ] (referred to as cross-age in [ 21 ] ), age significantly impacts the performance of C-SV systems. In this context, global features, such as formant distribution [ 27 ] , refer to the stable and consistent aspects of a speaker’s voice that remain relatively unchanged over time, making them crucial for identifying the speaker’s identity. In contrast, local features, such as segmental durations [ 17 ] , exhibit transient, short-term variations that are sensitive to slight changes in the input signal, such as age-related shifts. We hypothesize that as a child ages, local features undergo changes in both the time and frequency domains, whereas global features remain relatively stable. To address this, we introduce an innovative structure referred to as the Feature Transform Adapter (FTA), as depicted in Fig 1 . This adapter aggregates features in a manner that obscures age-related local information while preserving essential global information related to the speaker’s identity. The primary goal of this adapter is to enhance the robustness of the children’s speaker verification system, making it more effective in handling age-related variability and improving overall verification accuracy. The details of the FTA are as follows. Initially, the 80-dimensional filterbank features are layer-normalized and passed through a fully connected layer. The features are then processed through two 1D convolutional layers to aggregate local features along the frequency dimension. The aim is to capture the average variations along the frequency dimension while maintaining the global speaker identity information. The ReLU activation function is employed between the two convolutional layers to introduce non-linearity into the adapter. Finally, the processed features are integrated with the original features via a residual connection. These features can be then used to train the SV system. 2.2 Synthetic Audio Augmentation Synthetic Audio Augmentation (SAA) involves using artificially generated audio samples to diversify training datasets. We assume that such synthesis methods preserve the speaker’s identity but may not accurately retain age-related information due to challenges in capturing age-specific features during synthesis. In this paper, we introduce an SAA method based on HiFi-GAN [ 24 ] . HiFi-GAN includes one generator and two discriminators: the generator converts mel spectrograms into raw waveforms through the convolutional neural network. Among the discriminators, the Multi-Period Discriminator (MPD) captures diverse periodic patterns by analyzing various segments of the audio, while the Multi-Scale Discriminator (MSD) focuses on both short-term and long-term dependencies across multiple resolutions. During training, the generator learns to produce realistic audio waveforms that can deceive both discriminators, while the discriminators simultaneously refine their ability to distinguish between real and generated audio. In this work we directly use the pre-trained open source HiFi-GAN generator [ 28 ] to generate the synthetic audio. For each child’s speech signal from a specific year, we input the corresponding spectrogram into the HiFi-GAN generator,

Read the complete text