Voice Cloning for Dysarthric Speech Synthesis: Addressing Data Scarcity in Speech-Language Pathology
Birger Moëll, Fredrik Sand Aronsson · 2025
Read Voice Cloning for Dysarthric Speech Synthesis: Addressing Data Scarcity in Speech-Language Pathology by Birger Moëll, Fredrik Sand Aronsson (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-01266.txt.
Introduction
Birger Moell and Fredrik Sand Aronsson test voice cloning for people with dysarthria in a 2025 study. Dysarthria makes speech hard to understand, and recordings of such speech are scarce and private. Cloned voices could supply training data for diagnosis and therapy tools without exposing patients.
Using a public dataset of dysarthric and typical speech, the team cloned voices on a commercial platform, matched by gender. A licensed speech pathologist judged samples blind. She spotted dysarthria in every case and gender in nearly all, yet mistook thirty percent of synthetic samples for real ones. The clones kept the disordered traits well. The team release their synthetic dataset for further work.
Catalog record
| CREATOR | Birger Moëll, Fredrik Sand Aronsson |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-01266
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Voice Cloning for Dysarthric Speech Synthesis: Addressing Data Scarcity in Speech-Language Pathology Birger Moëll, Fredrik Sand Aronsson Abstract This study investigates the use of voice cloning technology to generate synthetic speech that accurately replicates the unique speech patterns of individuals with dysarthria. Utilizing the TORGO dataset, which comprises speech data from speakers with dysarthria, we aimed to address challenges in data scarcity and privacy that hinder the development of robust models in speech-language pathology. Our primary contributions include: demonstrating the effectiveness of voice cloning in preserving dysarthric speech characteristics; showcasing the utility of speech-to-speech voice cloning techniques; identifying differences between real and synthetic data; and discussing the implications of synthetic data and voice cloning for improving diagnostics, rehabilitation, and functional communication in dysarthria. We cloned voices of both individuals with dysarthria and controls using a commercial voice cloning platform, ensuring gender-matched synthetic voices to reflect the natural diversity within the dataset. A licensed speech-language pathologist (SLP) evaluated a subset of the recordings for indicators of synthetic speech, dysarthria, and speaker gender. The SLP correctly identified dysarthria in all samples and accurately determined speaker gender in 95% of cases. Notably, the SLP misclassified 30% of the synthetic speech samples as real, indicating a high degree of realism in the cloned voices. Our findings suggest that synthetic speech can effectively capture disordered speech characteristics, and that voice cloning technology has advanced sufficiently to produce high-quality synthetic data that closely resembles real speech, even to trained professionals. This advancement holds significant implications for the health sector where synthetic data can alleviate issues related to data scarcity, privacy concerns, and the need for diverse datasets. By enabling the creation of abundant, high-quality synthetic speech data, voice cloning can enhance AI-driven diagnostics, facilitate the development of generalizable models with acoustic and linguistic markers, personalize therapeutic interventions, and improve assistive communication technologies for individuals with dysarthria. In conclusion, this study demonstrates the transformative potential of voice cloning and synthetic data in healthcare. We release our synthetic dataset publicly to encourage further research and collaboration, aiming to advance the development of robust, generalizable models that can improve patient outcomes in speech and language pathology. keywords speech generation, voice cloning, dysarthria, amyotrophic lateral sclerosis, cerebral palsy † † address: 1 Division of Speech, Music and Hearing, KTH Royal Institute of Technology, Stockholm, Sweden 2 Division of Speech and Language Pathology, Karolinska Institutet, Stockholm, Sweden † † email: [email protected], [email protected] 1 Introduction Speech generation and voice cloning technologies have undergone significant evolution, transitioning from simple text-to-speech (TTS) systems to sophisticated solutions powered by deep learning [ 1 , 2 ] . This study explores the utilization of voice cloning technology to produce synthetic speech that accurately replicates the speech characteristics of individuals affected by dysarthria. Our main contributions include: • Demonstrating the effectiveness of voice cloning in preserving the unique speech patterns associated with dysarthria. • Showing that speech-to-speech voice cloning is an effective techinque in preserving dysarthric speech patterns. • Highlighting what differences exists between real and synthetic data. • Discussing how synthetic data and voice cloning can improve diagnostics, rehabilitation, and functional communication for individuals with dysarthria. The remainder of this paper is structured as follows: Section 2 provides background information on speech differences in dysarthria and an overview of synthetic speech. Section 3 describes our methodology, including the voice cloning model used and evaluation metrics. Section 4 presents our results, followed by a discussion in Section 5, and concludes with outlines for future research. 2 Dysarthria and synthetic speech 2.1 Dysarthria Dysarthria is a motor speech disorder resulting from impaired control of the muscles involved in speech production, which can affect respiration, phonation, articulation, resonance, and prosody. It is typically associated with damage to the central or peripheral nervous systems, including the motor cortex, basal ganglia, cerebellum, brainstem, and cranial nerves. Dysarthria can be a consequence of several neurological conditions with the clinical presentation varying depending on the etiology. Subtypes of dysarthria include flaccid, spastic, ataxic, hypokinetic, hyperkinetic and mixed forms, famously described by Darley, Aronson and Brown in 1975 [ 3 ] . 2.2 Dysarthria in Amyotrophic Lateral Sclerosis Amyortrophic Lateral Sclerosis (ALS) affects several different aspects of speech, including imprecise articulation, reduced speech rate, decreased intensity, hypernasality, and reduced intelligibility [ 4 , 5 ] . Recent advancements in speech analysis and machine learning have shown potential for monitoring the progression of speech impairments in ALS over time. Techniques such as automated speech recognition and acoustic analysis can provide objective measures of changes in speech production longitudinally, which can potentially be used for early diagnosis and the evaluation of treatment efficacy [ 6 , 7 , 8 ] . Additionally, voice banking, a process in which individuals record their own speech to create a personalized synthetic voice, can provide a means of communication when speech becomes severely impaired [ 9 , 10 ] . 2.3 Dysarthria in Cerebral Palsy In Cerebral Palsy (CP), dysarthria is caused by early brain damage affecting the motor pathways. The type of dysarthria in CP depends on the motor subtype of CP and commonly includes spastic dysarthria, which is characterized by slow, effortful speech and imprecise articulation due to increased muscle tone [ 11 , 12 , 13 ] . Speech-language pathologists are integral to the multidisciplinary care team, focusing on individualized rehabilitation aimed at improving speech intelligibility, communication efficiency, and quality of life. Emerging technologies, including automated speech analysis, show promise for early identification based on speech samples [ 14 ] . 2.4 Synthetic Speech The advent of synthetic speech data has emerged as a pivotal development in the field of speech technologies, offering a versatile solution to the challenges of data scarcity and privacy concerns. Synthetic data, artificially generated rather than obtained by direct measurement, provides a means to augment datasets, improve model robustness, and facilitate the development of speech technologies without compromising individual privacy [ 15 , 16 ] . Synthetic data enables the creation of diverse datasets that can capture a wide range of vocal characteristics such as accents, emotions or speech impairments. This diversity can be helpful for training robust models capable of generating natural-sounding speech or transcribing spoken text [ 17 ] . Furthermore, synthetic speech data plays a critical role in developing voice cloning technologies, allowing for the creation of personalized synthetic voices with limited real-world samples, thereby preserving the speaker’s privacy and identity [ 2 ] . The application of synthetic speech in the context of neurological disorders such as ALS is promising. By leveraging voice cloning technologies, it is possible to create personalized synthetic voices that capture the unique speech characteristics associated with these conditions. This approach can not only aid in the development of assistive technologies and communication devices but also contribute to a deeper understanding of the underlying speech impairments [ 18 , 19 ] . Moreover, synthetic speech can serve as a valuable tool for research and clinical practice. By generating large datasets of synthetic speech samples that mimic the speech patterns of individuals with neurological disorders, researchers can develop and validate new assessment and intervention strategies without relying on real-world data, which may be limited or difficult to obtain [ 20 , 21 ] . This