Unsupervised Rhythm and Voice Conversion of Dysarthric to Healthy Speech for ASR
Karl El Hajal 2 3 , Enno Hermann 2 , Ajinkya Kulkarni 2 and Mathew Magimai.-Doss 2 · 2025
Read Unsupervised Rhythm and Voice Conversion of Dysarthric to Healthy Speech for ASR by Karl El Hajal 2 3 , Enno Hermann 2 , Ajinkya Kulkarni 2 and Mathew Magimai.-Doss 2 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-10256.txt.
Description
Karl El Hajal and co-authors published a 2025 paper on making speech recognition work for people with dysarthria. The condition, often from nerve or muscle disease, slurs and slows speech. Standard recognition systems, trained on typical voices, perform badly on it. Earlier fixes adjusted speaking rate, but they needed written transcripts of the patient's speech to learn from.
The team's method needs no transcripts. It converts both the rhythm and the voice of a dysarthric recording toward typical speech. The conversion leans on self-supervised models that learn speech structure from raw audio. Converted speech was then fed to a large recognition system trained on healthy speech, with no extra tuning. Rhythm conversion helped most, especially for speakers with severe dysarthria in a standard test collection. The authors share their code and sound samples. The goal is recognition that adapts to the speaker, not the other way round.
Catalog record
| CREATOR | Karl El Hajal 2 3 , Enno Hermann 2 , Ajinkya Kulkarni 2 and Mathew Magimai.-Doss 2 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 19 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-10256