Whisper Turns Stronger: Augmenting Wav2Vec 2.0 for Superior ASR in Low-Resource Languages
Or Haim Anidjar, Revital Marbel, Roi Yozevitch · 2025
Read Whisper Turns Stronger: Augmenting Wav2Vec 2.0 for Superior ASR in Low-Resource Languages by Or Haim Anidjar, Revital Marbel, Roi Yozevitch (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-00425.txt.
Description
Anidjar, Marbel, and Yozevitch improved speech recognition for low-resource languages in twenty twenty-four. Languages like Arabic, Russian, and Portuguese have many dialects and accents but little validated training data, so automatic speech recognition struggles. The popular Wav2Vec two point zero model needs less labeled data than older systems, yet its accuracy still drops sharply for under-represented languages.
Their framework adds data augmentation techniques on top of fine-tuned Wav2Vec models. Experiments used three Mozilla Common Voice datasets, one per language, and the method proved robust to different diacritic marks. Against both the pretrained Wav2Vec baseline and the well-known Whisper system, their approach cut word error rates by about a third on average and character error rates by about half. The authors offer the framework for other low-resource settings.
Catalog record
| CREATOR | Or Haim Anidjar, Revital Marbel, Roi Yozevitch |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-00425