Whisper Turns Stronger: Augmenting Wav2Vec 2.0 for Superior ASR in Low-Resource Languages

Or Haim Anidjar, Revital Marbel, Roi Yozevitch · 2025

Read Whisper Turns Stronger: Augmenting Wav2Vec 2.0 for Superior ASR in Low-Resource Languages by Or Haim Anidjar, Revital Marbel, Roi Yozevitch (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-00425.txt.

Description

Anidjar, Marbel, and Yozevitch improved speech recognition for low-resource languages in twenty twenty-four. Languages like Arabic, Russian, and Portuguese have many dialects and accents but little validated training data, so automatic speech recognition struggles. The popular Wav2Vec two point zero model needs less labeled data than older systems, yet its accuracy still drops sharply for under-represented languages.

Their framework adds data augmentation techniques on top of fine-tuned Wav2Vec models. Experiments used three Mozilla Common Voice datasets, one per language, and the method proved robust to different diacritic marks. Against both the pretrained Wav2Vec baseline and the well-known Whisper system, their approach cut word error rates by about a third on average and character error rates by about half. The authors offer the framework for other low-resource settings.

Catalog record

CREATOROr Haim Anidjar, Revital Marbel, Roi Yozevitch
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-00425

Browse the full library · About the Tower of Babel