Connecting Voices: LoReSpeech as a Low-Resource Speech Parallel Corpus
Samy Ouzerrout · 2025
Read Connecting Voices: LoReSpeech as a Low-Resource Speech Parallel Corpus by Samy Ouzerrout (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-18215.txt.
Introduction
Samy Ouzerrout presents a 2025 method for building speech corpora for low resource languages. Aligned audio sets power speech recognition and speech to speech translation, yet they barely exist for most tongues. That gap locks whole communities out of voice tech.
The build starts with a shared platform where speakers record short clips matched to text. Long texts, such as Bible readings, are then aligned with a forced alignment tool. The result pairs speech with text inside one language and across languages. The corpus aims to lift multilingual recognition, direct speech translation, and language preservation at once. The work sits in a wider project on digital inclusion.
Catalog record
| CREATOR | Samy Ouzerrout |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-18215
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Connecting Voices: LoReSpeech as a Low-Resource Speech Parallel Corpus Samy Ouzerrout Abstract Aligned audio corpora are fundamental to NLP technologies such as ASR and speech translation, yet they remain scarce for under-represented languages, hindering their technological integration. This paper introduces a methodology for constructing LoReSpeech, a low-resource speech-to-speech translation corpus. Our approach begins with LoReASR, a sub-corpus of short audios aligned with their transcriptions, created through a collaborative platform. Building on LoReASR, long-form audio recordings, such as biblical texts, are aligned using tools like the MFA. LoReSpeech delivers both intra- and inter-language alignments, enabling advancements in multilingual ASR systems, direct speech-to-speech translation models, and linguistic preservation efforts, while fostering digital inclusivity. This work is conducted within Tutlayt AI project ( https://tutlayt.fr ). 1 Introduction Aligned corpora, whether textual or audio, are essential for the development of language technologies such as machine translation and automatic speech recognition (ASR). They enable the training of models capable of handling a wide variety of languages, including under-represented ones. While aligned textual corpora, such as Bible translations, are relatively accessible for some minority languages, aligned audio corpora remain scarce, thereby limiting advancements in voice-centered applications. The primary challenge lies in the lack of precise alignment for audio data. For instance, aligned Bible translations exist for many minority languages at the verse level, but their audio versions are aligned at macroscopic levels (chapters or books), rendering these long sequences unusable for machine learning models that require short and accurately segmented data. Tools such as the Montreal Forced Aligner (MFA) can align segmented texts with long audio recordings, but they require pre-aligned audio-text corpora for calibration, which are often unavailable for under-represented languages. In this article, we propose a methodology to create a parallel audio corpus for under-represented languages, named LoReSpeech (Low-Resource Speech Parallel Corpus). This work is part of the Tutlayt AI project, which aims to develop speech and language resources for low-resource languages. The LoReASR dataset is collected through a dedicated web-based system designed for collaborative speech data collection ( https://tutlayt.fr ). This approach begins with the creation of a sub-corpus, called LoReASR (Low-Resource Automatic Speech Recognition), consisting of short alignments (audio-transcriptions) for languages lacking such resources. Unlike approaches based on massive data collection, this sub-corpus emphasizes quality by leveraging a dedicated vocalization platform, carefully selected speakers, and collaborations with local organizations. LoReASR serves as a critical foundation for aligning existing long audio recordings with their segmented translations, thereby paving the way for the development of LoReSpeech. To ensure alignment accuracy, we adopt a two-step validation process: a subset of the alignments is manually reviewed, and an automatic verification step is performed using ASR transcription and TER scoring. Our approach provides a key initial step for under-represented languages by enabling the creation of intra- and inter-language aligned audio corpora. We aim to bridge the gap between over-resourced and under-resourced languages in terms of audio resources, thereby paving the way for new linguistic applications. 2 Introduction Aligned corpora, whether textual or audio, are essential for the development of language technologies such as machine translation and automatic speech recognition (ASR). They enable the training of models capable of handling a wide variety of languages, including under-represented ones. While aligned textual corpora, such as Bible translations, are relatively accessible for some minority languages, aligned audio corpora remain scarce, thereby limiting advancements in voice-centered applications. The primary challenge lies in the lack of precise alignment for audio data. For instance, aligned Bible translations exist for many minority languages at the verse level, but their audio versions are aligned at macroscopic levels (chapters or books), rendering these long sequences unusable for machine learning models that require short and accurately segmented data. Tools such as the Montreal Forced Aligner (MFA) can align segmented texts with long audio recordings, but they require pre-aligned audio-text corpora for calibration, which are often unavailable for under-represented languages. In this article, we propose a methodology to create a parallel audio corpus for under-represented languages, named LoReSpeech (Low-Resource Speech Parallel Corpus). This approach begins with the creation of a sub-corpus, called LoReASR (Low-Resource Automatic Speech Recognition), consisting of short alignments (audio-transcriptions) for languages lacking such resources. Unlike approaches based on massive data collection, this sub-corpus emphasizes quality by leveraging a dedicated vocalization platform, carefully selected speakers, and collaborations with local organizations. LoReASR serves as a critical foundation for aligning existing long audio recordings with their segmented translations, thereby paving the way for the development of LoReSpeech. Our approach provides a key initial step for under-represented languages by enabling the creation of intra- and inter-language aligned audio corpora. We aim to bridge the gap between over-resourced and under-resourced languages in terms of audio resources, thereby paving the way for new linguistic applications. 3 Context and Motivation Advancements in ASR and speech-to-speech translation rely on rich and aligned data resources. However, under-represented languages face a critical shortage of aligned audio corpora, which are essential for training advanced models. 3.1 The Importance of Under-Represented Languages in NLP Under-represented languages, often minority languages, are crucial for preserving global linguistic and cultural diversity. Their integration into NLP technologies is essential for several reasons: • Linguistic Equity and Digital Inclusion: Providing tailored technologies to these communities helps bridge the digital divide and ensures equitable access to information for millions of speakers ( Bird 2020 ) . • Preservation of Linguistic Heritage: Digitizing and developing tools for these languages contributes to their preservation and the intergenerational transmission of their cultural richness. • Enhancement of Multilingual Models: Integrating under-represented languages strengthens the generalization and robustness of multilingual models by enriching their ability to understand linguistic diversity ( Conneau et al. 2020 ) . • Scientific Advancements: Working on low-resource languages, which face data scarcity and complex morphologies, drives the development of innovative methodologies such as transfer learning and multilingual approaches. In summary, the inclusion of under-represented languages in NLP is an essential technological, cultural, scientific, and social challenge. 3.2 Current State of Aligned Corpora Parallel audio corpora (speech-to-speech) remain scarce and are primarily limited to a few major languages, such as those found in SpeechMatrix ( Borsos et al. 2022 ) and CVSS ( Jia et al. 2022 ) . Corpora associating aligned audio with its transcription and translation have become more widespread, often based on TEDx talks, such as MUST-C ( Di Gangi et al. 2019 ) and mTEDx ( Salesky et al. 2021 ) , or European Parliament debates, such as Europarl-ST ( Iranzo-Sánchez et al. 2019 ) . However, they remain limited to certain languages. ASR corpora have seen a notable expansion in availability and linguistic diversity, driven by major projects such as Common Voice ( Ardila et al. 2020 ) , which covers over 100 languages, the Pangloss Collection ( LACITO-CNRS 2020 ) , dedicated to endangered languages, and Lingua Libre ( France 2020 ) , a collaborative platform for recording speech data in under-represented languages. Additionally, targeted initiatives, often tailored to regional or specific contexts, continue to emerge. However, despite these advancements, linguistic coverage remains limited, leaving many languages without resources. Finally, textual translation corpora are the most developed for low-resource languages, with resources covering hundreds of languages, such as NLLB ( Costa-jussà et al. 2022 ) , OPUS (