LinTO Audio and Textual Datasets to Train and Evaluate Automatic Speech Recognition in Tunisian Arabic Dialect
Hedi Naouara, Jean-Pierre Lorré, Jérôme Louradour · 2025
Read LinTO Audio and Textual Datasets to Train and Evaluate Automatic Speech Recognition in Tunisian Arabic Dialect by Hedi Naouara, Jean-Pierre Lorré, Jérôme Louradour (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-02604.txt.
Introduction
Hedi Naouara, Jean-Pierre Lorré, and Jérôme Louradour release speech and text data for the Tunisian Arabic dialect. Their paper appeared in two thousand twenty-five. Speech recognition for this dialect is hard for two reasons. The dialect itself is linguistically complex. Annotated speech data is also very scarce. Systems cannot train or be graded without such material.
The LinTO datasets gather texts from many sources. Audio samples feature varied real-world speakers. Speech often switches between Tunisian Arabic and English or French, as daily talk does. Each recording pairs with a precise transcription. The data captures the dialect's sound and word patterns. Builders can train and benchmark recognition systems on it. Low-resource languages gain a tested stepping stone here.
Catalog record
| CREATOR | Hedi Naouara, Jean-Pierre Lorré, Jérôme Louradour |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-02604
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
LinTO Audio and Textual Datasets to Train and Evaluate Automatic Speech Recognition in Tunisian Arabic Dialect Hedi Naouara, Jean-Pierre Lorré, Jérôme Louradour Abstract Developing Automatic Speech Recognition (ASR) systems for Tunisian Arabic Dialect is challenging due to the dialect’s linguistic complexity and the scarcity of annotated speech datasets. To address these challenges, we propose the LinTO audio and textual datasets – comprehensive resources that capture phonological and lexical features of Tunisian Arabic Dialect. These datasets include a variety of texts from numerous sources and real-world audio samples featuring diverse speakers and code-switching between Tunisian Arabic Dialect and English or French. By providing high-quality audio paired with precise transcriptions, the LinTO audio and textual datasets aim to provide qualitative material to build and benchmark ASR systems for the Tunisian Arabic Dialect. Keywords — Tunisian Arabic Dialect, Speech-to-Text, Low-Resource Languages, Audio Data Augmentation \setcode utf8 Introduction In recent years, artificial intelligence has made significant advances in the fields of natural language processing (NLP) and automatic speech recognition (ASR). Pioneering models such as wav2vec ( Baevski et al. 2020 ) , OpenAI Whisper ( Radford et al. 2022 ) and Meta Massively Multilingual Speech ( Tjandra et al. 2022 ) boast support for dozens to hundreds of languages. For example, despite massive amounts of training data (680,000 hours of transcribed speech for Whisper), recent models fail to correctly transcribe with Arabic dialects. For these reasons, we have collected data in the Tunisian Arabic dialect to provide high-quality resources for effective training and evaluation of ASR systems. This paper presents our datasets and describes some preliminary results that show that they can be used to improve ASR sytems for Tunisian Arabic Dialect. Challenges and Existing Initiatives for Tunisian The linguistic evolution of the Tunisian Arabic dialect has been shaped by a complex historical background, influenced by various civilisations, including Amazigh (Berber) ( Tilmatine 1999 ) , Phoenician, Roman and Arab cultures, as well as the Ottoman Empire - now Turkey ( Ouerhani 2009 ) , French colonialism and modern globalisation. These diverse influences have contributed to Tunisian lexical richness and distinct phonetic characteristics based on regional varieties ( Gibson 1999 ; Zribi et al. 2017 ) , which pose significant challenges for the development of ASR systems. This task is further hindered by the limited availability of annotated speech datasets for Tunisian Arabic Dialect. Many Arabic dialects are underrepresented, including Tunisian Arabic. This dialect presents unique challenges due to its phonetic complexity ( Gayraud et al. 2018 ) , lack of standardized dictionaries ( Saidi 2007 ) , lack of formal writing rules, and frequent code-switching with French and English. Although previous initiatives, such as TunSwitch ( Abdallah et al. 2023 ) and TARIC ( Mdhaffar et al. 2024 ) have made progress, further efforts are needed to build a comprehensive dataset for Tunisian Arabic Dialect. TARIC was collected entirely at a single train station, resulting in limited topics like greetings and ticket prices. TunSwitch is too small to train a model from scratch. And while the Massive Arabic Speech Dataset (MASC) ( Al-Fetyani et al. 2021 ) contains 1000 hours of speech collected from YouTube, it includes only 3 hours of Tunisian. Contribution To address these challenges, we present the LinTO datasets for Tunisian Arabic Dialect, comprising a diverse collection of text and audio contents. The LinTO textual dataset in Tunisian includes content from various sources such as films and TV series, rap lyrics, documentaries, stories, and more. This diverse collection was curated to support the training of language models for the Tunisian Arabic Dialect. We also implemented tailored normalization to address the language’s unique characteristics, such as standardizing the spelling of dialect-specific words, handling code-switching with French and English, and transliterating Arabizi. These normalizations enhance the linguistic quality and coverage of the language model, especially when training data is limited. The LinTO audio (raw and augmented) datasets in Tunisian include a wide range of recordings, such as music, documentaries, podcasts, TV shows, radio broadcasts, educational stories, and narratives of prophets, each accompanied by a transcript. To enhance dataset diversity, we employed data augmentation techniques on raw audio data. Specifically, Voice Conversion Augmentation was used to introduce more speaker variety into datasets with significant amounts of single-speaker recordings ( e.g. story telling). Noise reduction techniques were applied to improve the clarity and quality of the audio, addressing the challenges posed by the limited availability of annotated speech datasets. Cleaned audio was then be enhanced by adding noise, reverberation and other effects. Our datasets are designed to support speech recognition tasks for the Tunisian Arabic Dialect and feature code-switching between Tunisian, English, and French. They are meticulously organized into multiple configurations and splits to facilitate a variety of experimental setups, making them valuable resources for research and development in speech processing. We release three datasets under the CC BY 4.0 license on Hugging Face: an audio dataset with transcribed speech in Tunisian 1 1 1 https://huggingface.co/datasets/linagora/linto-dataset-audio-ar-tn , an augmentation of this dataset using Voice Conversion Augmentation 2 2 2 https://huggingface.co/datasets/linagora/linto-dataset-audio-ar-tn-augmented and a textual dataset gathering several sources of text in Tunisian Arabic Dialect 3 3 3 https://huggingface.co/datasets/linagora/linto-dataset-text-ar-tn . In the following sections, we provide a detailed overview of the methodologies and procedures used to collect and process our Tunisian Arabic Dialect datasets. First, we discuss the compilation of textual corpora, highlighting the diversity of sources, the challenges and our solutions. We then outline the strategies used for collecting transcribed audio recordings and describe data augmentation techniques. Finally, we carry out some preliminary experiments to provide a first baseline ASR model for the Tunisian Arabic Dialect. Textual Corpus in Tunisian Arabic Dialect Language Models (LM) are a crucial element in many ASR systems. They help determine the most likely spelling for a given sequence of phonemes, making their fine-tuning essential for optimal system performance. Unlike Acoustic Models, which predict lattices of phoneme or character probabilities based on audio frames, LMs do not require aligned audio data and can be trained solely on text, which is more cost-effective to collect. The LinTO Tunisian text dataset was compiled from various sources, including public datasets on Hugging Face: • TuDiCoI: A Tunisian dialogue dataset built by ARBML (An Arabic Researchers Community). • Brahim Mohamed: A Tunisian dialect summary dataset created to test Llama2. several datasets from GitHub: • T-HSAB: A Tunisian Hate Speech and Abusive Language dataset. • TSAC: A Tunisian Sentiment Analysis Corpus. • BARD: A dataset of Arabic book reviews. • Tunbert: A dataset of daily Tunisian communications. We include in addition DrejjaToEnglish dataset from Kaggle the TunSwitch dataset trancripts. Finally, we crawled various blogs and websites: • Stories: Chakhabit, HkayetErwi, TunHistoires, Lbachch. • Blog posts: TunHistoires, Lbachch. • TV and film transcripts: ChroniqueChroniyet, KisatiAna. • RAP lyrics: A Tunisian rap lyrics dataset. • Tweets: A collection of Tunisian Tweets. The links corresponding to each source are provided in the dataset card of the LinTO dataset on Hugging Face. This effort resulted in over 4.5 million lines of text and approximately 288,000 unique words. The composition of the dataset is shown in Table 1 . Notably, the dataset includes sentences with code-switching between Tunisian and French or English, as well as some sentences exclusively in French