LuxEmo: Expressive Text-to-Speech Corpus for Luxembourgish
1 st Nina Hosseini-Kivanani, 2 nd Sandipana Dowerah · 2026
Read LuxEmo: Expressive Text-to-Speech Corpus for Luxembourgish by 1 st Nina Hosseini-Kivanani, 2 nd Sandipana Dowerah (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-31947.txt.
Introduction
Hosseini-Kivanani and Dowerah present LuxEmo, an expressive speech corpus for Luxembourgish, a low-resource language largely missing from speech technology. Speech data sets concentrate on major languages, and expressive text-to-speech is usually trained on acted studio recordings. Real broadcast speech is messier: noisy, with voices over each other, and full of code-switching.
LuxEmo holds 21 hours of expressive, chat-style speech drawn from RTL youth broadcasts, spanning four emotion groups and four speakers who recur across 7,562 short segments. A partly automatic workflow joins voice activity detection, denoising, language ID, splitting, emotion cues and focused human review. Five expressive synthesis systems are benchmarked on the corpus, covering cross-lingual transfer from German, multilingual support, Luxembourgish adaptation and prosody transfer.
Catalog record
| CREATOR | 1 st Nina Hosseini-Kivanani, 2 nd Sandipana Dowerah |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.31947
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
LuxEmo: Expressive Text-to-Speech Corpus for Luxembourgish 1 st Nina Hosseini-Kivanani, 2 nd Sandipana Dowerah Abstract State-of-the-art speech datasets predominantly focus on widely spoken languages, often overlooking low-resource languages such as Luxembourgish, which remain underrepresented in speech technology research. In this work, we introduce LuxEmo, a 21-hour conversational expressive speech corpus for Luxembourgish with 4 emotion categories. LuxEmo is derived from Radio Télévision Luxembourg (RTL) youth broadcasts, using automated detection followed by human validation. We propose a semi-automatic curation workflow that combines voice activity detection, denoising, language identification, LuxASR-based segmentation, automatic emotion prediction, lexical cues, and targeted human review. Additionally, we benchmark five expressive TTS systems covering German-based cross-lingual transfer, multilingual Luxembourgish support, Luxembourgish adaptation, and non-parametric prosody transfer. Performance is evaluated using both objective metrics and human evaluation. I Introduction Expressive text-to-speech (TTS) supports conversational agents, media production, assistive technologies, and educational platforms. Emotional prosody, including pitch, rhythm, and intensity, shapes naturalness, empathy, and engagement in synthetic voices [ 8 , 1 , 20 ] . Prior work shows that modeling affective cues and user state can foster trust, presence, and prosocial behavior in human-computer interaction [ 16 , 8 ] . Current expressive TTS systems are largely developed and evaluated for English and other high-resource languages, often using acted speech recorded in controlled studio conditions [ 23 , 26 ] . Real-world expressive speech, however, involves informal registers, noisy recordings, overlapping speech, code-switching, and naturally imbalanced emotion distributions. These challenges are amplified for low-resource languages, where annotated speech data, speaker coverage, transcriptions, and language-specific TTS tools are limited. Multilingual TTS provides partial coverage, but emotional control is still often evaluated through high-resource surrogate languages or transfer-learning strategies [ 37 , 13 , 18 , 38 ] . As a result, expressive corpora for low-resource languages remain scarce, especially for spontaneous speech in realistic media conditions [ 17 , 34 ] . Luxembourgish, the national language of Luxembourg, is technologically low-resource [ 9 ] . Existing work has addressed foundational tasks such as ASR and lexical or phonological description [ 9 , 27 , 36 ] . Luxembourgish is embedded in a multilingual ecology involving German, French, and English [ 12 , 11 ] , and everyday speech frequently includes code-switching [ 32 ] . Youth-oriented media adds further challenges, including background music, sound effects, overlapping talk, rapid speaker changes, and informal discourse [ 35 ] . Luxembourgish, therefore, provides a relevant but difficult case for studying expressive TTS beyond clean studio corpora. Fig. 1: Overall LuxEmo pipeline. Top: corpus construction. Bottom: TTS evaluation pipeline from the corpora. This work is resource- and protocol-oriented rather than architectural, where we address the construction and evaluation of an expressive speech corpus for Luxembourgish from spontaneous, code-switching RTL Youth broadcasts. The source material lacks the controlled properties of studio corpora: it contains residual music and noise, overlapping speech, uneven speaker participation, incomplete manual transcripts, and skewed emotion classes. LuxEmo therefore targets a realistic low-resource setting in which clean recordings, balanced labels, and broad speaker coverage are not available. We introduce LuxEmo , a spontaneous emotional speech corpus and expressive TTS benchmark for Luxembourgish. LuxEmo contains 21 hours of wide-band speech and 7,562 segments of up to 10 seconds from four recurring speakers, annotated for language, speaker identity, and four emotion categories in a heavily code-switching setting. First, we document a semi-automatic curation workflow combining voice activity detection, denoising, language identification, LuxASR-based speaker-aware segmentation [ 9 , 10 ] , acoustic and lexical emotion cues, targeted human review, and non-intrusive corpus-quality assessment. The emotion annotations are released as weakly supervised labels with confidence information, not as independently validated gold-standard labels. Second, we provide standardized corpus indices and speaker- and episode-aware train, development, and test splits to reduce leakage from shared conversational context while preserving emotion coverage. Third, we benchmark five TTS systems, including zero-shot multilingual, German-proxy, Luxembourgish-aware, prompt-controlled, and kNN-based prosody-transfer systems. The benchmark characterizes realistic system behavior under heterogeneous deployment conditions. It is not a controlled architectural ablation and should not be interpreted as evidence for a universally best TTS model. LuxEmo complements existing monolingual emotional corpora by offering a testbed for expressive TTS in a low-resource, code-switching setting and by documenting curation strategies for broadcast archives under practical reuse constraints. II LuxEmo Corpus In this section, we explain the steps involved in creating the LuxEmo dataset. Figure 1 gives an overall graphical description of LuxEmo construction and evaluation. II-A Audio pre-processing For the creation of LuxEmo, we collect the data from RTL Youth video programs. RTL programs mainly target teenagers and young adults, combining studio discussions, interviews, and on-location reports. The shows are predominantly in Luxembourgish but include systematic code-switching into German, French, and English. Episodes typically contain multiple recurring hosts and guests, background music, sound effects, and an informal register. The RTL Youth material consists of approximately 21 hours of spontaneous conversational speech on everyday topics, including multi-speaker interactions and single-speaker segments. From raw broadcast video, we first extract and resample audio to a wideband format suitable for TTS. The resulting signals are pre-processed using Voice Activity Detection (VAD) to remove non-speech segments. We discard segments shorter than 200 ms to remove non-informative speech fragments. The resulting segmentation yields utterances with a mean duration of 9.87 seconds, with 98.5\% of segments exceeding 6 seconds, preserving prosodic context while remaining compatible with standard TTS back-ends. We use DeepFilterNet [ 33 ] to attenuate background music and ambient noise. The denoised speech files are segmented into fixed-length chunks of 1–10 s and saved as mono 22.05 kHz WAV for downstream TTS. Because ground-truth transcripts were unavailable, segment-level transcriptions were obtained from LuxASR TextGrid files and temporally aligned with VAD-based segments. Single-speaker segments are extracted from LuxASR diarization output and mapped to four recurring speakers. We retain the program-level metadata, such as show identity and approximate air date, to enable later analysis across domains and time. Quality of preprocessed recordings. To characterize the acoustic quality of the processed corpus, we applied NISQA v2.0 [ 25 ] and DNSMOS [ 31 ] to all 7,562 segments after denoising and VAD-based segmentation. NISQA-TTS was not used for this corpus-level analysis because it is calibrated for synthetic speech. The processed corpus obtains a NISQA quality score of 3.38 and a DNSMOS OVRL score of 2.91, consistent with denoised broadcast-origin speech that still contains residual music and ambient noise. The DNSMOS BAK score of 3.73 indicates relatively strong background-noise suppression after preprocessing. These corpus-level values provide an intrinsic quality reference for the synthesized-output analysis in Section IV-A . II-B Annotation process We employed the Wav2Vec2-based mms-lid-4017 model [ 28 ] to do the utterance-level language identification (LID). The model assigns a language label to each segmented utterance. Across 7,562 segments, 83.8\% are classified as Luxembourgish, 6.5\% as English, and 2.2\% as German, while the remaining 7.5\% are assigned minority language codes. These cases likely reflect classifier uncertainty, particularly in instances of code-switching, dialectal variation, or non-standard speech patterns. To improve annotation reliability, a subset of 1,135 segments (approximately 15\% of the corpus) was manually reviewed by a native speaker of Luxembourgish. This review focused on validating language assignments and identifying potential errors in automatic predictions, particularly in ambiguous