KIT’s Low-resource Speech Translation Systems for IWSLT2025: System Enhancement with Synthetic Data and Model Regularization

Zhaolin Li, Yining Liu, Danni Liu, Tuan Nam Nguyen, Enes Yavuz Ugan · 2025

Read KIT’s Low-resource Speech Translation Systems for IWSLT2025: System Enhancement with Synthetic Data and Model Regularization by Zhaolin Li, Yining Liu, Danni Liu, Tuan Nam Nguyen, Enes Yavuz Ugan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-19679.txt.

Introduction

A team of researchers reports speech translation systems for three low-resource languages in a paper from 2025. The catalog names five authors while the head byline lists nine, so team framing is used here. The work entered a shared evaluation campaign. Systems translate Bemba and two Arabic dialects into English. Both cascaded pipelines and direct end-to-end models were built. Synthetic data plays a central role throughout.

For one dialect with no real training pairs, synthetic data alone beat the cascade trained on real data. Synthetic speech also lifted Bemba recognition and translation. A distillation trick improved every task tried. Combining systems with risk-based decoding added about one and a half quality points.

Catalog record

CREATORZhaolin Li, Yining Liu, Danni Liu, Tuan Nam Nguyen, Enes Yavuz Ugan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-19679

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

KIT’s Low-resource Speech Translation Systems for IWSLT2025: System Enhancement with Synthetic Data and Model Regularization Zhaolin Li, Yining Liu, Danni Liu, Tuan Nam Nguyen, Enes Yavuz Ugan Abstract This paper presents KIT’s submissions to the IWSLT 2025 low-resource track. We develop both cascaded systems, consisting of Automatic Speech Recognition (ASR) and Machine Translation (MT) models, and end-to-end (E2E) Speech Translation (ST) systems for three language pairs: Bemba, North Levantine Arabic, and Tunisian Arabic into English. Building upon pre-trained models, we fine-tune our systems with different strategies to utilize resources efficiently. This study further explores system enhancement with synthetic data and model regularization. Specifically, we investigate MT-augmented ST by generating translations from ASR data using MT models. For North Levantine, which lacks parallel ST training data, a system trained solely on synthetic data slightly surpasses the cascaded system trained on real data. We also explore augmentation using text-to-speech models by generating synthetic speech from MT data, demonstrating the benefits of synthetic data in improving both ASR and ST performance for Bemba. Additionally, we apply intra-distillation to enhance model performance. Our experiments show that this approach consistently improves results across ASR, MT, and ST tasks, as well as across different pre-trained models. Finally, we apply Minimum Bayes Risk decoding to combine the cascaded and end-to-end systems, achieving an improvement of approximately 1.5 BLEU points. 1 Introduction In this paper, we present our submissions to the IWSLT 2025 low-resource track. We participate in three language pairs, translating from Bemba (ISO: bem), North Levantine Arabic (ISO: apc), and Tunisian Arabic (ISO: aeb) into English. Our approach follows the unconstrained track, reflecting practical scenarios by leveraging all available resources, including multilingual pre-trained models and external datasets. Building upon the submissions of last year Li et al. 2024 , which investigates efficient utilization of available resources using multilingual pre-trained models, this work explores two approaches to further enhance model performance without involving extra resources: synthetic data augmentation and model regularization. One of the main challenges in building speech translation (ST) systems is the scarcity of end-to-end (E2E) ST data. Given that Automatic Speech Recognition (ASR) and Machine Translation (MT) resources are more accessible, we leverage them to create synthetic ST data. First, we investigate the MT-augmented approach, using a trained MT model to generate target-language translations from ASR datasets. Additionally, inspired by prior work Robinson et al. 2022 ; Yang et al. 2025 ; Eskimez et al. 2024 ; Tong et al. 2024 ; Moslem 2024 , we explore synthetic speech generation. Specifically, we train Text-To-Speech (TTS) models using ASR data and use them to generate synthesized speech from the MT datasets. We also explore model regularization to enhance model performance. Previous research shows ST systems for low-resource languages benefit from model regularization during training because of the imbalanced parameter usage Romney Robinson et al. 2024 ; Jiawei et al. 2024 . However, these works are limited to MT models in the cascaded system. Since model regularization is a generic approach, this work investigates its effectiveness with both ASR, MT, and ST tasks. With experimental results across different language pairs, we conclude the findings as follows: • Synthetic data is promising for improving model performance, provided that the generated data is of reasonable quality. • Model regularization is a general approach for enhancing performance, and we demonstrate its effectiveness across different tasks and pre-trained models. • The various differences between languages and corpora lead to divergent findings in terms of pre-trained model effectiveness and training strategies, highlighting the need for language-specific approaches. 2 Task Description The IWSLT 2025 low-resource track defines two system categories: constrained, where models are trained exclusively on datasets provided by the organizers, and unconstrained, where participants are free to use any external resources. In this work, we focus on the unconstrained condition, aiming to reflect better practical and real-world scenarios, where leveraging diverse data sources is often essential for building effective translation systems. 2.1 Development Dataset This work focuses on three language pairs with the source languages of Bemba, North Levantine, or Tunisian, and the same target language of English. The development data used for these tasks is summarized in Table 1 . Notably, North Levantine lacks end-to-end parallel training data, highlighting the need for additional resources and data augmentation techniques to build effective translation models for this language. Train Valid Test apc - 1126 975 aeb 202k 3833 4204 bem 82k 2782 2779 Table 1: Statistics on development data. The value indicates the number of samples, where one sample is composed of the audio, transcript in the language, and translation in English. 2.2 Additional Dataset Under the unconstrained condition, we utilize additional resources to improve model performance, as detailed in Table 2 . These supplementary datasets include ASR and MT datasets, but notably no end-to-end ST dataset due to unavailability. This highlights the advantages of building cascaded ST systems, which can effectively leverage separate ASR and MT components. All additional datasets are publicly accessible, except SyKIT and MINI, which are internally developed and originate from conversational speech data. Lang. Corpus Type Amount. apc LDC2005S08 ASR 60h LDC2006S29 ASR 250h SyKIT ASR 50h Tatoeba MT 20 UFAL MT 120k LDC2012T09 MT 138k aeb SRL46 ASR 12h GNOME MT 646 ara SLR148 ASR 111h MGB ASR 1200h MINI ASR 10h CCMatrix MT 5M NLLB MT 5M OpenSubtitles MT 3M bem BembaSpech ASR 24h NLLB MT 427k Table 2: Overview of the additional data resources. The unit in amount is the number of hours or sentences. 3 Approaches 3.1 Synthetic Data Augmentation Data scarcity remains a key challenge in low-resource natural language processing tasks, particularly for end-to-end speech translation (ST). To address this limitation, this work investigates data augmentation approaches using synthetic data. We focus on two augmentation approaches that address different modalities: the MT-augmented method, which generates synthetic translations from ASR data, and the TTS-augmented method, which produces synthetic speech from MT data. Together, these methods aim to enhance the quality and robustness of ST models in low-resource settings. 3.2 Model Regularization Regularization remains a simple yet powerful way to boost the generalisation capacity of neural sequence models, and has already proved valuable in machine translation through techniques such as R - Drop and its variants Wu et al. 2021 ; Xu et al. 2022 . Motivated by the recent success of intra - distillation (ID) in low-resource MT Romney Robinson et al. 2024 , we extend ID to all three tasks: ASR, MT, and ST, based on the public implementation with the following modification 1 1 1 https://github.com/fe1ixxu/Intra-Distillation/ . Unlike previous work that directly fine-tunes a pre - trained model with a loss that combines the task objective and ID, we notice that direct fine-tuning leads to suboptimal performance in preliminary experiments. We therefore adopt a two - stage approach: (1) vanilla fine - tuning to adapt the pre - trained model to the downstream task, followed by (2) ID fine - tuning to regularize the adapted model with its own intermediate predictions. This simple approach retains the advantages of task - specific adaptation while unlocking the additional robustness that ID provides. 3.3 System combination Following the prior work Li et al. 2024 , we combine the cascaded system and the end-to-end

Read the complete text