WARDEN: Endangered Indigenous Language Transcription and Translation with 6 Hours of Training Data

Ziheng, Yunzhong, Naijing, Liang · 2026

Read WARDEN: Endangered Indigenous Language Transcription and Translation with 6 Hours of Training Data by Ziheng, Yunzhong, Naijing, Liang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-13846.txt.

Introduction

Ziheng Zhang and three colleagues introduce WARDEN, an early tongue model system writing and turning Wardaman, a rare Aussie native tongue, into English from only 6 hours of audio. WARDEN uses split writing and turning models: it first turns Wardaman audio into sound writing, then the writing into English turning. For writing, the Wardaman token is seeded from Sundanese, a tongue sharing similar sounds with Wardaman, to speed fine-tuning.

Catalog record

CREATORZiheng, Yunzhong, Naijing, Liang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE25153
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.13846

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

WARDEN: Endangered Indigenous Language Transcription and Translation with 6 Hours of Training Data Ziheng, Yunzhong, Naijing, Liang Abstract † † footnotetext: * equal contribution This paper introduces WARDEN \thefootnote \thefootnote \thefootnote It is abbreviation for Wardaman Decoding ENgine. , an early language model system capable of transcribing and translating Wardaman, an endangered Australian indigenous language into English. The significant challenge we face is the lack of large-scale training data: in fact, we only have 6 hours of annotated audio. Therefore, while it is common practice to train a single model for transcription and translation using large datasets (like English to French), this practice is no longer viable in the Wardaman to English context. To tackle the low-resource challenge, we design WARDEN to have separate transcription and translation models: WARDEN first turns a Wardaman audio input into phonemic transcription, and then the transcription into English translation. Further, we propose two useful techniques to enhance performance. For transcription, we initialize the Wardaman token from Sundanese, a language that shares similar phonemes with Wardaman, to accelerate fine-tuning of the transcription model. For translation, we compile a Wardaman-English dictionary from expert annotations, and provide this domain-specific knowledge to a large language model (LLM) to reason and decide the final output. We empirically demonstrate that this two-stage design works better than data-hungry unified approaches in extremely low data settings. Using a mere 6 hours of annotated data, WARDEN outperforms larger open-source and proprietary models and establishes a strong baseline. Data and code are available at \textcolor bluelink . Zhang ∗ a Hou ∗ a Liu b Zheng a keywords speech recognition, large language models, computational paralinguistics † † address: a Australian National University b University of Oxford † † email: [email protected], [email protected], [email protected], [email protected] 1 Introduction The world has numerous small languages. For example, the Wardaman language examined in this work is a highly endangered non-Pama-Nyungan language spoken in the Northern Territory of Australia, with only two full speakers as of 2025 [ 9 , 11 ] . Documenting such languages must be carried out in person by well-trained linguists. An important task in the documentation process is producing time-aligned transcriptions and translations, which relies heavily on collaboration between linguists and local community members. It is well established in language documentation that transcription and translation require a considerable time commitment. For example, it can take days to accurately transcribe and translate just one hour of audio [ 6 ] . Although there were originally only a few ELAN-annotated hours, the ELDP project has since increased that number considerably. As a result, the largest dataset to which we have access still contains only 6 hours of time-aligned transcribed and translated segments, covering more than 10 hours of audiovisual recordings [ 11 ] . Figure 1: Overview of the WARDEN system. For transcription, we select the language most similar to Wardaman for token initialization and fine-tune an existing ASR model. For translation, given transcription results, a lexicon matcher first retrieves relevant Wardaman-English dictionary entries. Then, both the transcript and matched lexicons are fed into an LLM for translation. A potential way to accelerate this process is to use automatic speech recognition (ASR) [ 1 ] and machine translation (MT) [ 2 ] , which can transcribe and translate a large volume of audio data at a relatively low cost. However, these automatic systems need large amounts of annotated data for training and thus are built for major languages like English and Chinese. This requirement of training data is infeasible for small languages like Wardaman. To automate language documentation of low-resource languages like Wardaman, we introduce WARDEN, a two-stage system that first transcribes and then translates the Wardaman language into English. WARDEN adopts two key strategies grounded in linguistic insights. First , for transcription, we leverage cross-linguistic phonological similarity and select a proxy language, Sundanese, for language token initialization in the ASR model. This helps to provide a suitable inductive bias and accelerate knowledge transfer during ASR model fine-tuning [ 3 ] . Second , for translation, we leverage knowledge from an expert-compiled Wardaman-English distionary when fine-tuning a large language model (LLM). The LLM takes as input both transcription results from the ASR model and expert-annotated lexicon entries most related to the transcription results. The LLM is expected to use its general knowledge and reasoning capability to understand the transcript using field-specific knowledge from the lexicons. This approach transforms the LLM from a data-hungry translator into a knowledge-grounded interpreter. The two strategies allow WARDEN to escape the curse of limited data that haunts existing systems [ 8 ] . Integrating these two components, we introduce WARDEN, a framework that separates the transcription and translation for data-efficient learning. Trained on only 6 hours of data, WARDEN outperforms data-hungry transcription and translation systems [ 8 ] , verifying the effectiveness of our design. 2 Related Work Recent studies have shown that fine-tuning models like Whisper for translation and transcription require a significant amount of data even when dealing with low-resource languages. Liu et al. [ 8 ] report that it requires more than tens of hours of data for Whisper to effectively reduce the word error rate (WER) across seven languages. Timmel et al. [ 15 ] show that it takes more than 900 hours of training data to reduce the WER for Swiss German from 45% to 18% through fine-tuning, demonstrating the data-hungry nature. In translation, large language models like Qwen3 [ 16 ] , which often possess strong zero-shot capabilities due to the vast semantic knowledge learned during training, often encounter problems when vertical domain data is scarce and the distribution differs from the pre-training data. To bridge this gap, LexC-Gen [ 17 ] attempts to guide the generation of synthetic data using bilingual dictionaries, while Zheng and Yu [ 18 ] improve BLEU scores in Tangut–Chinese translation with external word-for-word translation. In contrast to the training data requirements in the scale of tens or hundreds in existing works, we are working with a mere 6 hours of audio data. Thus, we separate the translation and the transcription stages, and introduce inductive bias from expert knowledge to help with model fine-tuning. Figure 2: Similarity visualization of six candidate languages to Wardaman. To measure the segmental distance ( upward ) at the phonemic level between Wardaman and the six proxy languages, we compute the Hamming distance between their segmental inventories extracted from PHOIBLE [ 13 ] . We also show the translation word error rate (WER) for these six proxy languages in both zero-shot ( leftward ) and fine-tuning ( rightward ) scenarios as a reference. A smaller phoneme distance indicates higher similarity, and a lower WER indicates stronger translation performance. We observe that as the phoneme distance decreases, the performance of the translation model overall improves, verifying our model initialization design. 3 Method As shown in Fig. 1 , the proposed WARDEN system is composed of two separate stages: a transcription stage and a translation stage. Stage 1 turns a Wardaman audio into phonetic transcript, while Stage 2 translates the transcript into English. In this section, we detail the design of these two stages. 3.1 Transcription Stage In the first stage, to convert Wardaman speech audio into phonetic

Read the complete text