VietMix: A Naturally-Occurring Parallel Corpus and Augmentation Framework for Vietnamese-English Code-Mixed Machine Translation

Hieu Tran, Phuong-Anh Nguyen-Le, Huy Nghiem, Quang-Nhan Nguyen, Wei Ai, Marine Carpuat · 2025

Read VietMix: A Naturally-Occurring Parallel Corpus and Augmentation Framework for Vietnamese-English Code-Mixed Machine Translation by Hieu Tran, Phuong-Anh Nguyen-Le, Huy Nghiem, Quang-Nhan Nguyen, Wei Ai, Marine Carpuat (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-24472.txt.

Introduction

Hieu Tran and co-authors present a 2025 paper on translating mixed-language text. Speakers often blend Vietnamese and English in one message, and translation systems stumble on such code-mixed input. The problem bites harder for language pairs with little training data and loose spelling habits.

The team built VietMix, a corpus of natural mixed text with expert translations, the first of its kind for this pair. A pipeline then grew training data by rounds of fine-tuning and careful filtering. Models fed with the new data beat strong back-translation baselines on a quality score. Gains were larger still for models that had never seen mixed text. The authors offer the pipeline as a template for other low-resource pairs.

Catalog record

CREATORHieu Tran, Phuong-Anh Nguyen-Le, Huy Nghiem, Quang-Nhan Nguyen, Wei Ai, Marine Carpuat
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-24472

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

VietMix: A Naturally-Occurring Parallel Corpus and Augmentation Framework for Vietnamese-English Code-Mixed Machine Translation Hieu Tran, Phuong-Anh Nguyen-Le, Huy Nghiem, Quang-Nhan Nguyen, Wei Ai, Marine Carpuat Abstract Machine translation (MT) systems universally degrade when faced with code-mixed text. This problem is more acute for low-resource languages that lack dedicated parallel corpora. This work directly addresses this gap for Vietnamese-English, a language context characterized by challenges including orthographic ambiguity and the frequent omission of diacritics in informal text. We introduce VietMix , the first expert-translated, naturally occurring parallel corpus of Vietnamese-English code-mixed text. We establish VietMix ’s utility by developing a data augmentation pipeline that leverages iterative fine-tuning and targeted filtering. Experiments show that models augmented with our data outperform strong back-translation baselines by up to +3.5 xCOMET points and improve zero-shot models by up to +11.9 points. Our work delivers a foundational resource for a challenging language pair and provides a validated, transferable framework for building and augmenting corpora in other low-resource settings. $*$ $*$ footnotetext: These authors contributed equally to this work. 1 Introduction The proliferation of code-mixing, the blending of multiple languages within a single utterance Poplack (1980) , is dominant in global digital communication. While this reflects the realities of multilingualism, it severely degrades the performance of state-of-the-art machine translation (MT) systems, especially those overwhelmingly trained on non-code-mixed formal text Zhang et al. (2023) . In low-resource language pairs, the absence of large-scale code-mixed parallel corpora creates a cycle of poor model performance and data scarcity. Benchmark datasets have emerged for medium-resource pairs, e.g., Sheth et al. (2025) , but low-resource communities remain underserved. Throughout this paper, we adopt the sociolinguistic term "code-mixing" to refer specifically to intra-sentential blending of linguistic units Bokamba (1989) . While NLP works often use "code-mixing" as an umbrella term to cover all forms of language alternation Doğruöz et al. (2021) ; Winata et al. (2023) , our choice of "code-mixing" more precisely describes the hybridization phenomena that characterize our corpus. This paper focuses on Vietnamese-English, where a confluence of unique linguistic properties amplifies the code-mixing challenge. First, the two share significant orthographic ambiguity. For instance, the token ban is the English word meaning ("prohibition") but corresponds to at least five distinct Vietnamese words with different tones (bạn (friend), bản (village), bàn (table), bán (to sell), ban (to grant)), rendering context-free language identification nearly impossible. Second, informal digital text frequently omits the diacritics essential for disambiguating meaning in Vietnamese. Third, the prevalence of English-origin proper nouns and named entities further confounds this task of identifying true code-mixing. Automatic data curation, therefore, becomes exceptionally difficult to achieve and, until now, has hindered the development of a dedicated natural corpus. Addressing this, we introduce VietMix , the first expert-translated parallel corpus of naturally occurring Vietnamese-English code-mixing ( § 3 ). Our core contribution lies in both this resource and the validated methodology for its creation. VietMix contains over 10K code-mixed samples collected from Threads.com, with a held-out test set of 1K sentences translated and adjudicated by linguistic experts to serve as a gold-standard evaluation. Accompanying VietMix , we developed a three-stage data augmentation pipeline to establish strong baselines and provide a transferable framework for the community ( § 4 ). Critically, we show that augmenting models with our filtered, synthetic data provides consistent and significant gains over zero-shot models by up to +11.9 xCOMET points and strong back-translation baselines by up to +3.5 points. This proves the value of our quality-focused curation approach. Experimental validation across multiple model architectures ( § 5 ) confirms that this methodology provides more faithful translations, especially in capturing pragmatic and idiomatic nuances of code-mixed language ( § 6 ). We release the held-out test set under a Data Use Agreement (non-commercial, research-only). Code and preprocessing recipes are publicly accessible. 1 1 1 https://github.com/umd-vietnlp/code-switching Figure 1: Overview of our three-stage iterative data augmentation pipeline converting naturally occurring code-mixed Vi texts into synthetic parallel Vi-En corpora. Stage 1 focuses on seed data generation from naturally occurring Vi text and base model ( En \rightarrow Vi translation) bootstrapping. Stage 2 involves iterative synthetic Vi generation from En corpora and progressive fine-tuning with filtering. Stage 3 implements final quality assurance to produce the augmented parallel dataset. Italicized language code denotes synthetic/generated data. 2 Related Work Our work intersects three research areas: code-mixed MT, resource creation for low-resource languages, and synthetic data generation. Code-mixed MT. The challenge that mixed-language text poses to NLP systems is well-documented, with initial works focusing on core tasks like LID and part-of-speech tagging Solorio and Liu (2008) ; Li and Fung (2012) . Centralized benchmarks like GLUECoS Khanuja et al. (2020) and LinCE Aguilar et al. (2020) enabled systematic evaluation of model degradation on code-mixed inputs. These efforts have shown that even large multilingual models struggle to transfer non-code-mixed capabilities to code-mixed scenarios. Within this landscape, MT presents distinct challenges, primarily in the scarcity of parallel data. Consequently, research has concentrated on a few relatively high-resource language pairs, with Hindi-English being the most prominent with annotated datasets Sheth et al. (2025) and specialized augmentation techniques Kartik et al. (2024) . While work has expanded to low-resource pairs like Kazakh-Russian Borisov et al. (2025) and dialects of Mandarin Lu et al. (2022) , these efforts remain more limited in scope and do not address unique challenges in Southeast Asian tonal languages. Our work addresses this linguistic and geographic gap. Parallel Corpora for Vietnamese MT. The ecosystem of NLP resources for Vietnamese has matured significantly from foundational work on tokenization and syntactic parsing Vu et al. (2003) ; Nguyen et al. (2006) to the comprehensive VnCoreNLP toolkit Vu et al. (2018) . In MT, large-scale multi-domain corpora like PhoMT Doan et al. (2021) and MTet Ngo et al. (2022) have been instrumental in advancing translation quality for non-code-mixed Vietnamese-English. Recent efforts focused on domain specialization, namely, medical texts Vo et al. (2024) and other lanuguage pairs like Japanese-Vietnamese Do (2021) or Korean-Vietnamese Nguyen et al. (2019) . Despite the pervasiveness of code-mixing in Vietnamese social media, prior work on Vietnamese code-mixing has been limited to small-scale and non-parallel speech corpora Nguyen and Bryant (2020) or monolingual text mining Nguyen et al. (2024a) ; Hoang et al. (2023) . VietMix is the first resource to fill this gap and provides a gold-standard, expert-translated benchmark to catalyze research on this phenomenon. Synthetic Data for Low-Resource MT. Given high costs in creating parallel corpora, researchers have long turned to monolingual and comparable web corpora as a source of training data. Early statistical MT methods mined noisy parallels or lexicons to bootstrap low-fidelity translation systems before iteratively adding comparable monolingual corpora for retraining Abdul-Rauf and Schwenk (2009) ; Do et al. (2010) . More recent neural methods have refined this process using multilingual embeddings and self-supervised retraining to extract parallel data with minimal supervision Keung et al. (2020) ; Shi et al. (2022) . LLMs introduce a new paradigm for synthetic data generation as they can output vast amounts of parallel data through both forward- and back-translation Nguyen et al. (2024b) ; Lim et al. (2024) , with back-translation often yielding higher adequacy improvements Moslem et al. (2022) . However, naive back-translation can distort code-mixing

Read the complete text