TopXGen: Topic-Diverse Parallel Data Generation for Low-Resource Machine Translation

Armel Zebaze, Benoît Sagot, Rachel Bawden · 2025

Read TopXGen: Topic-Diverse Parallel Data Generation for Low-Resource Machine Translation by Armel Zebaze, Benoît Sagot, Rachel Bawden (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-08680.txt.

Description

Armel Zebaze, Benoît Sagot, and Rachel Bawden generate topic-diverse training text for low-resource translation in a 2025 paper. Language models translate well into big languages but stumble into small ones, and the parallel data that could teach them is scarce and narrow. Back-translation helps only when good target texts exist.

TopXGen flips the flow: the model writes fresh, varied target-language texts itself, exploiting its strength in big languages and its multilingual reach. Those texts are then translated back into a rich source language, yielding diverse parallel pairs. Used for fine-tuning and in-context examples, the synthetic data lifted translation quality into low-resource languages. Code and outputs are public.

Catalog record

CREATORArmel Zebaze, Benoît Sagot, Rachel Bawden
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE70 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-08680

Browse the full library · About the Tower of Babel