Multilingual Non-Autoregressive Machine Translation without Knowledge Distillation

Chenyang Huang, Fei Huang, Zaixiang Zheng, Osmar R. Zaïane, Hao Zhou, Lili Mou · 2025

Read Multilingual Non-Autoregressive Machine Translation without Knowledge Distillation by Chenyang Huang, Fei Huang, Zaixiang Zheng, Osmar R. Zaïane, Hao Zhou, Lili Mou (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-04537.txt.

Description

Chenyang Huang and co-authors speed up translation between many languages with a single model, in this 2025 paper. Their model writes the whole target sentence at once rather than word by word, which is far faster. Past versions of this trick needed a costly training step called knowledge distillation, where a slower teacher model's output trains the fast one. Dropping that step was the goal here.

Their system builds on a transformer shaped like a branching graph, which plans word order without a teacher. They add a pivot trick: translating through a middle language and back to firm up pairs the model never saw in training. Tests show top scores among fast, teacher-free systems. The result points to cheaper multilingual tools for low-resource settings.

Catalog record

CREATORChenyang Huang, Fei Huang, Zaixiang Zheng, Osmar R. Zaïane, Hao Zhou, Lili Mou
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-04537

Browse the full library · About the Tower of Babel