Multilingual Non-Autoregressive Machine Translation without Knowledge Distillation
Chenyang Huang, Fei Huang, Zaixiang Zheng, Osmar R. Zaïane, Hao Zhou, Lili Mou · 2025
Read Multilingual Non-Autoregressive Machine Translation without Knowledge Distillation by Chenyang Huang, Fei Huang, Zaixiang Zheng, Osmar R. Zaïane, Hao Zhou, Lili Mou (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-04537.txt.
Description
Chenyang Huang and co-authors speed up translation between many languages with a single model, in this 2025 paper. Their model writes the whole target sentence at once rather than word by word, which is far faster. Past versions of this trick needed a costly training step called knowledge distillation, where a slower teacher model's output trains the fast one. Dropping that step was the goal here.
Their system builds on a transformer shaped like a branching graph, which plans word order without a teacher. They add a pivot trick: translating through a middle language and back to firm up pairs the model never saw in training. Tests show top scores among fast, teacher-free systems. The result points to cheaper multilingual tools for low-resource settings.
Catalog record
| CREATOR | Chenyang Huang, Fei Huang, Zaixiang Zheng, Osmar R. Zaïane, Hao Zhou, Lili Mou |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-04537