Recovered in Translation: Efficient Pipeline for Automated Translation of Benchmarks and Datasets
Hanna Yukhymenko, Anton Alexandrov, Martin Vechev · 2026
Read Recovered in Translation: Efficient Pipeline for Automated Translation of Benchmarks and Datasets by Hanna Yukhymenko, Anton Alexandrov, Martin Vechev (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-22207.txt.
Description
Multilingual model tests are only as good as their translations, and translated benchmarks often drift in meaning or drop context. Hanna Yukhymenko and two co-authors present a fully automated pipeline for translating benchmarks and datasets at scale without that decay. It adapts test-time compute scaling, including a method called Universal Self-Improvement and a new multi-round ranking method, T-RANK.
The pipeline preserves each benchmark's task structure and linguistic nuance during localization, and its outputs beat traditional pipelines on quality. The team applies it to popular benchmarks across eight Eastern and Southern European languages. Evaluators gain translated tests they can trust to measure models rather than translation errors.
Catalog record
| CREATOR | Hanna Yukhymenko, Anton Alexandrov, Martin Vechev |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 68 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-22207