English Please: Evaluating Machine Translation with Large Language Models for Multilingual Bug Reports
1 st Avinash Patil, 2 nd Siru Tao, 3 rd Aryan Jadon · 2025
Read English Please: Evaluating Machine Translation with Large Language Models for Multilingual Bug Reports by 1 st Avinash Patil, 2 nd Siru Tao, 3 rd Aryan Jadon (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-14338.txt.
Description
Avinash Patil, Siru Tao, and Aryan Jadon run the first broad test of how well machines translate bug reports written in many languages. Their paper appeared in two thousand twenty-five. Global software teams depend on clear bug reports to fix faults fast. Reports flagged for translation in a major code editor's public tracker supplied the test data.
The team scored DeepL, AWS Translate, and five large language models. Measures covered both translation quality and spotting the source language. One chat model led on meaning and wording but not on naming the source language. Two rivals topped the language-spotting balance scores, while AWS led on raw hit rate there. No single system won across the board. The authors stress that translation for tech text needs domain tuning. Their code and data are shared for teams that triage bugs.
Catalog record
| CREATOR | 1 st Avinash Patil, 2 nd Siru Tao, 3 rd Aryan Jadon |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 27 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-14338