Beyond Scalar Scores: Reinforcement Learning for Error-Aware Quality Estimation of Machine Translation
Archchana Sindhujan, Girish A. Koushik, Shenbin Qian, Diptesh Kanojia, Constantin Orăsan · 2026
Read Beyond Scalar Scores: Reinforcement Learning for Error-Aware Quality Estimation of Machine Translation by Archchana Sindhujan, Girish A. Koushik, Shenbin Qian, Diptesh Kanojia, Constantin Orăsan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-08600.txt.
Description
Judging machine translation without reference translations usually means a single quality score, with no account of what went wrong. Archchana Sindhujan and four co-authors build error-aware quality estimation for the English-Malayalam pair, where annotated data is extremely scarce. Their arXiv paper releases the first segment-level dataset for that pair, pairing human scores with short annotator remarks on errors.
A reinforcement-learning framework, ALOPE-RL, trains compact adapters using rewards from both scores and error remarks, teaching models to reason about quality beyond numbers. Despite small training data, it sets a new state of the art for the pair with models under four billion parameters, beating larger baselines and leading encoder models. Readers get a data-efficient path to translation quality judgments that explain themselves.
Catalog record
| CREATOR | Archchana Sindhujan, Girish A. Koushik, Shenbin Qian, Diptesh Kanojia, Constantin Orăsan |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-08600