Beyond Scalar Scores: Reinforcement Learning for Error-Aware Quality Estimation of Machine Translation

Archchana Sindhujan, Girish A. Koushik, Shenbin Qian, Diptesh Kanojia, Constantin Orăsan · 2026

Read Beyond Scalar Scores: Reinforcement Learning for Error-Aware Quality Estimation of Machine Translation by Archchana Sindhujan, Girish A. Koushik, Shenbin Qian, Diptesh Kanojia, Constantin Orăsan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-08600.txt.

Description

Judging machine translation without reference translations usually means a single quality score, with no account of what went wrong. Archchana Sindhujan and four co-authors build error-aware quality estimation for the English-Malayalam pair, where annotated data is extremely scarce. Their arXiv paper releases the first segment-level dataset for that pair, pairing human scores with short annotator remarks on errors.

A reinforcement-learning framework, ALOPE-RL, trains compact adapters using rewards from both scores and error remarks, teaching models to reason about quality beyond numbers. Despite small training data, it sets a new state of the art for the pair with models under four billion parameters, beating larger baselines and leading encoder models. Readers get a data-efficient path to translation quality judgments that explain themselves.

Catalog record

CREATORArchchana Sindhujan, Girish A. Koushik, Shenbin Qian, Diptesh Kanojia, Constantin Orăsan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-08600

Browse the full library · About the Tower of Babel