Hindsight Quality Prediction Experiments in Multi-Candidate Human-Post-Edited Machine Translation

2026

Read Hindsight Quality Prediction Experiments in Multi-Candidate Human-Post-Edited Machine Translation (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-04083.txt.

Description

Marmonier and others run hindsight quality output tests in multi-candidate post-edited machine translation. They study source difficulty output and candidate quality gauging via hindsight tests on a multi-candidate post-editing dataset. The dataset holds more than 6,000 English segments with nine hypotheses each from neural systems and large language models. Using Kendall rank correlation against post-editing effort and human-judgment proxies, they assess difficulty metrics, quality models, and heuristics. Findings show the shift toward large language models changes shown quality output reliability, while mitigating document-level challenges.

Catalog record

YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42193
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2603.04083

Browse the full library · About the Tower of Babel