LangMark: A Multilingual Dataset for Automatic Post-Editing

Diego Velazquez, Mikaela Grace, Konstantinos Karageorgos, Lawrence Carin, Aaron Schliem, Dimitrios Zaikis, Roger Wechsler · 2025

Read LangMark: A Multilingual Dataset for Automatic Post-Editing by Diego Velazquez, Mikaela Grace, Konstantinos Karageorgos, Lawrence Carin, Aaron Schliem, Dimitrios Zaikis, Roger Wechsler (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-17153.txt.

Description

Diego Velazquez and six co-authors release LangMark, a dataset for automatic post-editing, the task of fixing machine translation errors without redoing the translation by hand. Good post-editing systems were held back by a lack of large, multilingual training data based on real machine output. LangMark fills that gap for translations from English into seven languages, including French, German, Japanese, Russian, and Spanish.

The dataset holds nearly 207,000 triplets: a source segment, the machine translation, and a human expert's corrected version. Using it, the authors show that large language models with few-shot prompting can post-edit effectively, beating leading commercial translation systems on their tests. Because expert linguists produced the corrections, the data offers both scale and quality. The release should spur better post-editing research.

Catalog record

CREATORDiego Velazquez, Mikaela Grace, Konstantinos Karageorgos, Lawrence Carin, Aaron Schliem, Dimitrios Zaikis, Roger Wechsler
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-17153

Browse the full library · About the Tower of Babel