TranslationCorrect : A Unified Framework for Machine Translation Post-Editing with Predictive Error Assistance
Syed Mekael Wasti Shou-Yi Hung Christopher Collins En-Shiun Annie Lee · 2025
Read TranslationCorrect : A Unified Framework for Machine Translation Post-Editing with Predictive Error Assistance by Syed Mekael Wasti Shou-Yi Hung Christopher Collins En-Shiun Annie Lee (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-18337.txt.
Introduction
Syed Mekael Wasti, Shou-Yi Hung, Christopher Collins, and En-Shiun Annie Lee built a tool in twenty twenty-five that unites machine translation and human fixing of its errors. Post-editing work is often split across clumsy, separate tools. Their framework, TranslationCorrect, puts translation, error prediction, and editing in one place.
The system generates drafts with models such as NLLB, then flags likely errors with quality models or language model APIs that explain their calls. Editors fix text in an interface designed to reduce mental load. For researchers, the tool exports span-level error notes in a standard format tied to a known quality scheme. A user study found the tool raised both speed and satisfaction over older annotation methods.
Catalog record
| CREATOR | Syed Mekael Wasti Shou-Yi Hung Christopher Collins En-Shiun Annie Lee |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-18337
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
TranslationCorrect : A Unified Framework for Machine Translation Post-Editing with Predictive Error Assistance Syed Mekael Wasti Shou-Yi Hung Christopher Collins En-Shiun Annie Lee Abstract Machine translation (MT) post-editing and research data collection often rely on inefficient, disconnected workflows. We introduce TranslationCorrect , an integrated framework designed to streamline these tasks. TranslationCorrect combines MT generation using models like NLLB, automated error prediction using models like XCOMET or LLM APIs (providing detailed reasoning), and an intuitive post-editing interface within a single environment. Built with human-computer interaction (HCI) principles in mind to minimize cognitive load, TranslationCorrect makes it easier for annotators to perform annotations, as confirmed by a user study using NASA Task Load Indices. For translators, it enables them to correct errors and batch translate efficiently. For researchers, TranslationCorrect exports high-quality span-based annotations in the Error Span Annotation (ESA) format, using an error taxonomy inspired by Multidimensional Quality Metrics (MQM). These outputs are compatible with state-of-the-art error detection models and suitable for training MT or post-editing systems. Our user study confirms that TranslationCorrect significantly improves translation efficiency and user satisfaction over traditional annotation methods. * * footnotetext: Equal contribution, corresponding author 1 Introduction Machine translation (MT) has seen significant advancements with the development of powerful translation models like Meta’s No Language Left Behind ( Team et al. 2022 , NLLB) and evaluation tools such as XCOMET Guerreiro et al. 2024 . However, the current translation and data collection workflows for MT model training remain inefficient. Traditional translation procedures often require human annotators to rely on manual, time-consuming processes involving tools like CSV files or Excel sheets Federmann 2018 . Typically, a translator must first generate machine translations using an external model, then manually collect and transfer the output into another format for review. Any subsequent error correction must also be performed manually, resulting in an inefficient and error-prone process. Similar challenges also exist in the data collection process for MT research. Datasets used for training MT systems are often complex to collect, as they have to undergo the tedious manual process mentioned earlier. However, to improve the efficiency of the annotation process, annotation tools like Appraise Federmann 2018 have been developed to facilitate the whole process, making MT training data collection easier and standardizing the data collection procedure. However, Appraise remains a platform dedicated to experienced annotators and linguists, enabling them to annotate data for future research and model training, which limits its usage to a specific group of users. Figure 1: Overview of the TranslationCorrect framework. The workflow begins with an annotator fetching data from a previously populated database we create for en \rightarrow xx language sets. We process our collections using the EC-1 error detection model and analyze the MT output to identify potential errors. The user sees these selected sentences and the relevant predicted errors within the post-edit section, where they can correct the translation based on these suggestions before submitting the final annotated sentence. To address these limitations, we introduce TranslationCorrect , a framework designed to streamline both translation workflows and MT data collection. For translators, TranslationCorrect offers a solution that automatically generates initial translations using a translation model, such as NLLB and identifies potential translation errors using XCOMET or an LLM of choice to provide more insights into the translation errors, enabling efficient post-editing of translations within the same environment. This approach eliminates the need for manual data handling through external tools, improving both translation quality and efficiency. For researchers in the MT community, TranslationCorrect also serves as a robust data collection tool, automatically formatting outputs in alignment with state-of-the-art MT dataset standards, supporting outputs that contain Multidimensional Quality Metrics ( Burchardt 2013 , MQM) and Error Span Annotation ( Kocmi et al. 2024 , ESA) information alongside each translation source and target pair. This feature enables annotators to generate high-quality datasets that can be used directly for training error correction models like XCOMET or fine-tuning translation systems like NLLB. Furthermore, our framework is designed with human-computer interaction (HCI) principles in mind, prioritizing ease of use and flexibility for annotators. The user interface is designed to minimize cognitive load and reduce the difficulty typically associated with traditional annotation workflows, such as those relying on manual data processing Norman 1983 ; Hustak et al. 2015 through Microsoft Excel. By integrating MT generation, error prediction, and correction within a single environment, our framework enables translators to focus on the translation task itself, rather than having to work with multiple tools simultaneously. Evaluation results from a user study indicate that our framework significantly outperforms traditional annotation methods, resulting in a considerably lower perceived workload and increased efficiency compared to conventional annotation methods. Our contributions are summarized as follows: • TranslationCorrect offers an integrated environment that automatically generates initial translations using translation models, predicts potential errors using error detection models or an LLM of choice, and enables efficient corrections. • The framework supports output formats aligned with state-of-the-art MT dataset standards, including MQM and ESA, enabling researchers and annotators to generate high-quality datasets for training and fine-tuning MT and translation error detection models. • Designed with HCI principles in mind, TranslationCorrect prioritizes ease of use and flexibility, reducing cognitive load for annotators. Our repository is MIT Licensed and is publicly available on GitHub 1 1 1 https://github.com/MekaelWasti/TranslationCorrect . Our deployed demo is available on a website 2 2 2 https://translation-correct-annotation-git-27a7e8-mekaelwastis-projects.vercel.app/ . A short demo of our framework is available on YouTube 3 3 3 https://youtu.be/j2sp13qyeQM . 2 TranslationCorrect An overview of TranslationCorrect ’s workflow is illustrated in Figure 1 , outlining the user flow from target language dataset selection to automatic error detection, user post-editing, and data export. Figure 2: Annotators can use the database view to easily view their target language dataset, select their desired sentences, and monitor completion status 2.1 Database View & MT Generation When annotators first enter the TranslationCorrect interface, they are presented with a database view component to select from the data entries that require annotation. Annotators can load sentences from this view, containing multiple source and MT pairs. The dataset is stored in MongoDB, containing the precomputed pairs of source and machine-translated sentences. For most of our datasets, we have used a 600M NLLB model 4 4 4 https://huggingface.co/facebook/nllb-200-distilled-600M to create machine translations; however, as we add increasingly lower-resource languages, we can switch to other models that support them. The source text and translated output are displayed side by side, as shown in Figure 3 , allowing annotators to compare and assess the machine translation quality conveniently. Furthermore, the annotated data is saved to the same database, permitting easy access. 2.2 Error Detection Following the MT generation, TranslationCorrect integrates an error detection model of the user’s choice to identify potential errors in the translated output automatically. For our demo, we offer two methods, with the first being XCOMET-XL 5 5 5 https://huggingface.co/Unbabel/XCOMET-XL , the 3.5B parameter variant of XCOMET, which will be used as a baseline error detection model, and the other being a custom GPT-4o assistant named EC-1. Figure 3: Predicted errors annotated by our error detection model are highlighted in both the source text and the machine translation output, with a detailed description of the error identified and its source-to-MT mapping. 2.2.1 Custom