MT-Lens : An all-in-one Toolkit for Better Machine Translation Evaluation

Javier García Gilabert, Carlos Escolano, Audrey Mash, Xixian Liao, Maite Melero · 2024

Read MT-Lens : An all-in-one Toolkit for Better Machine Translation Evaluation by Javier García Gilabert, Carlos Escolano, Audrey Mash, Xixian Liao, Maite Melero (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-11615.txt.

Description

Javier García Gilabert and co-authors release an all-in-one toolkit for grading machine translation systems, in a paper from two thousand twenty-four. Translation checks usually stop at output quality, leaving bias, toxicity, and spelling robustness unmeasured. Their toolkit extends a popular model evaluation harness for translation work.

Quality, gender bias, added toxicity, and typo robustness are all covered in one place. Modern data sets and many metrics come built in. An interactive platform lets users compare systems and inspect translations visually. The authors aim to widen access to deeper evaluation for researchers and engineers alike.

Catalog record

CREATORJavier García Gilabert, Carlos Escolano, Audrey Mash, Xixian Liao, Maite Melero
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-11615

Browse the full library · About the Tower of Babel