Lost in Translation? A Comparative Study on the Cross-Lingual Transfer of Composite Harms

Vaibhav Shukla, Hardik Sharma, Adith N Reganti, Soham Wasmatkar, Bagesh Kumar, Vrijendra Singh · 2026

Read Lost in Translation? A Comparative Study on the Cross-Lingual Transfer of Composite Harms by Vaibhav Shukla, Hardik Sharma, Adith N Reganti, Soham Wasmatkar, Bagesh Kumar, Vrijendra Singh (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-07963.txt.

Description

Safety tests for language models mostly run in English, but harm does not always survive translation intact. Vaibhav Shukla and five co-authors build CompositeHarm, a benchmark that extends two English harm datasets into Hindi, Assamese, Marathi, Kannada, and Gujarati, to see how alignment holds as syntax and semantics shift.

Across three large models, harmful prompts succeed far more often in Indic languages, most of all when the wording is twisted against the model, while harms tied to context spread moderately. The study uses lightweight inference strategies to keep the evaluation scalable and energy-efficient. Multilingual safety teams gain evidence that English-only testing overstates safety, and a benchmark for measuring the gap in languages spoken by hundreds of millions.

Catalog record

CREATORVaibhav Shukla, Hardik Sharma, Adith N Reganti, Soham Wasmatkar, Bagesh Kumar, Vrijendra Singh
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-07963

Browse the full library · About the Tower of Babel