CoCo-CoLa: Evaluating and Improving Language Adherence in Multilingual LLMs

Elnaz Rahmati, Alireza S. Ziabari, Morteza Dehghani, University of Southern California · 2025

Read CoCo-CoLa: Evaluating and Improving Language Adherence in Multilingual LLMs by Elnaz Rahmati, Alireza S. Ziabari, Morteza Dehghani, University of Southern California (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-12476.txt.

Description

Elnaz Rahmati, Alireza Ziabari, and Morteza Dehghani tackle a flaw in large language models in their 2025 paper. Such models learn tasks across tongues, yet they often reply in English or another big language when asked in a smaller one.

The team builds a score that checks if both the idea and the language of a reply are right. Tests in seven languages show that skill moves across tongues while the choice of tongue stays biased. The last layers of the model seem to pick the tongue. Training only those layers matched full training at far less cost, and helped small languages most.

Catalog record

CREATORElnaz Rahmati, Alireza S. Ziabari, Morteza Dehghani, University of Southern California
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-12476

Browse the full library · About the Tower of Babel