CoCo-CoLa: Evaluating and Improving Language Adherence in Multilingual LLMs
Elnaz Rahmati, Alireza S. Ziabari, Morteza Dehghani, University of Southern California · 2025
Read CoCo-CoLa: Evaluating and Improving Language Adherence in Multilingual LLMs by Elnaz Rahmati, Alireza S. Ziabari, Morteza Dehghani, University of Southern California (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-12476.txt.
Description
Elnaz Rahmati, Alireza Ziabari, and Morteza Dehghani tackle a flaw in large language models in their 2025 paper. Such models learn tasks across tongues, yet they often reply in English or another big language when asked in a smaller one.
The team builds a score that checks if both the idea and the language of a reply are right. Tests in seven languages show that skill moves across tongues while the choice of tongue stays biased. The last layers of the model seem to pick the tongue. Training only those layers matched full training at far less cost, and helped small languages most.
Catalog record
| CREATOR | Elnaz Rahmati, Alireza S. Ziabari, Morteza Dehghani, University of Southern California |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-12476