Lost in the Tower of Babel: The Adverse Effects of Incidental Multilingualism in LLMs

Anjishnu Mukherjee, Chutong Meng, Antonios Anastasopoulos · 2026

Read Lost in the Tower of Babel: The Adverse Effects of Incidental Multilingualism in LLMs by Anjishnu Mukherjee, Chutong Meng, Antonios Anastasopoulos (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-01224.txt.

Introduction

Anjishnu Mukherjee and two co-authors argue that modern language models are multilingual only incidentally, and that this paradigm is fragile and misleading. Models appear multilingual because they train on massive, uneven web corpora, not because such competence was a core design goal. The authors contend this produces unequal, brittle, and opaque behavior across languages, with severe consequences for real and agentic deployments.

A focused study examines which languages models self-report as supported and which ones they actually respond in across prompts in many tongues. A simple language-change attack further surfaces hidden assumptions and failures. The authors call for multilingualism by design. Equitable performance, cultural grounding, and cross-lingual behavioral understanding should be first-class goals throughout the pipeline.

Catalog record

CREATORAnjishnu Mukherjee, Chutong Meng, Antonios Anastasopoulos
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2605.01224

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Lost in the Tower of Babel: The Adverse Effects of Incidental Multilingualism in LLMs Anjishnu Mukherjee, Chutong Meng, Antonios Anastasopoulos Abstract This paper argues that contemporary multilingual NLP has converged on a fragile and misleading paradigm of incidental multilingualism . Today’s LLMs appear multilingual largely because they are trained on massive, uneven web corpora, not because multilingual or multicultural competence has been treated as a core design objective. We contend that this paradigm systematically produces unequal, brittle, and opaque behavior across languages, with severe consequences in real-world and agentic deployments where models must reason, plan, and act across multiple linguistic contexts. We report a focused empirical study of two practical questions: which languages models self-report as supported and which languages they actually respond in across multilingual prompts. We additionally demonstrate how even a simple language-change attack can surface these failures and expose hidden assumptions about language in LLM-based systems. To address this, we call for a shift toward multilingualism by design : a research agenda that treats equitable multilingual performance, cultural grounding, and cross-lingual behavioral understanding as first-class goals in all aspects of the model pipeline. 1 1 1 Results, code and data : https://github.com/antonisa/llm-languages . 1 Introduction Despite persistent and well-documented gaps, the success of large language models (LLMs) in multilingual settings is undeniable. Contemporary LLMs exhibit usable competence in over 100 languages and are increasingly deployed in real-world applications across the globe. This apparent breadth has led to a widespread perception that multilingual language modeling is a largely solved or at least steadily improving problem. But the same amazing LLMs exhibit embarassingly problematic limitations. One notable such limitation is their inability to consistently generate text in a user’s desired language. Even if top-tier models such as GPT-4o score between 96 and 98\% on the Language Confusion Benchmark ( 35 ) , a system that receives more than 2 billion queries per day (like ChatGPT does), effectively still responds in the wrong language 40+ million times per day. In this paper, we argue that this perception of success is misleading. Much of the recent progress in multilingual LLMs rests on shaky foundations that risk constraining future advances and obscuring systemic weaknesses. In particular, we contend that the dominant paradigm in multilingual LLM development relies on a set of implicit assumptions that deserve renewed scrutiny. Without revisiting these assumptions, further progress toward robust, equitable, and predictable multilingual systems may prove difficult. We characterize the multilingual capabilities of current LLMs as the result of incidental multilingualism . By this, we mean multilingual behavior that emerges largely as a side effect of other design decisions such as training on massive, heterogeneous web corpora. We contrast this with multilingualism by design , where multilingual capability is treated as a primary design goal, shaping decisions about data collection, modeling, evaluation, and deployment. Multilingualism by design requires explicit objectives and success criteria across languages/cultures, rather than current reliance on post hoc evaluation of emergent behavior. To ground this argument in evidence relevant for deployment, we analyze a two-way support gap between self-declared support lists produced by models when asked directly, and observed non-refusal multilingual behavior under diverse task prompts. This paper makes four contributions. First, we briefly situate our argument within the current status quo of multilingual language modeling (§ 2 ). Second, we present a focused investigation of language support claims versus observed behavior across current frontier models (§ 3 ). Third, we demonstrate how a simple language-change “attack” exposes failure modes of incidental multilingualism in practical LLM-powered agentic scenarios (§ 4 ). Finally, we outline a set of research directions and policy suggestions aimed at moving the field toward multilingualism by design (§ 5 ). We aim for this paper to be neither an exhaustive survey nor an explicitly empirical one. Rather, it is a position piece grounded in concrete investigation and examples, intended to provoke discussion and re-examination of prevailing practices in multilingual LLM research. 2 The Status Quo in Multilingual NLP Early massively multilingual NLP was driven by research in machine translation ( 2 , e.g.,) and eventually hit the spotlight with encoder-only transformer language models such as multilingual BERT (mBERT) and XLM-R. mBERT ( 13 ) was trained on Wikipedia in 100+ languages with a shared subword vocabulary, the first model that enabled zero-shot transfer across languages but also exhibiting strong performance disparities between high- and low-resource languages ( 52 ) . Generative LLMs such as GPT- n and various open-source families like LLaMA ( 50 ) inherit this incidental multilingualism: they are trained on massive but heavily skewed web corpora, which gives them surprisingly broad language coverage but without explicit design for facilitating language transfer or equitable performance across languages ( 14 ; 39 ) . Below, we outline general observations that we believe hold for the vast majority of multilingual LLM research and development. Uneven Performance and Evaluation Issues A consistent finding across models and tasks is that multilingual performance is highly imbalanced and, in many cases, “unfair”. Accuracy can vary dramatically across languages even when tokenization and architecture are shared, with languages that are low-resource or typologically distant from English lagging behind. This was true for mBERT ( 37 ) still to this day for the most recent models ( 45 ) . Even worse, 3 found robust indicators that several models are likely to be contaminated with multilingual evaluation benchmarks, making proper evaluation at scale almost impossible. Much recent multilingual work focuses on evaluation and dataset construction to quantify these problems. Benchmarks such as XTREME ( 41 ) , XGLUE ( 31 ) , FLORES ( 23 ) , MIRACL ( 55 ) , and multilingual safety benchmarks like XSafety ( 51 ) provide multi-task, many-language test suites that make cross-lingual gaps and safety issues more visible. Efforts like GlobalBench ( 45 ) , CultureBench ( 10 ) , or DialectBench ( 18 ) aimed to organize benchmarking around specific goals (holistic LM evaluation, cultural appropriateness, and robustness to dialectal variation respectively). In parallel, data- and tokenizer-centric efforts aim to mitigate structural disadvantages. The argument can be made that byte- or character-level models such as ByT5 ( 53 ) remove language-specific subword vocabularies and show competitive performance across scripts, with follow-up work demonstrating that tokenization decisions materially affect low-resource and morphologically rich languages ( 16 ; 12 ) . More recent efforts even attempt to go tokenization-free by converting text inputs to images, in the PIXEL model series 30 ; 48 . The Aya initiative did push toward “multilingualism by design”: the Aya Dataset and Collection ( 44 ) constitute large-scale multilingual instruction corpora with deliberate coverage of 100+ languages, and Aya-23 ( 4 ) traded breadth for depth to improve quality in 23 languages, releasing open-weight models and detailed multilingual evaluation to track progress ( 11 ) . Despite this intense activity around benchmarks, data curation, and tokenization, there is comparatively less work on understanding what massively multilingual (200+ language) models actually know and how languages interact internally. But properly understanding such complicated systems is highly computationally expensive: 34 rely on approximations from bilingual modeling, while 19 similarly relied on bi- and trilingual adapters on top of pre-trained multilingual models. Surveys emphasize that most analyses

Read the complete text