Language Arithmetics: Towards Systematic Language Neuron Identification and Manipulation
Daniil Gurgurov Katharina Trinley Yusser Al Ghussin, Tanja Bäumel Josef van Genabith Simon Ostermann · 2025
Read Language Arithmetics: Towards Systematic Language Neuron Identification and Manipulation by Daniil Gurgurov Katharina Trinley Yusser Al Ghussin, Tanja Bäumel Josef van Genabith Simon Ostermann (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-22608.txt.
Introduction
Daniil Gurgurov and co-authors build an arithmetic for language neurons in large models in a 2025 paper. Multilingual models handle many languages, but which neurons govern each language, and how to steer them, was poorly mapped. The team studied three open models across twenty-one typologically diverse languages.
Their entropy-based method found language neurons clustered in deeper layers, with non-Latin scripts more specialized and related languages sharing neurons. By systematically adding and multiplying activations, they steered models to deactivate unwanted languages and activate chosen ones, beating simpler replacement approaches across five tasks. High-resource languages steered best, and progressive deactivation exposed internal fallback mechanisms for language choice. The code is public.
Catalog record
| CREATOR | Daniil Gurgurov Katharina Trinley Yusser Al Ghussin, Tanja Bäumel Josef van Genabith Simon Ostermann |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-22608
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Language Arithmetics: Towards Systematic Language Neuron Identification and Manipulation Daniil Gurgurov Katharina Trinley Yusser Al Ghussin, Tanja Bäumel Josef van Genabith Simon Ostermann Abstract Large language models (LLMs) exhibit strong multilingual abilities, yet the neural mechanisms behind language-specific processing remain unclear. We analyze language-specific neurons in Llama-3.1-8B, Mistral-Nemo-12B, and Aya-Expanse-8B & 32B across 21 typologically diverse languages , identifying neurons that control language behavior. Using the Language Activation Probability Entropy (LAPE) method, we show that these neurons cluster in deeper layers, with non-Latin scripts showing greater specialization. Related languages share overlapping neurons, reflecting internal representations of linguistic proximity. Through language arithmetics , i.e. systematic activation addition and multiplication, we steer models to deactivate unwanted languages and activate desired ones, outperforming simpler replacement approaches. These interventions effectively guide behavior across five multilingual tasks: language forcing, translation, QA, comprehension, and NLI. Manipulation is more successful for high-resource languages, while typological similarity improves effectiveness. We also demonstrate that cross-lingual neuron steering enhances downstream performance and reveal internal "fallback" mechanisms for language selection when neurons are progressively deactivated. Our code is made publicly available at https://github.com/d-gurgurov/Language-Neurons-Manipulation . 1 Introduction The emergence of large language models (LLMs) with impressive multilingual capabilities has raised fundamental questions about how these systems internally represent and process different languages Wendler et al. 2024 ; Zhao et al. 2024 . While models like Llama-3 Grattafiori et al. 2024 and Gemma-3 Team et al. 2024 perform well across dozens of languages despite limited multilingual training data, the neural mechanisms underlying this competence, such as the emergence of language-specific spaces, cross-lingual feature sharing, and internal language routing, are not fully understood. Understanding these mechanisms is crucial not only for advancing theoretical insights into multilingual representation learning, but also for building more controllable and interpretable language technologies Amodei et al. 2016 ; Gabriel 2020 ; Singh et al. 2024 . Figure 1: Success rates of language forcing when deactivating neurons for the input language and activating those of a target language for Llama-3.1-8B. Recent studies have begun to explore how multilingual LLMs process language internally, showing that specific neurons may specialize in particular languages ( Tang et al. 2024 ; Kojima et al. 2024 ; Zhao et al. 2024 ; Mondal et al. 2025 ) . However, these works often focus on narrow language sets or specific architectures, leaving open questions about how language-specific processing scales across typologically diverse languages and how these insights can support model control and enhancement. In this work, we present the first large-scale investigation of language-specific neuron identification and manipulation in the Llama-3.1-8B Grattafiori et al. 2024 , Mistral-Nemo-12B AI 2024 , and Aya-Expanse-8B & 32B Dang et al. 2024 models across 21 typologically diverse languages. We examine the distribution of language-sensitive neurons, their cross-linguistic overlap, and the evolution of output language distributions across layers. Using the Language Activation Probability Entropy (LAPE) method ( Tang et al. 2024 ) , we identify neurons with strong language preferences and report several key findings. Unlike previously tested models such as Llama-2 Touvron et al. 2023 , BLOOM Le Scao et al. 2023 , and Phi-2 Javaheripi et al. 2023 , the models we study exhibit concentrated language-specific activity in their deeper layers. Analyzing output language distributions with logit lens Wendler et al. 2024 across layers reveals that language generation predominantly occurs in the final layers, aligning with the concentration of language-sensitive neurons. Non-Latin script languages show both a higher number of specialized neurons and less cross-language overlap, while typologically related Germanic and Romance languages share more neurons–reflecting linguistic proximity and possibly orthographic similarities in their internal representations. Building on these findings, we establish simple additive and multiplicative neuron intervention techniques, which we call language arithmetics 1 1 1 The naming follows conceptually similar works on task and prompt arithmetics Ilharco et al. 2023 ; Belanec et al. 2024 . , to test the causal role of language-specific neurons in controlling language use while preserving internal representations. Unlike prior approaches that rely on activation replacement Tang et al. 2024 ; Kojima et al. 2024 , our approach adds target-language patterns to hidden states, while simultaneously multiplying unwanted language patterns with 0 . We demonstrate that language arithmetics outperforms both replacement-based methods Tang et al. 2024 ; Kojima et al. 2024 and the widely used DiffMean Marks and Tegmark 2023 approach on a novel language forcing task, where models are expected to answer questions in a specific target language without being explicitly prompted, with especially strong results for languages better represented in pretraining. We further evaluate additive language arithmetic on four downstream tasks–machine translation, question answering, natural language inference, and machine comprehension–and show that targeted neuron activation improves performance without any task-specific fine-tuning, contrasting with the findings of Mondal et al. 2025 . For example, our intervention improves translation scores by up to 10% and enables precise cross-lingual transfer. Additionally, we find that when dominant language signals are suppressed, models fall back to the next most probable language, suggesting the presence of internal "fallback" mechanisms for language selection. Overall, our work (1) reveals new patterns of language-specific neuron specialization and layer-wise processing, (2) applies a minimally invasive steering technique to test their causal influence, and (3) demonstrates practical benefits for multilingual model control and performance. 2 Related Work Recent research has focused on uncovering language-specific mechanisms in LLMs. Several works have proposed methods to identify and intervene on neurons specialized for particular languages. Tang et al. 2024 introduce the Language Activation Probability Entropy (LAPE) method, demonstrating that certain neurons are critical to multilingual capacity and can be manipulated to control language behavior via activation (setting neurons to their average values) or deactivation (zeroing them out). Kojima et al. 2024 , building on Cuadros et al. 2022 , similarly identify neurons selectively active for one language and inactive for others, and show that setting these to their median activation can shift generation language. Tan et al. 2024 further propose a frequency-based method to rank FFN neurons by activation counts on language-specific inputs, and show that fine-tuning these neurons improves downstream tasks such as machine translation. Expanding beyond FFNs, Zhao et al. 2024 introduce Parallel Language-specific Neuron Detection (PLND), which identifies language neurons in both attention and FFN modules. They show that deactivating these neurons reduces performance in the corresponding language, and that fine-tuning them on limited language data enhances multilingual ability. Meanwhile, Deng et al. 2025 highlight the problem of superposition–where neurons encode multiple concepts ( Elhage et al. 2022 ) –and instead use sparse autoencoders (SAE) ( Cunningham et al. 2023 ) to extract latent dimensions linked to language identity. Ablating these features degrades performance, and they use them to guide steering vector construction for better control. Following this, Chou et al. 2025 show that modifying a single SAE feature can steer generation language with high accuracy and semantic preservation, especially in mid-to-late layers. Similarly, Andrylie et al. 2025 introduce SAE-LAPE to identify interpretable language-specific features in the sparse weight space, enabling both language identification and control. Our work extends this line of research in two dimensions: (1) We analyze the internal structure of LLMs without relying on auxiliary models such as SAEs, and (2) we look at a wider range of