Knowledge Localization in Mixture-of-Experts LLMs Using Cross-Lingual Inconsistency

Lucas Bandarkar Alan Ansell Trevor CohnGoogle Research · 2026

Read Knowledge Localization in Mixture-of-Experts LLMs Using Cross-Lingual Inconsistency by Lucas Bandarkar Alan Ansell Trevor CohnGoogle Research (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-17102.txt.

Introduction

Bandarkar, Ansell, and Cohn use cross lingual inconsistency to locate knowledge inside mixture of experts language models. Models often recall a fact in one language but fail in another. Their framework contrasts expert routing for languages where recall succeeds against languages where it fails. A statistical test on router logits then names the experts that matter for that fact. To validate, they switch those experts off and ask again. Turning off about 20 of roughly 6,000 experts made the model fail over 40 percent of previously correct answers.

Catalog record

CREATORLucas Bandarkar Alan Ansell Trevor CohnGoogle Research
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44365
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2603.17102

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Knowledge Localization in Mixture-of-Experts LLMs Using Cross-Lingual Inconsistency Lucas Bandarkar Alan Ansell Trevor CohnGoogle Research Abstract Modern LLMs continue to exhibit significant variance in behavior across languages, such as being able to recall factual information in some languages but not others. While typically studied as a problem to be mitigated, in this work, we propose leveraging this cross-lingual inconsistency as a tool for interpretability in mixture-of-experts (MoE) LLMs. Our knowledge localization framework contrasts routing for sets of languages where the model correctly recalls information from languages where it fails. This allows us to isolate model components that play a functional role in answering about a piece of knowledge. Our method proceeds in two stages: (1) querying the model with difficult factual questions across a diverse set of languages to generate “success” and “failure” activation buckets and then (2) applying a statistical contrastive analysis to the MoE router logits to identify experts important for knowledge. To validate the necessity of this small number of experts for answering a knowledge question, we deactivate them and re-ask the question. We find that despite only deactivating about 20 out of 6000 experts, the model no longer answers correctly in over 40% of cases. Generally, this method provides a realistic and scalable knowledge localization approach to address increasingly complex LLMs. 1 Introduction The accelerated development of large language models (LLMs) has far outpaced our ability to understand them. Despite significant effort, modern interpretability research has struggled to provide a verifiable understanding of how LLMs store and retrieve knowledge, something they do incredibly well. The field of mechanistic interpretability, for example, has focused on reverse-engineering models at neuron-level, but such “bottom-up”, ultra-granular approaches have failed to reliably explain the increasing complexity of modern models ( 14 ; 33 ) . Figure 1: Overview of our knowledge localization framework for MoEs that uses Cross-Lingual Inconsistency for Contrastive Identification ( XICI ) The recent transition of frontier LLMs from dense models to sparse mixture-of-experts (MoE) architectures ( 42 ) has only added to the challenges. In MoEs, the MLP block of each decoder layer is replaced with E small blocks ( experts ) where only k\ll E are activated for each token. This sparsity enables much larger and better models, but relies on non-differentiable, discrete activations and results in highly distributed and redundant representations. As a result, many interpretability methods have become even less feasible. However, sparse activations also provide a natural unit of abstraction: the experts. This modularity offers a scalable lens for interpretability, uncovering structured patterns such as expert specialization for various functionality, domains, and languages ( 32 ; 3 ; 21 ; 9 ) . In this work, we propose a new angle for dissecting models rooted in the common observation that LLMs often behave differently when prompted with semantically equivalent inputs across languages. Modern LLMs operate in abstract representation spaces that are accessible via many input languages, allowing them to transfer knowledge and reasoning capabilities. However, the language-universality of these parameters is far from perfect and accessing this knowledge with a high rate of dependability remains difficult. As a result, we propose leveraging unsuccessful responses as an instrument for interpretability, rather than requiring unnatural perturbations. That is, we prompt semantically equivalent inputs in many languages to an LLM and if it produces the desired output in some languages but not others, we have two sets of computation graphs that we can contrast for analysis — a framework we call Cross-lingual Inconsistency for Contrastive Identification (XICI). We apply XICI to MoEs for expert-level knowledge localization , the task of identifying the parts of the model important for the retrieval of information or a fact ( 13 ) . With hundreds of factual-recall prompts translated across numerous languages from ECLeKTic ( 11 ) , MultiLoKo ( 17 ) , and the prehistory subject from Global MMLU ( 43 ) , we collect positive and negative router data from the MoE block at every layer. We then use the Mann-Whitney U-test to statistically separate activation common amongst languages where the model answered correctly and missing from incorrect forward passes. On top of this statistical test, we take numerous additional steps to ensure experts are important for question-specific knowledge, rather than confounding factors. The result of this attribution method is a small set of experts that we identify as being important for a factoid. To verify the importance of such experts, we deactivate them (causal ablation) without disrupting the natural distribution of hidden states and evaluate the LLM’s ability to answer such questions without the necessary experts. Across two models and over 400 questions, we find that when deactivating about 0.3% of experts across the model, we achieve an ablation success rate of over 40%. Given the distributed nature of state-of-the-art MoEs, the ablation success rate and its comparison to baselines suggest significant promise in our approach. We start by discussing the background and intuition behind this methodology in Sections 2 and 4 . In Section 5 , we detail our XICI implementation. In Section 6 , we present the outcome of causally ablating the identified experts for each question. Finally in Section 7 , we discuss notable takeaways about XICI and broadly, knowledge in MoEs. 2 Related Work 2.1 Knowledge Localization and Editing Significant recent interpretability research in LLM knowledge has focused on mechanistic analyses of the model weights. While the locate-then-edit paradigm ( 30 ) initially promised a surgical understanding of LLM parameters, recent efforts reveal significant gaps in current knowledge localization ( 41 ) . Methods like Integrated Gradients ( 45 ; 28 ) and Causal Tracing ( 30 ; 13 ) often suffer from low precision. Even as Sparse Autoencoders (SAEs) ( 16 ) attempt to disentangle polysemanticity into interpretable features, they still fail to illuminate verifiable mechanisms that cause model behavior. As a result of these challenges, numerous researchers have advocated against continued attempts at reverse-engineering LLMs ( 14 ; 41 ; 33 ) . Regardless, research has consistently linked knowledge to FFN layers ( 30 ; 22 ; 10 ) , likely due to their immense parameter capacity. These complex networks, or knowledge circuits, are typically distributed across many layers ( 56 ) . 2.2 Interpretability in Mixture-of-Experts As discussed in the introduction, many localization methods designed for dense models are not easily adaptable to MoEs ( 12 ; 20 ) (e.g. circuit analysis). In particular, 48 claims knowledge localization is more challenging in MoEs as sparsity fosters even more distributed knowledge storage. However, there is growing evidence that MoEs learn to specialize experts by function or semantics, providing interpretability research with convenient modular units ( 32 ; 25 ; 35 ; 3 ) . Evidence suggests this specializaton is established quite early in pretraining ( 53 ; 48 ) and is more pronounced with global-batch load-balancing ( 39 ) . Functionality arises from numerous experts collaborating across layers ( 57 ) , but 9 demonstrates that individual experts can be identified and deactivated to reliably steer model behavior. 2.3 Language-Agnostic Representations Fundamentally, our method leverages LLM’s language-agnostic representations. These representations, attainable from input in any language, have been studied extensively and found to mostly reside in middle model layers ( 18

Read the complete text