Decoding Knowledge Attribution in Mixture-of-Experts: A Framework of Basic-Refinement Collaboration and Efficiency Analysis
Junzhuo Li, Bo Wang, Xiuze Zhou, Peijie Jiang, Jia Liu, Xuming Hu · 2025
Read Decoding Knowledge Attribution in Mixture-of-Experts: A Framework of Basic-Refinement Collaboration and Efficiency Analysis by Junzhuo Li, Bo Wang, Xiuze Zhou, Peijie Jiang, Jia Liu, Xuming Hu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-24593.txt.
Introduction
Some large language models work as a team of expert parts, with a router that sends each task to a few of them. Junzhuo Li and co-authors ask where facts live inside such models in a 2025 study. They compare three team-style models with three dense models that use all their parts at once.
The team-style models did more with each layer, the study found. Early layers screened the experts, and late layers refined facts with help from shared parts. Shared experts took on broad tasks, while routed ones took on narrow facts. Deep models shrugged off the loss of top experts, but a shallow one lost much ground. The map can guide leaner, tougher designs.
Catalog record
| CREATOR | Junzhuo Li, Bo Wang, Xiuze Zhou, Peijie Jiang, Jia Liu, Xuming Hu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-24593
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Decoding Knowledge Attribution in Mixture-of-Experts: A Framework of Basic-Refinement Collaboration and Efficiency Analysis Junzhuo Li, Bo Wang, Xiuze Zhou, Peijie Jiang, Jia Liu, Xuming Hu Abstract The interpretability of Mixture-of-Experts (MoE) models, especially those with heterogeneous designs, remains underexplored. Existing attribution methods for dense models fail to capture dynamic routing-expert interactions in sparse MoE architectures. To address this issue, we propose a cross-level attribution algorithm to analyze sparse MoE architectures (Qwen 1.5-MoE, OLMoE, Mixtral-8x7B) against dense models (Qwen 1.5-7B, Llama-7B, Mistral-7B). Results show MoE models achieve 31% higher per-layer efficiency via a “mid-activation, late-amplification” pattern: early layers screen experts, while late layers refine knowledge collaboratively. Ablation studies reveal a “basic-refinement” framework—shared experts handle general tasks (entity recognition), while routed experts specialize in domain-specific processing (geographic attributes). Semantic-driven routing is evidenced by strong correlations between attention heads and experts ( r = 0.68 r=0.68 ), enabling task-aware coordination. Notably, architectural depth dictates robustness: deep Qwen 1.5-MoE mitigates expert failures (e.g., 43% MRR drop in geographic tasks when blocking top-10 experts) through shared expert redundancy, whereas shallow OLMoE suffers severe degradation (76% drop). Task sensitivity further guides design: core-sensitive tasks (geography) require concentrated expertise, while distributed-tolerant tasks (object attributes) leverage broader participation. These insights advance MoE interpretability, offering principles to balance efficiency, specialization, and robustness. 1 Introduction In recent years, transformer-based large language models (LLMs) ( Vaswani et al., 2017 ; Brown et al., 2020 ; Touvron et al., 2023b ; Bai et al., 2023 ) have significantly enhanced task performance by scaling up parameters, yet at the cost of prohibitive computational demands. To balance efficiency and performance, Mixture-of-Experts (MoE) architectures ( Fedus et al., 2021 ; Lepikhin et al., 2021 ; Shen et al., 2023 ; Jiang et al., 2024 ; Dai et al., 2024 ; Sun et al., 2024 ) activate subsets of experts per input, reducing overhead while maintaining capability. While existing research has prioritized optimizing routing mechanisms and expert module efficiency (e.g., top- k gating ( Fedus et al., 2021 ; Lepikhin et al., 2021 ) ), a critical question remains unanswered: How do experts collaboratively process and refine knowledge within MoE models? This gap in interpretability is particularly pronounced in models with heterogeneous designs, such as shared expert modules ( Dai et al., 2024 ) . Despite their widespread adoption ( DeepSeek-AI et al., 2024 ; Team, 2024 ) , the roles of shared experts—whether they serve as universal feature extractors or redundant backups—lack empirical validation. The opacity of expert collaboration not only hampers credibility assessment (e.g., verifying if experts specialize in specific knowledge domains) but also forces model designers to rely on trial-and-error strategies, limiting systematic improvements. For instance, fundamental issues like the distribution of shared experts across layers and their impact on knowledge consistency remain unexplored. Two key challenges compound this problem: (1) Existing attribution methods ( Geva et al., 2021 ; Dai et al., 2022a ; Geva et al., 2022 ; Wu et al., 2023 ) are designed for dense models and fail to capture dynamic interactions between routed experts and shared modules. (2) Comparative studies on heterogeneous MoE architectures are scarce, leaving functional assumptions (e.g., “shared experts handle general tasks”) unverified. Figure 1: Schematic of the MoE expert layer: Shared experts perform foundational tasks (e.g., the Capital Identifier recognizes “capital,” the Country Identifier recognizes “Canada”), while routed experts execute refinement steps—generating candidate capitals, matching them to “Canada,” and selecting the final answer (“Ottawa”). In this paper, we address these gaps by proposing a cross-level attribution algorithm for MoE models, extending dense model methods to analyze both macro architectures (Mixtral-8x7B ( Jiang et al., 2024 ) , Qwen 1.5-MoE ( Team, 2024 ) , OLMoE Muennighoff et al. (2024) ) and micro behaviors. Our experiments uncover four pivotal insights. First, MoE models significantly outperform dense counterparts in per-layer efficiency—Qwen 1.5-MoE achieves a layer efficiency of 0.294 with 24 layers, surpassing Qwen 1.5-7B (0.213 with 32 layers), a 37% improvement attributed to concentrated knowledge processing in early layers. Second, we identify a hierarchical "basic-refinement" collaboration: shared experts act as generalists for foundational tasks like entity localization, while routed experts specialize in refining domain-specific attributes (e.g., linking "Canada" to "Ottawa"). Third, semantic-driven routing is validated through strong temporal correlations between attention heads and expert selection ( r=0.68,p<0.0014 ), indicating that attention mechanisms guide experts toward task-relevant features. Finally, robustness varies starkly by architecture: blocking top-10 experts in deep Qwen 1.5-MoE causes a 43% MRR drop in geographic tasks, whereas shallow OLMoE suffers a 76% decline, underscoring the critical role of depth and shared experts in redundancy design. Contributions Our main contributions are as follows: • A cross-level attribution algorithm for MoE models , bridging the gap in interpreting sparse architectures by dynamically weighting expert and attention contributions. • Empirical validation of MoE efficiency and collaboration patterns , including layer efficiency gains, a “mid-activation, late-amplification” processing paradigm, and semantic-driven expert routing. • Design implications for robust MoE architectures , demonstrating that deep models with shared experts balance specialization and redundancy, particularly critical for complex tasks like geographic reasoning. Model HIT@10 MRR Total FFN Gain Total Attn Gain Peak Gain Layer Position (Relative Position%) Layer Efficiency (FFN Gain / Num. of Layers) Llama-7B 0.90 0.70 5.16 4.03 24.82 (77.6%) 0.161 Qwen 1.5-7B 0.79 0.62 6.49 4.14 27.08 (90.2%) 0.203 Mistral-7B 0.88 0.71 6.74 2.96 26.64 (83.2%) 0.211 Qwen 1.5-MoE 0.85 0.63 7.36 3.18 20.36 (84.8%) 0.307 OLMoE 0.83 0.64 4.98 4.40 13.53 (84.6%) 0.311 Mixtral-8x7B 0.90 0.73 6.79 3.03 26.66(83.3%) 0.212 Table 1: Comparison of model architectures on performance metrics, component contributions, and layer efficiency across dense and MoE models. 2 Methodology In this section, we first describe the MoE model architecture, followed by the knowledge attribution method. More details for model settings and experimental settings (i.e., dataset, evaluation metrics) can be found in Appendix A . 2.1 MoE Architecture In the decoder-only MoE architecture, each Transformer decoder block replaces the conventional Feed-Forward Network (FFN) with an MoE layer, enhancing model capacity via dynamic routing. Given an input sequence X=(x_{1},x_{2},\dots,x_{T}) , the tokens are embedded to produce the initial hidden state \bm{h}^{0}=\text{Embed}(X) . We omit bias and layer normalization ( Ba et al., 2016 ) following Geva et al. (2022) . Each decoder layer consists of a self-attention mechanism and an MoE layer. At layer l , the attention output for token x_{i} is computed as: \bm{A}_{i}^{l}=\sum_{j=1}^{H}\text{ATTN}_{j}^{l}(\bm{h}_{1}^{l-1},\bm{h}_{2}^{l-1},\dots,\bm{h}_{T}^{l-1}), (1) where H is the number of attention heads. The intermediate representation \bm{u}_{i}^{l}=\bm{A}_{i}^{l}+\bm{h}_{i}^{l-1} is routed to N experts via a gating network, which computes the routing probabilities: \bm{g}_{i}^{l}=\text{softmax}(\bm{W}_{g}^{l}\bm{u}_{i}^{l}+\bm{b}_{g}^{l}), (2) where \bm{W}_{g}^{l} and \bm{b}_{g}^{l} are learnable parameters. Each expert \mathcal{E}_{j}^{l} is a feed-forward network: \mathcal{E}_{j}^{l}(\bm{u}_{i}^{l})=\bm{W}_{j,2}^{l}\phi(\bm{W}_{j,1}^{l}\bm{u}_{i}^{l}+\bm{b}_{j}^{l}), (3) where \phi(\cdot) is a nonlinear activation function Nair and Hinton (2010) ; Maas et al. (2013) ; Hendrycks and Gimpel (2023) . The final output for token x_{i} at layer l is computed by a weighted sum of the top k experts’ outputs: \bm{F}_{i}^{l}=\sum_{j=1}^{k}g_{i,j}^{l}\cdot\mathcal{E}_{j}^{l}(\bm{u}_{i}^{l}). (4) Some MoEs include shared experts that are always selected ( Dai et al., 2024 ) , which results in: \bm{F}_{i}^{l}=\sum_{j=1}^{k}g_{i,j}^{l}\cdot\mathcal{E}_{j}^{l}(\bm{u}_{i}^{l})+g_{i,s}^{l}\cdot\mathcal{E}_{s}^{l}(\bm{u}_{i}^{l}). (5) Finally, the output at position i of the l -th layer is: \bm{h}_{i}^{l}=\bm{h}_{i}^{l-1}+\bm{A}_{i}^{l}+\bm{F}_{i}^{l}. (6) The final hidden states \bm{h}_{i}^{L} need to go through the unembedding process to map the high-dimensional