Evaluating Expert Contributions in a MoE LLM for Quiz-Based Tasks

Andrei Chernov · 2025

Read Evaluating Expert Contributions in a MoE LLM for Quiz-Based Tasks by Andrei Chernov (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-17187.txt.

Introduction

Andrei Chernov inspects how the expert sub-networks inside a mixture-of-experts language model actually behave on quiz questions, in a 2025 study. Such models route each input to a few chosen experts, yet most research covers training rather than what the routing does afterward. The test bed is the MMLU benchmark of multiple-choice questions.

Most experts were never switched on at all during the quiz runs. The routing networks spread their choices far more evenly than the sparse design suggests, closer to uniform than selective. Within a single layer, some experts also performed much better than their neighbors on average. The author presents these checks as a first step toward routine post-hoc audits of expert models.

Catalog record

CREATORAndrei Chernov
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE15 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-17187

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Evaluating Expert Contributions in a MoE LLM for Quiz-Based Tasks Andrei Chernov Abstract Recently, Large Language Models (LLMs) with Mixture of Experts (MoE) layers have gained significant attention. Currently, state-of-the-art LLMs utilize this architecture. There is a substantial amount of research on how to train such models and how to select hyperparameters for this architecture. However, there is a lack of studies focusing on post-evaluation analysis of MoE layer properties. In this paper, we take a first step toward closing this gap by evaluating expert contributions on the quiz-based MMLU benchmark. We show that most experts were never activated during inference on this benchmark. Additionally, the output distribution of gating networks is much closer to uniform than sparse. Finally, we demonstrate that the average performance of some experts within the same layer varies significantly. 1 Introduction Recently, Large Language Models (LLMs) with Mixture of Experts (MoE) layers, instead of fully dense layers, have gained popularity ( Du et al., 2022 ; Wan et al., 2023 ) . Currently, one of the best-performing models utilizes this architecture ( Liu et al., 2024 ) . The main reason MoE models are preferred over dense models is that they tend to achieve similar performance while activating significantly fewer parameters, thereby reducing training time compared to dense LLMs ( Muennighoff et al., 2024 ) . Most research on MoE in the natural language processing (NLP) domain has focused on either modifying the architecture to speed up inference—such as the Top-K gating mechanism ( Shazeer et al., 2017 ) , which selects only the top-K experts with the highest probabilities—or adjusting the training loss to prevent the gating networks from always activating only a small subset of experts ( Shazeer et al., 2017 ; Shen et al., 2024 ) . In this paper, we focus on post-evaluation analysis of expert contributions to final predictions. Specifically, we evaluate the pretrained OLMoE model 1 1 1 https://huggingface.co/allenai/OLMoE-1B-7B-0125-Instruct ( Muennighoff et al., 2024 ) on the quiz-based MMLU benchmark ( Hendrycks et al., 2020 ) to address the following questions: • How many experts were activated at least once during inference on this benchmark? • What does the distribution of gating network outputs look like? Does it tend to be sharp or closer to uniform? • Do all experts perform equally in terms of accuracy? 2 Experimental Setup In this paper, we investigate the contribution of each expert in the OLMoE model during inference on the MMLU benchmark. MMLU is a quiz-based benchmark that evaluates the knowledge and reasoning abilities of large language models (LLMs). It consists of 57 datasets covering various domains, such as humanities, STEM, social sciences, and other fields. We did not observe a significant difference in expert contributions across different domains. Therefore, in the results section (Section 3 ), we present results aggregated over all datasets, comprising a total of 14,042 questions. For each question, the benchmark requires a model to select the correct answer from four possible choices: A, B, C, and D. Thus, the model needs to generate only one token corresponding to an answer. To assess the contribution of experts, we store the probabilities (alphas) from the gating network for each MoE layer when the model predicts the token corresponding to the correct answer. The OLMoE model consists of 16 MoE layers, each containing 64 experts. For every question, we store an array of alphas with the following dimensions: 16\times 64 . Note that only the top 8 experts with the highest probabilities contribute to the final output. To run the experiment, we utilized a V100 GPU with 16 GB of memory. We used a batch size of 2 , and the evaluation of the MMLU dataset took approximately 5 hours. 3 Results 3.1 Distribution of Activated Experts In this section, we analyze how many experts were activated 2 2 2 To be activated, the corresponding probability for this expert from the gating function must be among the top 8 . during inference, as well as the normalized distribution of activated experts for each datapoint. Tables 1 and 2 report the number of experts that were activated for at least one datapoint. Considering that the total number of experts is 64 , we observe that more than 60\% of the experts were never activated for the entire MMLU dataset. Additionally, we report the mean and standard deviation of natural entropy ( Conrad, 2004 ) , defined as: E=-\sum_{i\in\text{top }8}p_{i}\log p_{i} (1) where p_{i} represents the normalized distribution over the highest gating probabilities, i.e., p_{i}=\dfrac{\alpha_{i}}{\sum_{i\in\text{top }8}\alpha_{i}}, (2) where \alpha_{i} is the output from the gating network. We use natural entropy as a measure of uncertainty. It converges to zero when one expert has a probability close to 1 , meaning that only this expert contributes to the result. Conversely, when the distribution is uniform, entropy reaches its maximum value. Specifically, for a discrete distribution with 8 outcomes, the highest entropy value is 2.0794 . Based on the reported entropy in the tables, we conclude that the distribution for each expert is far from sparse and instead tends to be closer to uniform. We believe this behavior is likely caused by auxiliary losses during the training procedure, which force the model to activate each expert approximately the same number of times. This prevents the model from converging to a small subset of preferred experts, thereby ensuring that all experts remain utilized. However, as our results suggest, this may lead to a gating probability distribution that is close to uniform, which might not be desirable. These results also hold for the distribution across all 64 experts (see Appendix A ). A hypothesis that we believe is worth validating in future work is whether this uniform-like behavior negatively impacts the model’s robustness. The primary concern is that the Top-K activation approach is not smooth. If the gating outputs follow a nearly uniform distribution, small changes in input may lead to significant differences in output due to a different set of experts being activated. Even if only the last expert in the top K differs, this could still cause noticeable variations. As shown in the Table 3 , the weight of the eighth expert is significant, averaging 8.74\% . This observation motivated us to investigate the average accuracy of each expert (see Section 3.2 ). Additionally, an unexpected result for us is that entropy tends to increase from the first to the last layer. The first layer has the lowest entropy, while the last layer has one of the highest entropy. Intuitively, we expected the opposite: the last layer should be more confident in its predictions. One possible explanation is that some benchmark questions are too complex for the model, leading to less confident predictions. However, the standard deviation of entropy is low, indicating that the distribution remains stable across all questions, regardless of their complexity. Layer 1 2 3 4 5 6 7 8 Mean Entropy (top 8) 1.8516 1.9375 1.9297 1.9531 1.8516 1.9219 2.0156 1.8984 Std Entropy (top 8) 0.0084 0.0096 0.0080 0.0104 0.0220 0.0165 0.0120 0.0288 Number of Activated Experts 20 14 14 10 16 14 19 15 Table 1: Statistical data per layer (Layers 1 to 8). Entropy calculated across the top

Read the complete text