When Mean CE Fails: Median CE Can Better Track Language Model Quality
Hao Guo, Simon Dennis, Rivaan Patil, Kevin Shabahang, [0.5em] i14 · 2026
Read When Mean CE Fails: Median CE Can Better Track Language Model Quality by Hao Guo, Simon Dennis, Rivaan Patil, Kevin Shabahang, [0.5em] i14 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-24667.txt.
Introduction
Hao Guo and others show that mean cross-entropy can misread language-model quality during training. In Qwen2.5 fine-tuning on synthetic facts, mean loss climbs after early learning while fact recall stays near its peak. In top-K distillation on TinyStories, smaller K improves median loss while worsening mean loss. The top-5 student earns the best judge score despite the worst mean. The bulk saturates early while the tail stretches. The authors urge percentile summaries alongside the mean, watching their agreement as a diagnostic.
Catalog record
| CREATOR | Hao Guo, Simon Dennis, Rivaan Patil, Kevin Shabahang, [0.5em] i14 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55589 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.24667
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
When Mean CE Fails: Median CE Can Better Track Language Model Quality Hao Guo, Simon Dennis, Rivaan Patil, Kevin Shabahang, [0.5em] i14 Abstract Mean cross-entropy is the standard validation metric for language models, but it can fail to track model quality during training. We examine this in two common scenarios. First, in Qwen2.5-1.5B SFT on synthetic fact-learning, we find that mean CE rises substantially after the initial learning phase while held-out fact-recall accuracy remains near its peak. Second, we find that in top- K K distillation on TinyStories, decreasing K K improves median CE while worsening mean CE; the Top-5 student attains the highest LLM-judge score and crosses below its teacher on median CE, despite having the worst mean CE. In both cases, median CE correlates much more closely with task performance than does mean CE. Analyzing how bulk and tail percentile CE move during training reveals that training reshapes the empirical per-token CE distribution. In top- K K distillation, smaller K K yields a distribution with more mass at both extremes, decreasing the median and increasing the mean. In Qwen SFT, the bulk saturates quickly while the tail extends in the latter half of training. In both, the task-evaluation metric appears more sensitive to the bulk than to the tail. Practically, we recommend reporting a small set of percentile CE summaries alongside the mean, and using concordance among them as a tool to keep track of distribution reshaping, as well as a low-cost diagnostic for when mean and median CE disagree on model selection. 1 Introduction Mean cross-entropy ( Bengio et al. 2003 ) (equivalently, perplexity) is the standard validation metric for language models. But it is well documented that mean CE does not fully explain variation in downstream task performance ( Fang et al. 2025 ; Ruan et al. 2024 ) . Indeed, it can fail when the empirical per-token CE distribution reshapes—meaning that the bulk and tail move differently—in ways that mass-averaging hides. This paper is motivated by the following question: when does mean CE fail to predict downstream model quality, and how can we detect this cheaply? Let \ell_{t}=-\log q_{\theta}(x_{t}\mid x_{<t}) denote the per-token loss, where q_{\theta} is the model’s output distribution. When most parts of the empirical per-token CE distribution improve together during training, mean CE and percentile summaries tend to give the same model-selection 1 1 1 By model selection we mean choosing among candidate checkpoints or training objectives to optimize performance on a specific task. signal. But in practice, we see more nuanced behavior — for example, the upper tail grows while typical-token prediction improves. To detect this, we can use percentile CE summaries, which are robust statistics. We use the median as our bulk percentile ; it tracks typical-token loss without being unduly affected by a small number of high-loss tokens. We use p_{95} as our tail percentile . We study how mean and percentile CE summaries interact in two scenarios that arise frequently in practice: supervised fine-tuning and top- K distillation, in which the student is trained to match the teacher’s top- K token probabilities, renormalized to sum to one. We use a notion of concordance to test whether different CE summaries give consistent model-selection signals. This lets us distinguish regimes where mean CE is a reliable proxy for task performance from regimes where the choice of CE summary becomes consequential. Notation. The empirical per-token CE distribution is the collection \{\ell_{t}\}_{t=1}^{T} over evaluated validation tokens indexed by t=1,\dots,T . The mean CE is \bar{\ell}=\tfrac{1}{T}\sum_{t}\ell_{t} . The k -th percentile CE , denoted p_{k} , is the value below which k\% of per-token CE losses fall; for example, p_{50} is the median. We reserve q (with subscripts as needed) for model output distributions. Concordance regimes. Let \mathcal{S} denote a set of CE summaries. Throughout most of the paper, we will take \mathcal{S}=\{\mathrm{mean},\mathrm{median},p_{95}\} . Given a family \mathcal{M} of model checkpoints, the concordance of \mathcal{S} over \mathcal{M} , denoted by \pi(\mathcal{S}) , is the degree to which the summaries in \mathcal{S} agree on how pairs of checkpoints are ranked relative to one another (see Appendix A for the precise definition). 2 2 2 We will sometimes take \mathcal{S}=\{\mathrm{mean},\mathrm{median}\} in order to compare mean and median CE directly. In that case, \pi(\mathcal{S}) is essentially the same as Kendall’s notion of concordance (see Appendix A ). Intuitively, when concordance is high, the summaries in \mathcal{S} tell the same selection story, in which case selecting models on the basis of mean CE alone is less likely to conflict with selecting by bulk or tail percentiles. When concordance is low, model selection is more likely to depend on whether the target evaluation is bulk- or tail-sensitive. In this way, we view concordance as a complement to mean and percentile CE that can help detect when the choice of CE summary becomes consequential. Motivated by the experiments that follow, we identify three regimes: 1. Directionally uniform improvement : high \pi(\mathcal{S}) , where CE summaries in \mathcal{S} give consistent model-selection signals. 2. Deliberate reshaping : low \pi(\mathcal{S}) induced by a training objective, e.g. top- K distillation. 3. Implicit reshaping : low \pi(\mathcal{S}) induced by training dynamics, e.g. during SFT. Our main contributions are as follows: • We find that Qwen2.5-1.5B SFT fact-learning (Section 3 ) falls under regime 3: fine-tuning dynamics implicitly reshape the per-token CE distribution in a way not explained by mean CE alone. Recall accuracy is much more closely aligned with median CE than mean CE. • We find that top- K self-distillation on TinyStories (Section 4 ) falls under regime 2: decreasing K corresponds to greater reshaping of the loss distribution, moving mass toward both extremes (Section 4.3 ) and decreasing median CE while increasing mean CE. Students can cross below their teacher on median CE (Section 4.2 and Appendix D ). • We find that LLM-judge scores on the quality of subsequent generation are much more closely aligned with median CE than mean CE (Section 4.2 ), with the Top-5 student achieving the highest judge score despite having the worst mean CE. By contrast, when top- K distilled students are replaced by controls of various sizes and learning rates, the cohort falls under regime 1 (Section 4.4 ), where mean CE and median CE agree as model selectors. The TinyStories findings above replicate qualitatively on linear attention (Appendix G ). 2 Related Work Perplexity and its limitations. Fang et al. 2025 show that perplexity correlates poorly with long-context benchmark score since it averages uniformly over all tokens. They propose LongPPL, which selectively weights key tokens. We identify a complementary failure: uniform averaging lets a heavy tail of high-loss tokens dominate the mean. Where LongPPL learns a token-importance criterion, we summarize the full loss distribution via percentiles—a simpler, task-agnostic diagnostic. Ruan et al. 2024 show that pretraining-loss scaling is not uniformly predictive of downstream behavior. MAUVE ( Pillutla et al. 2021 ) and LLM-as-judge ( Zheng et al. 2023 ) are alternative quality measures; we show that even within the CE framework, the choice of summary statistic matters. Token typicality and generation. Meister et al. 2023 propose local typical sampling: selecting tokens whose information content lies near the model’s conditional entropy. Our percentile-CE perspective is