Superposition Yields Robust Neural Scaling

Yizhou Liu, Ziming Liu, Jeff Gore · 2025

Read Superposition Yields Robust Neural Scaling by Yizhou Liu, Ziming Liu, Jeff Gore (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-10465.txt.

Introduction

Yizhou Liu, Ziming Liu, and Jeff Gore wrote this machine learning paper, published in 2025. It argues that a key reason bigger language models reliably get better is superposition: the models pack more features into their inner space than they have dimensions to hold.

Using a toy model, the authors dial superposition up and down with weight decay. When superposition is weak, the famous power-law drop in loss with size appears only if the data's feature frequencies also follow a power law. When superposition is strong, loss falls in step with model dimension for many frequency patterns, thanks to geometric overlap between feature directions. Checks on open models place them in the strong regime, and the known Chinchilla scaling laws fit the picture. The authors say the idea predicts when scaling will help and when it will stall.

Catalog record

CREATORYizhou Liu, Ziming Liu, Jeff Gore
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE77 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-10465

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Superposition Yields Robust Neural Scaling Yizhou Liu, Ziming Liu, Jeff Gore Abstract The success of today’s large language models (LLMs) depends on the observation that larger models perform better. However, the origin of this neural scaling law — the finding that loss decreases as a power law with model size — remains unclear. Starting from two empirical principles — that LLMs represent more things than the model dimensions (widths) they have (i.e., representations are superposed), and that words or concepts in language occur with varying frequencies — we constructed a toy model to study the loss scaling with model size. We found that when superposition is weak, meaning only the most frequent features are represented without interference, the scaling of loss with model size depends on the underlying feature frequency; if feature frequencies follow a power law, so does the loss. In contrast, under strong superposition, where all features are represented but overlap with each other, the loss becomes inversely proportional to the model dimension across a wide range of feature frequency distributions. This robust scaling behavior is explained geometrically: when many more vectors are packed into a lower dimensional space, the interference (squared overlaps) between vectors scales inversely with that dimension. We then analyzed four families of open-sourced LLMs and found that they exhibit strong superposition and quantitatively match the predictions of our toy model. The Chinchilla scaling law turned out to also agree with our results. We conclude that representation superposition is an important mechanism underlying the observed neural scaling laws. We anticipate that these insights will inspire new training strategies and model architectures to achieve better performance with less computation and fewer parameters. 1 Introduction The remarkable success of large language models (LLMs) has been driven by the empirical observation that increasing model size, training data, and compute consistently leads to better performance [ 1 , 2 , 3 , 4 ] . Across a wide range of tasks — including language understanding [ 1 , 5 , 6 ] , math [ 7 , 8 , 9 , 10 ] , and code generation [ 11 , 12 ] — larger models achieve lower loss, higher accuracy, and greater generalization abilities [ 2 , 13 ] . This consistent trend, known as neural scaling laws, has been observed across multiple model families and architectures, fueling the development of increasingly large models [ 2 , 3 , 4 ] . These scaling laws have not only shaped the current strategies for building better models but have also raised fundamental questions about why such simple and universal patterns emerge in complex learning systems. Figure 1: Superposition leads to robust and fast power-law loss decay with model size. (a) Illustration of no superposition where a three-dimensional space can at most represent three features without any interference (overlap). (b) Toy model results in the regime of weak superposition, where we set data dimension n=10240 (number of features). The toy model will be introduced; more details are in Appendix D.1 . (c) Illustration of superposition: there are more features than the dimension of the space. (d) The same toy models in the strong superposition regime show lower losses, which are on power laws with model dimension and have exponents close to 1 (color coding same as panel b). The gray points are from actual LLMs, which seem to have a similar power-law relation with exponent \sim 1 . The scaling of loss with model size plays a central role in both the practical design and the theoretical understanding of large-scale machine learning systems, yet its origin remains inconclusive [ 3 , 14 , 15 , 16 , 17 , 18 , 19 , 20 , 21 , 22 , 23 , 24 ] . Various explanations have been proposed, drawing from statistical learning theory and empirical phenomenological models, including improved function or manifold approximation in larger models [ 14 , 15 ] , and enhanced representation or skill learning in larger models [ 18 , 19 , 20 , 21 ] . In the limit of infinite data, many of these explanations predict a power-law decay of loss with model size, provided the underlying data distribution also follows a power law. However, the predicted scaling exponents depend sensitively on the properties of the data distribution. Moreover, the connection between these mechanistic explanations and the behavior of actual LLMs needs further exploration. When considering LLMs specifically, it becomes clear that representation learning can be a limiting factor, which is closely related to a phenomenon called superposition [ 25 , 26 ] , yet this aspect has not been thoroughly studied. LLMs must learn embedding vectors for tokens, process these representations through transformer layers to predict the next token, and use a final projection (the language model head) to generate the output. Conceptually, fitting functions or manifolds and learning skills or grammars are primarily tasks of the transformer layers, while representation learning is more directly tied to the embedding matrix and the language model head. To represent more than fifty thousand tokens — or even more abstract concepts — within a hidden space of at most a few thousand dimensions, the quality of representations is inevitably constrained, contributing to the final loss. Although models can represent more features than their dimensionality would suggest through a mechanism known as superposition [ 26 ] , prior work on neural scaling laws has implicitly assumed weak superposition [ 15 , 16 , 17 , 18 , 19 ] , which may be less relevant to the regime where LLMs operate. To address this gap, we systematically study here how representation superposition and data structure together influence the scaling of loss with model size. We adopt a toy model construction similar to [ 26 ] to study how superposition affects neural scaling laws. In the toy model, representations are learned by recovering data, each composed of multiple latent features. These features in data have different frequencies of occurrence, reflecting their relative importance. In the absence of superposition, only the most frequent features are perfectly represented, while the others are ignored. As illustrated in Figure 1 a, the first three of six features are represented in the three-dimensional space without interference, and the remaining three are omitted. We find that in the weak superposition regime, the scaling of loss with model dimension depends sensitively on how feature frequency decays with rank: the loss follows a power law with model size only if the feature frequencies themselves follow a power law, provided that m is sufficiently large (Figure 1 b). By contrast, strong superposition allows many more features to be represented, albeit with overlap in the representation (Figure 1 c). In this regime, the model displays a robust behavior: loss scales inversely with model dimension, independent of the data frequency distribution (Figure 1 d). Remarkably, we find that actual LLMs follow the same rule. Comparing models with the same dimension but different superposition degrees, the ones with stronger superposition also have a lower loss. Building on the basic phenomena, we provide the main takeaways : (i) In the strong superposition regime, loss due to imperfect representation scales inversely with model dimension, largely independent of feature frequency distributions; (ii) Scaling

Read the complete text