Do Language Models Use Their Depth Efficiently?
Róbert Csordás, Christopher D. Manning, Christopher Potts, {manning, cgpotts}@stanford.edu · 2025
Read Do Language Models Use Their Depth Efficiently? by Róbert Csordás, Christopher D. Manning, Christopher Potts, {manning, cgpotts}@stanford.edu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-13898.txt.
Introduction
Róbert Csordás, Christopher Manning, and Christopher Potts ask, in 2025, whether large language models actually use their many layers well. Deeper models score higher, but gains shrink as depth grows. The team probed three model families by comparing each layer's output with the model's main information stream.
Layers in the second half added much less than those in the first half. Skipping those later layers changed results only slightly, and multi-step problems showed no sign of deeper step-by-step work. Maps between small and large models suggested the same work is simply spread thinner. Depth, they conclude, buys fine tuning more than new kinds of thinking.
Catalog record
| CREATOR | Róbert Csordás, Christopher D. Manning, Christopher Potts, {manning, cgpotts}@stanford.edu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 74 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-13898
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Do Language Models Use Their Depth Efficiently? Róbert Csordás, Christopher D. Manning, Christopher Potts, {manning, cgpotts}@stanford.edu Abstract Modern LLMs are increasingly deep, and depth correlates with performance, albeit with diminishing returns. However, do these models use their depth efficiently ? Do they compose more features to create higher-order computations that are impossible in shallow models, or do they merely spread the same kinds of computation out over more layers? To address these questions, we analyze the residual stream of the Llama 3.1, Qwen 3, and OLMo 2 family of models. We find: First, comparing the output of the sublayers to the residual stream reveals that layers in the second half contribute much less than those in the first half, with a clear phase transition between the two halves. Second, skipping layers in the second half has a much smaller effect on future computations and output predictions. Third, for multihop tasks, we are unable to find evidence that models are using increased depth to compose subresults in examples involving many hops. Fourth, we seek to directly address whether deeper models are using their additional layers to perform new kinds of computation. To do this, we train linear maps from the residual stream of a shallow model to a deeper one. We find that layers with the same relative depth map best to each other, suggesting that the larger model simply spreads the same computations out over its many layers. All this evidence suggests that deeper models are not using their depth to learn new kinds of computation, but only using the greater depth to perform more fine-grained adjustments to the residual. This may help explain why increasing scale leads to diminishing returns for stacked Transformer architectures. 1 Introduction Large Language Models (LLMs [ 1 , 2 , 3 , 4 , 5 ] ) have improved rapidly in recent years, and one significant correlate of these improvements is their increasing depth as measured by number of Transformer layers (Fig. 1 ). This scaling relationship would seem to follow from the structure of these LLMs: they predominantly use a stacked Transformer structure [ 6 ] , which lacks recurrence across layers, and thus the number of computation steps they can perform is constrained by their depth. In theory, greater depth should enable them to perform more complex computations by building on top of the representations computed in previous layers. Deeper models should have the capacity to be more compositional, leading to better reasoning, math capabilities, and generalization. However, it is unclear whether these models are using their depth efficiently. On the one hand, Petty et al. [7] find that increasing depth does not help with compositional generalization, Lad et al. [8] show that, apart from the first and last layers, models are robust to layer skipping and swapping neighboring layers (see also Sun et al. [9] ), and Gromov et al. [10] were able to remove half of the layers from the network without significantly affecting performance on MMLU (but not for math). On the other hand, interpretability research often finds evidence for complex mechanisms spanning multiple layers [ 11 , 12 ] , suggesting that models can represent more complex operations as their depth increases. This paper is an exploration of this tension. Our primary question: do deeper LLMs use their depth to compose more features to create higher-order computations that are impossible in shallow models, or do they merely spread the same kinds of computation out over more layers? Figure 1: Performance of 132 Open LLM Leaderboard [ 13 ] base models as a function of depth. Colors represent different model families; dot size is proportional to parameter count. Linear regression in red, with 95% confidence interval. Depth is a significant predictor even in regressions that control for other scale-relevant factors (App. B ). Deeper models generally perform better. We focus on the Llama 3 series of models and supplement these findings with secondary analyses of the Qwen 3 series. Following the findings of previous work, we mostly focus on the math domain, which shows the greatest sensitivity to perturbations. Our analysis consists of five parts: 1. We analyze the norm of the residual stream and compare it to each individual sublayer’s output, as a measure of that layer’s contribution. We find a drop in this quantity in the second half of the model. 2. We measure the effect that skipping a layer has on all successive layers’ computations. These analyses show that, for the current output token, nearly all layers seem to be important, but the computations in the second half of the layers depend minimally on each other. In contrast, for future token predictions, skipping the second half of the layers has a minimal effect. This suggests that these layers are mainly refining the final probability distribution rather than computing reusable sub-results. We verify this using Logitlens [ 14 ] , which shows a drop in KL-divergence and a sharp increase in the top prediction overlap with the final layer, starting around the same layer as the importance for future predictions decreases. 3. We analyze multihop questions and difficult math questions, and look for evidence of deeper computations for more complex examples. However, our analysis shows the contrary: the layer’s sensitivity to previous layers seems to be independent of example complexity. Analyzing individual examples with both causal interventions and integrated gradients [ 15 ] shows that the input tokens remain important until the middle of the network, and later tokens in the multi-step computation are not delayed to later layers, suggesting that no composition is happening. 4. We train linear maps from each layer of a shallower model to each layer of an independently trained deeper one, sharing the same vocabulary. By measuring the prediction error of the linear maps, we can measure the correspondence of the layers of the two models. This shows a diagonal pattern, indicating that the deeper model merely spreads out the computation through more layers instead of doing more computation in the later layers. Overall, these findings suggest that current LLMs underutilize the second half of their layers. Rather than using their depth to learn more complex computations, they instead simply spread out the same kind of computation through an increasing number of layers, taking smaller computation steps and devoting the second half of the network to iteratively refining the probability distribution of the current token. We conclude with an exploration suggesting that MoEUT [ 16 ] might use its layers more efficiently. 2 Background All the models we analyze are pre-layernorm Transformers [ 6 , 17 ] . A Transformer layer l is constructed as follows: \displaystyle{\bm{a}}_{l} \displaystyle=\text{SelfAttention}_{l}(\text{Norm}({\bm{h}}_{l})) (1) \displaystyle\hat{\bm{h}}_{l} \displaystyle={\bm{h}}_{l}+{\bm{a}}_{l} (2) \displaystyle{\bm{m}}_{l} \displaystyle=\text{MLP}_{l}(\text{Norm}(\hat{\bm{h}}_{l})) (3) \displaystyle{\bm{h}}_{l+1} \displaystyle=\hat{\bm{h}}_{l}+{\bm{m}}_{l} (4) Here, {\bm{h}}_{l}\in\mathbb{R}^{T\times d_{\text{model}}} is the residual stream and {\bm{a}}_{l},{\bm{m}}_{l}\in\mathbb{R}^{T\times d_{\text{model}}} are the outputs of the SelfAttention and MLP layers, respectively, where T is the length of the current input sequence and d_{\text{model}} is the width of the residual stream. Norm( \cdot ) is some token-wise normalization, traditionally layer normalization [ 18 ] , but usually replaced with RMSNorm [ 19 ] . We call \text{SelfAttention}_{l}(\cdot) and \text{MLP}_{l}(\cdot) sublayers . The residual stream is initialized with {\bm{h}}_{0}=\text{Embedding}({\bm{x}}) , where {\bm{x}}\in\mathbb{N}^{T} is the sequence of input