What Do Language Models Learn and When? The Implicit Curriculum Hypothesis
Emmy Liu, Kaiser Sun, Millicent Li, Isabelle Lee, Lindia Tjuatja, Jen-tse Huang, Graham Neubig · 2026
Read What Do Language Models Learn and When? The Implicit Curriculum Hypothesis by Emmy Liu, Kaiser Sun, Millicent Li, Isabelle Lee, Lindia Tjuatja, Jen-tse Huang, Graham Neubig (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-08510.txt.
Introduction
Liu and six colleagues argue that language model training follows a hidden lesson plan, with skills emerging in a stable order built from parts. Tracking simple tasks across four model families from 410 million to 13 billion parameters, they find emergence orders strikingly consistent and composite skills usually arriving after their parts. Task similarity inside models also predicts later training paths, suggesting training is more ordered than loss curves show.
Catalog record
| CREATOR | Emmy Liu, Kaiser Sun, Millicent Li, Isabelle Lee, Lindia Tjuatja, Jen-tse Huang, Graham Neubig |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54522 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.08510
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
What Do Language Models Learn and When? The Implicit Curriculum Hypothesis Emmy Liu, Kaiser Sun, Millicent Li, Isabelle Lee, Lindia Tjuatja, Jen-tse Huang, Graham Neubig Abstract Large language models (LLMs) can perform remarkably complex tasks, yet the fine-grained details of how these capabilities emerge during pretraining remain poorly understood. Scaling laws on validation loss tell us how much a model improves with additional compute, but not what skills it acquires in which order. To remedy this, we propose the Implicit Curriculum Hypothesis : pretraining follows a compositional and predictable curriculum across models and data mixtures. We test this by designing a suite of simple, composable tasks spanning retrieval, morphological transformations, coreference, logical reasoning, and mathematics. Using these tasks, we track emergence points across four model families spanning sizes from 410M–13B parameters. We find that emergence orderings of when models reach fixed accuracy thresholds are strikingly consistent ( ρ = .81 \rho=.81 across 45 model pairs), and that composite tasks most often emerge after their component tasks. Furthermore, we find that this structure is encoded in model representations: tasks with similar function vector representations also tend to follow similar trajectories in training. By using the space of representations derived from our task set, we can effectively predict the training trajectories of simple held-out compositional tasks throughout the course of pretraining ( R 2 = .68 R^{2}=.68 – .84 .84 across models) without previously evaluating them. Together, these results suggest that pretraining is more structured than loss curves reveal: skills emerge in a compositional order that is consistent across models and readable from their internals. 1 1 1 Data and code available at https://github.com/KaiserWhoLearns/ElementalTask 1 Introduction Large language models (LLMs) exhibit predictable improvements in performance with scale, a phenomenon characterized by well-established scaling laws ( 15 ; 11 ; 30 ) . These scaling laws tell us how much models are expected to improve in predicting the next token on the pretraining distribution given additional compute, but not what skills the model acquires, or when during pretraining it acquires them specifically. In practice, training runs may cost millions of dollars, yet are primarily monitored through aggregate cross-entropy loss, or through evaluating at intervals on downstream benchmarks such as MMLU ( 14 ) . However, neither approach provides actionable diagnostic information. Cross-entropy loss decreases smoothly even as qualitatively different skills are acquired at sudden transition points ( 17 ) . Downstream benchmarks compose many prerequisite skills, making failures opaque: when GSM8k ( 7 ) performance stalls, it is unclear whether the bottleneck is numerical fluency, multi-step planning, or natural language understanding. For instance, scoring well on GSM8k may require numerical fluency, multi-step planning, as well as natural language understanding, making it difficult to diagnose which prerequisite skills are missing when performance stalls ( 26 ) . A growing body of theoretical work suggests that neural networks learn functions sequentially, acquiring simpler patterns before more complex ones ( 20 ; 49 ) . Recent work has built on these insights, hypothesizing that complex behaviors and scaling laws themselves emerge from the combination of more elementary sub-tasks that serve as fundamental building blocks ( 19 ) or quanta ( 28 ) . However, much of this theoretical work has focused on simplified modeling settings, leaving open questions about how these insights translate to large-scale language model pretraining ( 40 ) . Prior empirical work has shown that certain knowledge categories (e.g., syntactic vs. factual) are acquired at different rates ( 22 ) , and that grammatical phenomena are learned in a consistent order across architectures ( 10 ) . However, these studies have not examined whether the ordering reflects compositional dependencies between skills, nor whether it is legible in the model’s internal representations. Based on this, we propose the Implicit Curriculum Hypothesis : during pretraining, skills emerge in a stable compositional order that is consistent across models . This is a stronger claim than the quanta hypothesis alone. It predicts not only that simple precedes complex, but also that the specific ordering is reproducible across models and reflects compositional dependencies between skills. To test the Implicit Curriculum Hypothesis, we design a suite of simple tasks that probe a wide range of skills. We track emergence across 9 models from 4 families (410M-13B parameters) and find: 1. The emergence ordering is consistent across model families. Spearman correlations between emergence orderings range from \rho=.64 to .93 (mean .81 ) across all 45 model pairs, including cross-family comparisons. Copying is the first skill to emerge, followed by many simple string operations, fact extraction and coreference, then logic operations, simple world knowledge, then multistep arithmetic and more complex reasoning tasks. Composite tasks emerge after their elemental prerequisites. However, this consistency holds only when emergence is defined by fixed accuracy thresholds, not relative ones. 2. The ordering is legible in model representations. Tasks whose internal representations are nearby in the model’s residual stream, measured via function vectors ( 43 ) , follow similar learning trajectories. This proximity is sufficient to predict the full training trajectory of held-out composite tasks (mean R^{2} of .68 – .84 across models, with per-task R^{2} exceeding .95 ) without ever evaluating them during training. Together, these results suggest that pretraining is more structured than loss curves reveal: skills emerge in an order that is consistent across models, respects compositional dependencies, and is readable from model internals. Figure 1: Emergence order across model families and sizes, smoothed with a Gaussian kernel ( \sigma=1.0 ). Dots represent the point at which the model reaches a fixed 50% accuracy threshold. While the absolute emergence time varies across models, the ordering shows regularity. 2 Preliminaries 2.1 Background We provide a summary of the work that we directly build on in this paper. Further related work can be found in Appendix B . Scaling Laws Scaling laws characterize the relationship between a model’s held-out validation loss L and the compute budget allocated to training, typically decomposed into model size N and data size D . These relationships are well-approximated by power laws of the form L(N,D)\propto N^{\alpha}+D^{-\beta}+L_{\infty} ( 18 ; 15 ) , and hold across many orders of magnitude. However, this aggregate loss curve does not directly correlate with downstream performance ( 24 ; 16 ; 21 ) , and it is not clear what the model is learning as loss decreases. Quantization Hypothesis 28 offers a hypothesis that these smooth scaling curves arise from the learning of discrete skills, termed quanta . Under this framework, a model acquires these quanta in an order optimized to reduce total loss, hiding the discrete transitions that correspond to the model learning. One practical quandary is that quanta require a post-hoc discovery method, the results of which often do not correspond to interpretable skills ( 28 ) . While compelling, the Quantization Hypothesis typically treats these skills as independent, additive contributions, leaving the structural dependencies and compositional nature of these skills largely unexplored. Simplicity Bias Secondly, works show that neural networks trained with gradient-descent-based methods tend to exhibit simplicity bias , a tendency to learn simpler functions before more complex ones ( 37 ; 31 ; 38 ) . In the context of language modeling, this is reflected in models learning lower-order