Benchmark Shadows: Data Alignment, Parameter Footprints, and Generalization in Large Language Models
Hongjian Zou, Yidan Wang, Qi Ding, Yixuan Liao, Xiaoxin Chen · 2026
Read Benchmark Shadows: Data Alignment, Parameter Footprints, and Generalization in Large Language Models by Hongjian Zou, Yidan Wang, Qi Ding, Yixuan Liao, Xiaoxin Chen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-07363.txt.
Introduction
Zou and four colleagues show that data tuned to a benchmark can lift narrow scores while narrowing a model's growth. In controlled tests with fixed training, benchmark-tuned data boosts test metrics but curbs broad skill growth. Data with wider coverage spreads parameter change more evenly and generalizes better. Spectral and rank checks reveal distinct structural marks for the two regimes across many open models, including multimodal ones. A prompt-repetition case adds nuance: not every data quirk shifts regimes.
Catalog record
| CREATOR | Hongjian Zou, Yidan Wang, Qi Ding, Yixuan Liao, Xiaoxin Chen |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 78581 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.07363
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Benchmark Shadows: Data Alignment, Parameter Footprints, and Generalization in Large Language Models Hongjian Zou, Yidan Wang, Qi Ding, Yixuan Liao, Xiaoxin Chen Abstract Large language models often achieve strong benchmark gains without corresponding improvements in broader capability. We hypothesize that this discrepancy arises from differences in training regimes induced by data distribution. To investigate this, we design controlled data interventions that isolate distributional effects under fixed training settings. We find that benchmark-aligned data improves narrow evaluation metrics while limiting broader representational development, whereas coverage-expanding data leads to more distributed parameter adaptation and better generalization. We further introduce parameter-space diagnostics based on spectral and rank analyses, which reveal distinct structural signatures of these regimes. Similar patterns are observed across diverse open-source model families, including multimodal models as a key case study, suggesting that these effects extend beyond controlled settings. A case study on prompt repetition shows that not all data artifacts induce regime shifts. These results indicate that benchmark performance alone is insufficient to characterize model capability, and highlight the importance of data distribution in shaping learning dynamics. † † affiliationnotice: Equal contribution 1 Introduction Recent large language models have achieved rapid progress on a wide range of benchmark evaluations. However, improvements in benchmark scores do not always translate into corresponding gains in broader capability, such as robustness, compositional reasoning, or generalization beyond evaluation distributions. This discrepancy raises a fundamental question: what aspects of training determine how model capability actually develops? A common implicit assumption is that scaling data and optimizing for stronger task supervision will monotonically improve model performance. Yet in practice, models trained on different data mixtures—despite similar architectures and optimization settings—often exhibit qualitatively different behaviors. This suggests that training outcomes cannot be fully explained by scale alone, and that the structure of the training data plays a more central role than is typically acknowledged. In this work, we propose a regime-centric perspective, in which differences in data distribution induce distinct training regimes that govern how models allocate capacity during learning. Rather than treating training as a uniform process, we view it as operating under different regimes characterized by how information is distributed across samples. In particular, we distinguish between coverage-expanding data, which increases semantic diversity, and benchmark-aligned data, which concentrates training signals on narrow evaluation-relevant patterns. To study these effects, we begin with controlled experiments on a text-only decoder model, where architectural and optimization confounds can be tightly controlled, and then test whether the resulting signatures recur in independently trained multimodal systems. This allows us to isolate how data composition influences both performance and internal model structure in a simpler setting, while evaluating the broader relevance of the resulting diagnostics in more realistic model families. We complement these experiments with parameter-space diagnostics, using spectral and rank-based analyses to characterize how different regimes reshape representations across layers. Our results reveal a consistent pattern: benchmark-aligned data can improve narrow evaluation metrics while limiting broader representational development, whereas coverage-expanding data leads to more distributed parameter adaptation and improved generalization. We further show that similar signatures appear across diverse open-source model families, including multimodal models as a key case study, suggesting that these effects extend beyond controlled settings. Finally, through a case study on prompt repetition, we demonstrate that not all data artifacts induce regime shifts, highlighting the importance of semantic structure rather than surface redundancy. Our contributions are summarized as follows: • We introduce a regime-centric framework that links data distribution to learning dynamics in large language models. • We design controlled data interventions that isolate the effects of coverage-reducing and coverage-expanding data under fixed training conditions. • We propose parameter-space diagnostics that reveal distinct structural signatures associated with different training regimes. • We provide empirical evidence across both controlled experiments and external model families, showing that similar patterns arise in practice. • We present a case study on prompt repetition, clarifying the role of superficial redundancy versus semantic concentration. 2 Related Work Understanding how data distribution shapes learning dynamics is relevant to large language models broadly, but the issue becomes especially visible in multimodal systems, where heterogeneous data sources and multi-stage curation can amplify regime effects. Prior work has studied scaling behavior, benchmark sensitivity, and internal parameter dynamics, but these strands have largely been developed in isolation. Our work connects them by treating data regime as the organizing factor linking training distribution, parameter-space structure, and downstream generalization. 2.1 Scaling Behavior of Large Models Scaling laws have been a central principle in the development of Large Language Models (LLMs), where performance improves predictably as a function of model size, data volume, and compute ( 16 ; 7 ) . These findings suggest that, under appropriate data–compute trade-offs, increasing scale leads to consistent gains in capability across a wide range of tasks. However, the mechanisms through which different data regimes influence scaling behavior remain much less understood, especially in settings where training data is heterogeneous or heavily curated. This challenge is particularly visible in Multimodal Large Language Models (MLLMs). Recent multimodal systems, which integrate visual encoders with pretrained language models, often exhibit weaker and less predictable scaling behavior compared to their text-only counterparts. Empirical results across model families indicate that increasing training data or model size does not always yield proportional improvements in multimodal reasoning or understanding performance. In some cases, multimodal pretraining can even degrade text-only capabilities during intermediate stages of training. Several recent works have begun to explore scaling properties in multimodal settings. Early large-scale vision-language pretraining results showed that web-scale noisy image–text data can substantially improve visual and cross-modal representations even under relatively simple training objectives ( 9 ) . More explicit scaling-law studies later demonstrated power-law scaling behavior for contrastive language–image learning under public data and open models ( 4 ) , and extended scaling analysis to generative mixed-modal language models by modeling interaction effects across modalities ( 1 ) . These studies suggest that multimodal performance depends not only on total scale, but also on the composition and interaction of different data sources. Nevertheless, existing analyses primarily focus on external factors such as data size and model architecture, while treating multimodal data as a relatively homogeneous resource. Our work instead asks how differences in data regime shape both scaling outcomes and internal learning dynamics. 2.2 Data Regimes and Benchmark Effects Recent studies suggest that observed performance in large multimodal models is highly sensitive to the structure of the training data regime. In particular, benchmark-aligned curation, task-focused supervision, and contamination can substantially affect evaluation outcomes, making it difficult to distinguish genuine capability improvement from data-induced score inflation ( 17 ; 3 ) . This issue is especially important in multimodal settings, where both textual and visual overlap with evaluation benchmarks may bias reported gains ( 17 ) . Yet prior work has rarely treated data regimes themselves as an explicit object of analysis. At the same time, recent data-centric training work has shown that model quality depends strongly on how multimodal corpora are filtered, composed, and curated, rather than on raw scale alone ( 5 ) . Related work on downstream specialization further indicates that optimizing toward narrow target distributions can improve task-specific performance while weakening broader generalization ( 8 ) . Taken together, these studies highlight a