Why Do Reasoning Models Lose Coverage? The Role of Data and Forks in the Road
Ngoc-Hieu NguyenThe Pennsylvania State University [email protected] Parshin ShojaeeVirginia TechPhuc Minh NguyenVinUniversityNan ZhangThe Pennsylvania State UniversityChandan K ReddyVirginia Tech, Khoa D DoanVinUniversityRui ZhangThe Pennsylvania State University · 2026
Read Why Do Reasoning Models Lose Coverage? The Role of Data and Forks in the Road by Ngoc-Hieu NguyenThe Pennsylvania State University [email protected] Parshin ShojaeeVirginia TechPhuc Minh NguyenVinUniversityNan ZhangThe Pennsylvania State UniversityChandan K ReddyVirginia Tech, Khoa D DoanVinUniversityRui ZhangThe Pennsylvania State University (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-17026.txt.
Introduction
Nguyen's team investigates why reasoning models lose coverage under fine-tuning: pass-at-one rises, yet pass-at-k falls against the base model. They blame fine-tuning data, specifically decision points, or forks, where the model meets indecipherable patterns with several valid paths. Controlled studies with indecipherable graph-branching nodes and reasoning modes show shrinkage tracks how common decision-point cases are in training data. Targeted synthesis of decision points and diversity-encouraging decoding partly counter the shrinkage, pointing to data-centred design as a lever for control.
Catalog record
| CREATOR | Ngoc-Hieu NguyenThe Pennsylvania State University [email protected] Parshin ShojaeeVirginia TechPhuc Minh NguyenVinUniversityNan ZhangThe Pennsylvania State UniversityChandan K ReddyVirginia Tech, Khoa D DoanVinUniversityRui ZhangThe Pennsylvania State University |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53250 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.17026
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Why Do Reasoning Models Lose Coverage? The Role of Data and Forks in the Road Ngoc-Hieu NguyenThe Pennsylvania State University [email protected] Parshin ShojaeeVirginia TechPhuc Minh NguyenVinUniversityNan ZhangThe Pennsylvania State UniversityChandan K ReddyVirginia Tech, Khoa D DoanVinUniversityRui ZhangThe Pennsylvania State University Abstract Recent progress in large language models has led to the emergence of reasoning models, which have shown strong performance on complex tasks through specialized fine-tuning procedures. While these methods reliably improve pass@1 accuracy, prior works have observed that they show a coverage shrinkage behavior, where pass@k degrades relative to the base model. In this paper, we investigate the reasoning shrinkage arise under SFT-based post-training. We hypothesize that this behavior is driven by properties of the fine-tuning data, specifically related to decision points or ‘‘forks in the road’’ scenarios where model faces indecipherable patterns with multiple valid reasoning paths. To test this hypothesis, we design controlled case studies that simulate such decision-point settings, spanning indecipherable nodes in graph branching, and reasoning modes. By tracking post-training dynamics in these settings, we find that the shrinkage phenomenon is tightly correlated with the prevalence of decision-point scenarios in the training data. We also demonstrate that this shrinkage behavior can be partially mitigated through targeted data synthesis design of decision-points, and a more systematic diversity-encouraging decoding mechanism. Our findings identify data-centric factors as a key driver of shrinkage in reasoning models and highlight diversity-aware designs as an effective lever for controlling it. 1 1 1 Data and code for reproducing our experiments are available at: https://github.com/psunlpgroup/reasoning_forks “For every path you choose, there is another you must abandon” — Joan D. Vinge 1 Introduction Large language models (LLMs) fine-tuned for reasoning have recently achieved remarkable gains on complex reasoning benchmarks. Through post-training procedures such as reasoning-based supervised fine-tuning (SFT) and reinforcement learning with verification feedback (RLVR) ( 11 ; 6 ) , these models reliably have shown improvement on pass@1 accuracy, often substantially outperforming their base counterparts. As a result, reasoning-oriented post-training has become a central paradigm for improving the capabilities of LLMs on challenging tasks. Despite these gains, a growing body of work in literature has identified a concerning and counterintuitive phenomenon known as coverage shrinkage , where improvements in pass@1 are accompanied by a degradation in pass@k, indicating a loss of diversity and coverage in the model’s learned reasoning procedures. Understanding why this happens, and what fundamentally drives this shrinkage, remains an open and important research question. Most prior works have attributed this behavior to the optimization dynamics of RLVR ( 26 ; 23 ; 13 ; 17 ) , arguing that reward-driven training overemphasizes a narrow set of high-reward reasoning paths and leads to an increased chance of mode collapse. However, recent works have shown that coverage shrinkage is not unique to RLVR and also arises under supervised post-training with SFT ( 3 ; 5 ) , which implies that shrinkage may not simply be a consequence of post-training algorithms, but may arise from a more fundamental driver. Figure 1: Reasoning unfolds through forks in the road , choices made without knowing the path to truth. In this paper, we argue that data plays a central and underexplored role in driving the coverage shrinkage behavior. Instead of focusing on post-training algorithms, we shift attention to the structure and properties of the post-training data, and ask a simple but critical question: what aspects of reasoning data encourage the models to collapse onto fewer solution paths? Our key hypothesis is that shrinkage is strongly influenced by decision points or “forks in the road” in the data, situations in which a model encounters multiple valid, indistinguishable reasoning paths and must commit to one. At such points, post-training implicitly pressures the model to commit to a subset of these options available. Over time, this commitment suppresses alternative trajectories, resulting in improved correctness along dominant paths but reduced overall coverage. To test this hypothesis, we design controlled case studies that isolate and expose these decision-point structures to the reasoning (Figure 2 ). Our first setting is a graph-based navigation task, a natural testbed for studying decision points, which is inspired by prior work on indecipherable nodes in next-token prediction ( 1 ) . In this task, a model must traverse a star graph from a start node to a target node while encountering the branching points that provide no information about which branch leads to success. Our second setting focuses on mathematical reasoning problems that admit multiple valid reasoning modes and solution strategies. At certain stages of reasoning, the model must decide how to proceed without knowing which strategy will ultimately succeed; these moments constitute decision points analogous to the graph branching. By tracking post-training dynamics across both of these settings as well as across ablated data variants, we observe that post-training coverage shrinkage is largely driven by how models resolve ambiguity under repeated exposure to such decision points. In particular, ablating or restructuring these points significantly alters model behavior, and the degree of shrinkage is correlated with their prevalence in the post-training data. Motivated by our findings, we introduce two practical strategies to control such shrinkage phenomenon. First, we show that per-problem coverage of alternative decisions can significantly control shrinkage behavior compared to distributing diversity across the problems. This highlights the importance of synthetic data design that accounts for decision-point structure and its coverage within problems. Second, we observe that shrinkage is closely associated with the emergence of high-frequency tokens that often correspond to early, indecipherable choices for the model in the reasoning process. We demonstrate that a simple decoding mechanism that encourages diversity among these dominant initial tokens can partially recover the lost coverage after the post-training without the need for any additional re-training. Our findings also help explain why building a unified model that can effectively operate in both instruct (or non-thinking) and backtracking/thinking reasoning modes remains a challenging open problem ( 21 ) . This study is mainly aimed to deepen our understanding of coverage shrinkage in reasoning models and provides a data-centric perspective on this phenomenon. Our key contributions are as follows: • We present a systematic, data-centric study of coverage shrinkage in reasoning post-trained models, aiming to understand its underlying factors. • We identify forks-in-the-road patterns in fine-tuning data as a key driver of coverage shrinkage, and analyze this effect through targeted case studies such as graph branching and alternative mathematical reasoning strategies. • Through controlled experiments and training-dynamics analysis, we find a strong correlation between the structure of decision points in data and the severity of coverage shrinkage, providing empirical evidence for the role of data on such behavior. • Motivated by our findings, we introduce two simple diversity-aware data synthesis and decoding strategies, and present proof-of-concept results demonstrating their effectiveness in mitigating shrinkage. These results suggest that the lost coverage is not permanently forgotten, but instead suppressed, and can be recovered through effective inference-time intervention. Figure 2: Illustrative examples of forks in the road case studies. (a) Graph navigation with indecipherable nodes; and (b) Mathematical reasoning with multiple valid solution modes. In both settings, decision points force commitment to a path without knowing which will succeed. 2 Preliminaries To formally ground our investigation, we first define the standard metrics