SciPaths : Forecasting Pathways to Scientific Discovery
Eric Chamoun, Yizhou Chi, Yulong Chen, Rui Cao, Zifeng Ding, Michalis Korakakis, Andreas Vlachos · 2026
Read SciPaths : Forecasting Pathways to Scientific Discovery by Eric Chamoun, Yizhou Chi, Yulong Chen, Rui Cao, Zifeng Ding, Michalis Korakakis, Andreas Vlachos (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-14600.txt.
Introduction
Chamoun, Chi, Chen, Cao, Ding, Korakakis and Vlachos introduce discovery pathway forecasting: given a target contribution and prior literature, identify the enabling contributions it required and ground each in earlier work. Their SciPaths benchmark holds 262 expert-annotated gold pathways, plus 2,444 silver ones from machine learning and language processing papers. The best tested model is claimed to reach only 0.189 F1 under strict matching, with method dependencies hardest to recover.
Catalog record
| CREATOR | Eric Chamoun, Yizhou Chi, Yulong Chen, Rui Cao, Zifeng Ding, Michalis Korakakis, Andreas Vlachos |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 71755 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.14600
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SciPaths : Forecasting Pathways to Scientific Discovery Eric Chamoun, Yizhou Chi, Yulong Chen, Rui Cao, Zifeng Ding, Michalis Korakakis, Andreas Vlachos Abstract Scientific progress depends on sequences of enabling contributions, yet existing AI4Science benchmarks largely focus on citation prediction, literature retrieval, or idea generation rather than the dependencies that make progress possible. In this paper, we introduce discovery pathway forecasting : given a target scientific contribution and the prior literature available at a specified time, the task is to (1) identify the enabling contributions required to realize it and (2) ground each in prior work when such prior work exists. We present SciPaths , a benchmark of 262 expert-annotated gold pathways and 2,444 silver pathways constructed from machine learning and natural language processing papers, where each pathway records enabling contributions, roles, rationales, and prior-work groundings or unmapped decisions. Evaluating frontier and open-weight language models, we find that the best model reaches only 0.189 F1 under strict semantic matching, with core methodological dependencies hardest to recover. Prior-work grounding improves substantially when gold enabling contributions are provided, showing that decomposition quality is a major bottleneck for end-to-end pathway recovery. SciPaths therefore shifts evaluation toward a missing capability in scientific forecasting: reasoning backward from a target contribution to the enabling scientific building blocks and prior-work dependencies that make it feasible. † † affiliationnotice: Equal contribution 1 Introduction Scientific discoveries rarely arise in isolation: they build on enabling contributions and, in turn, enable subsequent work ( 4 ; 12 ; 14 ) . This raises a central question for scientific forecasting: given a target contribution, which enabling contributions are required to realize it? Two lines of work explore this question indirectly. Metascience studies of method recombination, concept prerequisites, and knowledge precedence describe how knowledge evolves ( 3 ; 16 ; 15 ) , but typically operate retrospectively over papers, concepts, or aggregate patterns. AI4Science systems support literature analysis, hypothesis generation, and idea evaluation ( 8 ; 2 ; 13 ) , but usually treat ideas as standalone outputs rather than reasoning over the dependencies that make them feasible. Figure 1 : Example SciPaths instance and task structure. In the main Task A setting, the model receives a target contribution claim and predicts the enabling contributions required to realize it, along with rationale fragments. Selection provenance explains why the target contribution was included but is not provided as model input. Task B grounds each enabling contribution in prior work or marks it as unmapped. Rationale fragments are abbreviated for readability. Closest to our work are citation-based formulations of scientific forecasting and citation recommendation. For example, PreScience ( 1 ) predicts the key references that a target paper’s authors are likely to build upon when creating a new contribution. However, citation-based supervision relies on influence proxies and operates at the level of whole papers, which can conflate heterogeneous contributions. Using the example from Figure 1 , Visual Instruction Tuning ( 7 ) releases both an instruction-tuning dataset and a general-purpose multimodal assistant; prior work essential for one contribution may be irrelevant to the other. A flat paper-level reference set cannot express which reference supports which target contribution or what enabling role it plays. Exact citation matching can also penalize models that identify the right enabling contribution but cite a different valid paper that could play the same role. Complementary to citation-based forecasting, GIANTS ( 5 ) generates downstream insights from known parent papers, assuming the relevant prior work is already given. We target the missing dependency-identification step at finer granularity through three design decisions: (1) representing targets at the contribution level rather than the paper level, (2) separating enabling contributions from their prior-work grounding, and (3) evaluating models based on contribution-level correctness rather than exact citation matching. We introduce SciPaths , a benchmark for discovery pathway forecasting . Given a target contribution, the task is to (a) identify the enabling contributions required to realize it and (b) ground each one in representative prior work when such prior work exists, or mark it as unmapped (Figure 1 ). This separates what is needed from which prior work realizes it . We construct SciPaths from machine learning and natural language processing papers by selecting target contributions with evidence of downstream reuse; for example, the instruction-tuning dataset in Figure 1 was later used for vision-language alignment and fine-tuning. This criterion focuses the benchmark on contributions that became actionable building blocks for subsequent research, rather than on all claims made in a paper. Expert annotators validate each target contribution and decompose it into a pathway under a necessity criterion: removing an enabling contribution would prevent the target contribution from being realized in its claimed form. Each pathway includes enabling contributions, prior-work groundings or unmapped decisions, functional roles, and evidence-backed rationales. SciPaths contains 262 expert-annotated gold pathways for benchmark evaluation and 2,444 silver pathways produced in a hindsight setting for training and large-scale analysis. Evaluating frontier and open-weight language models, we find that current systems recover only a limited fraction of expert pathways: the best model achieves 0.189 F1 under strict semantic matching, with core methodological dependencies especially difficult to identify. Grounding improves substantially when gold enabling contributions are provided, indicating that knowing what scientific building blocks to search for is crucial for identifying the relevant prior work. These results show that scientific dependency reasoning is distinct from retrieving related papers or generating plausible ideas, and directly relevant to AI4Science agents: beyond proposing research directions, such systems must identify the prerequisites and prior contributions needed to make those directions feasible. Beyond evaluation, SciPaths provides a training and analysis resource for modeling research trajectories as structured dependency pathways. Its annotations support studies of pathway structure, enabling roles, rationales, prior-work grounding and downstream usage. We release the silver data for training and analysis, the development set for evaluation, and the silver-construction pipeline for scaling pathway annotations to new papers, while reserving held-out test labels for benchmark evaluation. 2 Forecasting Pathways to Scientific Discovery Figure 2 : Constructing SciPaths from downstream usage evidence. Downstream citation contexts are clustered by the contribution being reused, allowing a single paper to yield multiple target contributions. For each target contribution, expert annotators construct a separate discovery pathway containing enabling contributions, prior-work groundings or unmapped decisions, functional roles, and evidence-backed rationales. The bottom row shows one annotated pathway field example for the instruction-tuning dataset target. We formalize discovery pathway forecasting as the task of identifying the enabling contributions required to make a target contribution feasible and grounding those in prior work when possible. A target contribution d is a method, dataset, benchmark, tool, resource, or finding that subsequent work demonstrably builds upon. Let t_{d} denote its publication time, and let \mathcal{C}_{<t_{d}} denote the papers published before t_{d} . Each target contribution d is associated with a set of enabling contributions \mathcal{I}^{*}(d)=\{i_{1},\ldots,i_{k}\}, where each i_{j} is a functional component required to realize d . We treat i_{j} as necessary if removing it would prevent d from being realized in its claimed form. Each enabling contribution may be grounded in zero, one, or more representative prior papers. We define a grounding function \phi:\mathcal{I}^{*}(d)\rightarrow 2^{\mathcal{C}_{<t_{d}}}, where 2^{\mathcal{C}_{<t_{d}}} denotes the power set of the pre-target corpus, so \phi(i_{j})\subseteq\mathcal{C}_{<t_{d}} is the set of prior