CrossTrace: A Cross-Domain Dataset of Grounded Scientific Reasoning Traces for Hypothesis Generation

Andrew Bouras · 2026

Read CrossTrace: A Cross-Domain Dataset of Grounded Scientific Reasoning Traces for Hypothesis Generation by Andrew Bouras (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-28924.txt.

Introduction

Bouras introduces CrossTrace, a dataset of grounded reasoning traces for scientific hypothesis generation. Past datasets cover single domains and lack explicit reasoning steps. CrossTrace holds 1,389 traces across biomedical research, AI and ML, and cross-domain work. Each trace links prior knowledge through logical steps to a new hypothesis, grounded in source text. A schema adds step level verification and eight discovery patterns. Fine-tuning a Qwen model on the data raised judged scores and structural compliance sharply. Human checks of 150 records found 99.7 percent step level grounding accuracy and no fabrication.

Catalog record

CREATORAndrew Bouras
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42631
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.28924

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CrossTrace: A Cross-Domain Dataset of Grounded Scientific Reasoning Traces for Hypothesis Generation Andrew Bouras Abstract Scientific hypothesis generation is a critical bottleneck in accelerating research, yet existing datasets for training and evaluating hypothesis-generating models are limited to single domains and lack explicit reasoning traces connecting prior knowledge to novel contributions. I introduce CrossTrace, a dataset of 1,389 grounded scientific reasoning traces spanning biomedical research (518), AI/ML (605), and cross-domain work (266). Each trace captures the structured reasoning chain from established knowledge through intermediate logical steps to a novel hypothesis, with every step grounded in source paper text. I define an Input/Trace/Output schema that extends the Bit-Flip-Spark framework of HypoGen ( Li et al. 2025 ) with step-level verification, a taxonomy of eight discovery patterns, and multi-domain coverage. Fine-tuning Qwen2.5-7B-Instruct on CrossTrace via QLoRA yields substantial improvements over the untuned baseline: IAScore rises from 0.828 to 0.968 (GPT-4o judge) and from 0.716 to 0.888 (Claude Opus 4.5 judge), structural compliance improves from 0% to 100%, and spark cosine similarity increases from 0.221 to 0.620. Balanced cross-domain training (biomedical + AI/ML + CS) outperforms single-domain training, providing evidence that scientific reasoning patterns transfer across disciplines. Human validation of 150 stratified records finds 99.7% step-level grounding accuracy with no fabricated steps identified, and a blinded evaluation by three independent domain experts rates model-generated hypotheses well above the scale midpoint (usefulness 4.18/5, soundness 3.76/5, overall 3.84/5) with excellent inter-rater agreement on scientific soundness (ICC = 0.929). To my knowledge, CrossTrace is the first dataset to combine multi-domain coverage, step-level reasoning traces, and source-text grounding for hypothesis generation, and my results demonstrate that structured, grounded traces encode transferable reasoning primitives: a matched-size ablation shows that a model trained on equal parts biomedical and CS data achieves near-parity with domain specialists, indicating that the benefits of trace-based supervision are domain-general rather than domain-specific. 1 Introduction The pace of scientific publishing has made it increasingly difficult for researchers to identify novel research directions by reading the literature alone. Over 2 million biomedical articles are indexed annually in PubMed, and the rate of AI/ML preprints on arXiv has grown exponentially. This volume creates both an opportunity (vast latent connections between fields) and a bottleneck: no individual researcher, reading perhaps 200–300 papers per year, can synthesize even a fraction of this literature broadly enough to identify cross-domain insights consistently. Recent work has demonstrated that large language models (LLMs) can generate scientific hypotheses when given appropriate context ( Yang et al. 2025a ; Li et al. 2025 ; Baek et al. 2024 ) . However, the quality of hypothesis generation depends critically on training data. Models trained on structured reasoning traces (explicit step-by-step chains connecting prior knowledge to novel contributions) significantly outperform those trained on input-output pairs alone ( Li et al. 2025 ) . NVIDIA’s work on post-training data further shows that deeper, more detailed reasoning traces outperform diverse but shallow ones ( NVIDIA 2025 ) . These findings point to a clear data bottleneck: the field needs high-quality reasoning trace datasets, but existing resources are limited. Current datasets for hypothesis generation suffer from three key limitations. First, domain restriction : HypoGen ( Li et al. 2025 ) , the largest open dataset with reasoning traces, contains 5,500 records drawn exclusively from NeurIPS and ICLR computer science papers. No comparable resource exists for biomedical research, despite biomedicine being the field with the greatest need for automated hypothesis generation. Second, missing reasoning chains : datasets like IdeaBench ( Pu et al. 2025 ) and ResearchBench ( Liu et al. 2025 ) provide paper-level metadata but do not capture the step-by-step reasoning process that connects prior knowledge to a new hypothesis. Third, lack of grounding : even where reasoning chains exist, individual steps are rarely linked back to source text, making it impossible to verify whether the chain reflects the paper’s actual argument or is a plausible fabrication. I address these gaps with CrossTrace , a dataset of 1,389 grounded scientific reasoning traces spanning three domains: biomedical research (518 traces from medRxiv and bioRxiv papers), AI/ML (605 traces from arXiv papers), and cross-domain work (266 traces from papers applying computational methods to biological or clinical problems). Each trace is structured as an Input/Trace/Output record where the Input describes the prior state of knowledge, the Trace is an ordered sequence of 3–6 verifiable reasoning steps, and the Output contains a core insight (spark), hypothesis, and experimental approach. Every reasoning step is grounded in a direct quotation from the source paper’s Introduction or Discussion section. My central finding is that grounded reasoning structure, not domain-specific knowledge, is the limiting factor in hypothesis generation training data: a model trained on equal parts biomedical and CS traces matches domain specialists, suggesting that the form of scientific reasoning is substantially domain-general. My contributions are: 1. A cross-domain reasoning trace dataset. CrossTrace provides 1,389 grounded scientific reasoning traces spanning biomedical and AI/ML domains, the first such resource to combine step-level grounding with multi-domain coverage. Records are annotated with domain labels, discovery patterns, explicitness scores, and extraction confidence. 2. A grounded schema with step-level verification. I extend the Bit-Flip-Spark schema ( Li et al. 2025 ) with a reasoning trace field containing 3–6 ordered steps, each linked to a source quotation from the paper, enabling automated and human verification of trace fidelity. 3. Evidence that grounded traces encode transferable reasoning primitives. A controlled ablation on matched-size training sets (1,180 records each) shows that a model trained on equal parts biomedical and CS data achieves 99.3%/99.7% of domain-specialist performance, demonstrating that scientific reasoning patterns generalize across disciplines independently of data volume. 4. A discovery pattern taxonomy. Eight recurring patterns (gap fill, Swanson ABC, analogy transfer, and others) are annotated across the dataset, enabling analysis of how reasoning strategies differ between biomedical and AI/ML research. 2 Related Work 2.1 Datasets for Scientific Hypothesis Generation HypoGen ( Li et al. 2025 ) introduced the Bit-Flip-Spark schema for hypothesis generation, where Bit represents a conventional assumption, Flip represents a novel hypothesis that challenges it, and Spark is a concise insight connecting them. The dataset contains 5,478 training and 50 test records drawn from NeurIPS and ICLR papers, accompanied by chain-of-reasoning narratives. A fine-tuned Llama 3.1 8B model achieved an IAScore of 0.6746 using the IdeaMatcher evaluation framework. CrossTrace builds directly on this schema but extends it with (a) step-level reasoning traces instead of narrative paragraphs, (b) source-text grounding for each step, (c) biomedical and cross-domain coverage, and (d) a discovery pattern taxonomy. HypoBench ( Zhu et al. 2025 ) provides a systematic evaluation framework for scientific hypothesis generation across 12 tasks and 194 datasets, primarily testing data-driven hypothesis formulation from tabular data. The best-performing model (Claude 3.5 Sonnet) achieves only 38.8% hypothesis discovery rate, highlighting the difficulty of the task. HypoBench evaluates hypothesis quality but does not provide training data or reasoning traces. DiscoveryBench ( Majumder et al. 2024 ) formalizes data-driven discovery across 264 tasks in six domains, but evaluates hypothesis verification from provided datasets rather than generation from literature. ResearchAgent ( Baek et al. 2024 ) generates novel scientific ideas through iterative literature retrieval and refinement, but focuses on the generation pipeline rather than providing a reusable trace dataset. HypoGeniC

Read the complete text