HypER: Literature-grounded Hypothesis Generation and Distillation with Provenance

Rosni Vasu, Chandrayee Basu, Bhavana Dalvi Mishra, Cristina Sarasua, Peter Clark, Abraham Bernstein · 2025

Read HypER: Literature-grounded Hypothesis Generation and Distillation with Provenance by Rosni Vasu, Chandrayee Basu, Bhavana Dalvi Mishra, Cristina Sarasua, Peter Clark, Abraham Bernstein (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-12937.txt.

Introduction

Rosni Vasu and five co-authors train a small language model to generate scientific hypotheses that come with their reasoning and evidence attached. Their paper came out in 2025. Hypothesis writing is the precise step where a research idea becomes a testable statement, and it has received less attention than general idea generation.

Their model, called HypER, learns in a multi-task setup to tell valid reasoning chains from invalid ones, even with distractions planted in the text. It beat its base model clearly at spotting flawed reasoning. Its hypotheses scored better on evidence grounding, and human experts rated them high on feasibility and impact. By keeping provenance, the chain back to the source literature, attached to each hypothesis, the system aims to make machine suggestions auditable.

Catalog record

CREATORRosni Vasu, Chandrayee Basu, Bhavana Dalvi Mishra, Cristina Sarasua, Peter Clark, Abraham Bernstein
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE89 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-12937

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

HypER: Literature-grounded Hypothesis Generation and Distillation with Provenance Rosni Vasu, Chandrayee Basu, Bhavana Dalvi Mishra, Cristina Sarasua, Peter Clark, Abraham Bernstein Abstract Large Language models have demonstrated promising performance in research ideation across scientific domains. Hypothesis development, the process of generating a highly specific declarative statement connecting a research idea with empirical validation, has received relatively less attention. Existing approaches trivially deploy retrieval augmentation and focus only on the quality of the final output ignoring the underlying reasoning process behind ideation. We present HypER ( Hyp othesis Generation with E xplanation and R easoning), a small language model (SLM) trained for literature-guided reasoning and evidence-based hypothesis generation. HypER is trained in a multi-task setting to discriminate between valid and invalid scientific reasoning chains in presence of controlled distractions. We find that HypER outperformes the base model, distinguishing valid from invalid reasoning chains (+22% average absolute F1), generates better evidence-grounded hypotheses (0.327 vs. 0.305 base model) with high feasibility and impact as judged by human experts ( > > 3.5 on 5-point Likert scale). 1 Introduction Figure 1: Comparison of hypothesis generation approaches: (1) Base LLM – Generates ungrounded hypotheses. (2) Citation Chain without Validation – Uses related papers but lacks a coherent argument across the chain. (3) HypER (Ours) – Ensures hypotheses are well-supported with literature and logical progression. Please refer to Table 10 in Appendix for details of reasoning chains. Large Language Models (LLMs) have shown remarkable potential as AI scientists and research assistants, excelling in tasks such as knowledge acquisition from the scientific literature, idea generation, hypothesis development, experiment design, and data-driven verification Pu et al. 2024 ; Li et al. 2024 ; Si et al. 2024 ; Wang et al. 2023a ; Lu et al. 2024 ; King et al. 2009 ; Qi et al. 2024 . One such scientific task is literature-based discovery (LBD), which aims to generate novel hypotheses by exploring connections within a large body of scientific literature. Techniques in LBD include structured causality investigations, including association rules, graph theoretics, and explicitly curated semantic relationships between concepts Swanson 1986 ; Xun et al. 2017 . In this work, we focus on LBD in the medical domain. In the medical domain, where evidence-based reasoning is the norm Yang et al. 2019 ; Bichindaritz et al. 1998 , researchers require a clear provenance of ideas before committing to costly hypothesis development and validation Jing et al. 2024 ; Karunarathna et al. 2024 . While traditional LBD methods provide structured pathways for discovery ( Swanson 1986 ; Thilakaratne et al. 2019 ) , their reliance on co-occurrence patterns limits the ability to capture evolving research trajectories. In contrast, LLMs enable the generation of creative, open-ended ideas by synthesizing diverse information ( Wang et al. 2023a ) . However, this flexibility often comes at the cost of interpretability and grounding in scientific evidence, two attributes essential for real-world use in clinical and biomedical research. Existing LLM-based approaches to scientific hypothesis generation, such as ResearchAgent ( Baek et al. 2024a ) , Acceleron Nigam et al. 2024 , SciMuse Gu and Krenn 2024 , and SciMON ( Wang et al. 2023b ) treat the task as conditional generation over retrieved literature. Unlike traditional LBD systems, these models lack a structured approach to literature organization. A common practice in literature review is to organize prior work chronologically to discover trends, uncover key milestones, and build knowledge. Recent work demonstrated the effectiveness of this approach in AI assisted idea generation, e.g., inspirations presented as chains of ideas or paths connecting concepts in a Knowledge Graph (KG) was reported to improve the quality of research ideas. Li et al. 2024 ; Ghafarollahi and Buehler 2024 . We build on this idea of structured representations to bridge the gap between traditional LBD and LLM-based hypothesis generation. However, rather than imposing structure only at inference time, we argue that scientific AI assistants should be trained to organize and reason over the literature, mimicking real-world scientific inquiry. In this paper, we ask: How can we train an LLM to navigate the noisy literature and generate novel and impactful ideas that are grounded in a solid understanding of existing work. . To address this question, we develop HypER , a small language model (SLM) trained for literature-guided reasoning and evidence-based hypothesis generation , focusing on fine-grained logical connections between arguments in scientific abstracts rather than collating ideas by surface-level similarity commonly used in recent work. We first validate a teacher LLM’s capability to extract these dependencies. Then using the validated teacher, we contribute a novel dataset of temporal chains (sequences of article abstracts) where each node is inspired by or dependent on its predecessor, reflecting the evidence-driven nature of scientific discovery. To account for the real-world challenges, we simulate varying levels of noise in the literature with carefully curated controlled distraction articles. While building these chains requires costly citation graph traversal and numerous LLM calls, we distill this process into an SLM fine-tuned via multitask learning. HypER is trained to discriminate between valid and invalid chains and to integrate this reasoning with the ideation of evidence-based hypotheses. This paper makes the following contributions: Task: We formalize a new literature-grounded scientific hypothesis generation task that goes beyond surface-level similarity-based linking by explicitly validating reasoning chains using relevance scoring to ensure logical coherence and progression across cited papers. Framework: We propose a multitask framework that explicitly supervises the scientific reasoning process via two classification tasks: one-hop paper-paper relevance and validity of multihop chains. Hypothesis generation is performed at inference time, conditioned on validated reasoning chains. Dataset: We construct a dataset of 3,523 reasoning chains derived from 359 core valid chains, with fine-grained relevance labels and curated invalid samples, using LLM-based scoring validated through expert evaluation. Model: We fine-tune small instruction-tuned LLMs (e.g., Phi-3-mini-128k-instruct), HypER , achieving strong performance across all tasks. Evaluation: We present a comprehensive evaluation of base vs HypER . For classification, we report accuracy and F1; for generation, we assess novelty, clarity, and groundedness via automated and expert review. HypER outperformed the base model at distinguishing valid vs. invalid reasoning chains (+22% average absolute F1) and generates more evidence-grounded hypotheses (0.327 vs. 0.305 base model) with high feasibility and impact as judged by human experts including clinicians and biomedical researchers ( > 3.5 on 5-point Likert scale), in some cases anticipatory of recent studies (Section 5 and Appendix H .) Although we focus on the medical domain for its strong emphasis on evidence-based reasoning, the framework is generalizable to other scientific fields. 2 HypER (a) (b) Figure 2: (a) Pipeline for constructing reasoning chains from RCT summarization data. The process iteratively retrieves citing papers, evaluates their relevance, and constructs a literature path of evidence-supported hypothesis reasoning. (b) An example sub-graph rooted from source paper p_{k} ( ) and multiple valid and invalid chains associated with it within it. All the are valid papers citing the previous papers and are the papers which are irrelevant to the previous paper but are cited them and might be sharing terminologies. 2.1 Problem formulation Our goal is to ensure that the reasoning paths not only support the generated hypothesis but also provide a clear and scientifically sound rationale, mimicking

Read the complete text