MOOSE-Star: Unlocking Tractable Training for Scientific Discovery by Breaking the Complexity Barrier
Zonglin Yang, Lidong Bing · 2026
Read MOOSE-Star: Unlocking Tractable Training for Scientific Discovery by Breaking the Complexity Barrier by Zonglin Yang, Lidong Bing (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-03756.txt.
Introduction
Zonglin Yang and Lidong Bing train a model to do the thing scientists do: given a background, propose a hypothesis. Existing discovery systems only infer at test time or learn from feedback. Directly training the probability of a hypothesis given background sounds clean, but their 2026 paper proves it intractable: retrieving and composing inspirations from a huge knowledge base explodes combinatorially.
Their framework, MOOSE-Star, breaks the wall three ways. Training targets decomposed subtasks drawn from a probabilistic equation of discovery. A motivation-guided hierarchical search retrieves in logarithmic time and prunes irrelevant corners. Bounded composition keeps the result robust to retrieval noise. The team releases TOMATO-Star, over one hundred thousand decomposed papers prepared for training. Brute-force sampling hits a complexity wall; MOOSE-Star keeps scaling with test-time computation instead.
Catalog record
| CREATOR | Zonglin Yang, Lidong Bing |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57458 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.03756
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
MOOSE-Star: Unlocking Tractable Training for Scientific Discovery by Breaking the Complexity Barrier Zonglin Yang, Lidong Bing Abstract While large language models (LLMs) show promise in scientific discovery, existing research focuses on inference or feedback-driven training, leaving the direct modeling of the generative reasoning process, P ( hypothesis | background ) P(\text{hypothesis}|\text{background}) ( P ( h | b ) P(h|b) ), unexplored. We demonstrate that directly training P ( h | b ) P(h|b) is mathematically intractable due to the combinatorial complexity ( O ( N k ) O(N^{k}) ) inherent in retrieving and composing inspirations from a vast knowledge base. To break this barrier, we introduce MOOSE-Star , a unified framework enabling tractable training and scalable inference. In the best case, MOOSE-Star reduces complexity from exponential to logarithmic ( O ( log N ) O(\log N) ) by (1) training on decomposed subtasks derived from the probabilistic equation of discovery, (2) employing motivation-guided hierarchical search to enable logarithmic retrieval and prune irrelevant subspaces, and (3) utilizing bounded composition for robustness against retrieval noise. To facilitate this, we release TOMATO-Star , a dataset of 108,717 decomposed papers (38,400 GPU hours) for training. Furthermore, we show that while brute-force sampling hits a “complexity wall,” MOOSE-Star exhibits continuous test-time scaling. https://github.com/ZonglinY/MOOSE-Star https://huggingface.co/datasets/ZonglinY/TOMATO-Star https://huggingface.co/ZonglinY/MOOSE-Star-HC-R1D-7B https://huggingface.co/ZonglinY/MOOSE-Star-IR-R1D-7B 1 Introduction Recently, increasing research attention has been brought to the field of LLMs for scientific discovery. However, most research efforts to date focus on developing inference methodologies to leverage LLMs for discovery, with only a few works investigating how to train an LLM specifically for this task ( 15 ) . Critically, nearly all of these existing training approaches rely on external feedback to refine generated hypotheses, rather than explicitly modeling the core conditional probability P(\text{hypothesis}|\text{background}) (denoted as P(h|b) ). In essence, these methods learn how to update a hypothesis given feedback, but overlook the fundamental reasoning process required to generate a high-quality hypothesis directly from the research background. For example, 29 ; 12 leverage open-access reviews to train critique models; 2 utilize alignment with observed data as reward; and 5 employ rubric-based LLM feedback. Consequently, how to train P(h|b) remains unknown. In this paper, we provide a theoretical analysis demonstrating why directly training P(h|b) is intractable due to its inherent combinatorial complexity. Furthermore, we propose a recipe to overcome this barrier, enabling the tractable and, crucially, scalable training of P(h|b) . To understand this intractability, we build upon the formalization established in prior studies ( 32 ; 13 ) , viewing the generation of a hypothesis h as a composition of the research background b and a sequence of latent inspirations retrieved from the global knowledge base. For instance, the discovery of Backpropagation can be viewed as composing the background of “multilayer logistic regression” with the inspiration of the “chain rule” from calculus. This compositional view is supported by cognitive science studies ( 10 ; 3 ) and recent inference-based discovery methods ( 30 ; 27 ; 4 ; 11 ) . However, directly training P(h|b) implies implicitly learning to retrieve the correct sequence of k inspirations from a literature space of size N (e.g., N\approx 10^{7} , encoded within the LLM’s pre-trained parameters). This results in a combinatorial search space of O(N^{k}) , rendering end-to-end training mathematically intractable. To break this complexity barrier, we introduce MOOSE-Star (MS), a framework that transforms the intractable objective into a solvable form through a series of theoretical decompositions. Specifically, we leverage the mathematical formulation proposed by 32 , which decomposes the combinatorial complexity of P(h|b) into a set of subtasks with linear complexity: retrieving inspirations (sequentially) and composing each inspiration into a hypothesis. Crucially, while 32 utilized this equation solely for inference, we operationalize it here for training. This decouples the exponential O(N^{k}) dependency into k independent sequential steps, reducing the sample complexity to a linear O(k\times N) . However, even with this decomposition, explicitly scanning the full literature ( N ) remains computationally prohibitive. To address this, we introduce three key innovations: (1) Hierarchical Search : We organize the global literature into a semantic search tree, replacing the expensive linear scan with top-down navigation. This reduces the retrieval complexity from linear O(N) to logarithmic O(\log N) in the best-case scenario. (2) Bounded Composition : To handle retrieval imperfections, we introduce a semantic tolerance radius. By training the composition module on noisy inspirations within a “bounded window” centered on the exact inspiration i^{*} , we ensure the model is robust to inexact retrievals. (3) Motivation Planning : We demonstrate that explicitly modeling a “Motivation” variable—appended to the research background—acts as a dynamic generative root for the search tree. By effectively pruning irrelevant branches during hierarchical search, this reduces the number of search steps required to locate the relevant semantic subspace ( N_{m}<N ). To support this data-hungry training paradigm, we developed a comprehensive pipeline that processes scientific literature across domains such as biology, chemistry, and cognitive science. In total, we extracted research backgrounds, ground-truth hypotheses, and inspirations—each explicitly linked to a historical citation—from 108,717 papers, a massive computational effort consuming approximately 38,400 A800 GPU hours. We release this processed dataset as the TOMATO-Star dataset. Finally, we demonstrate in § 7 that MOOSE-Star achieves superior test-time scaling compared to brute-force sampling. While brute-force sampling hits a complexity wall on hypotheses requiring the composition of multiple inspirations, our inspiration-based hierarchical search exhibits a continuous improvement in success rate with increased inference budget, effectively turning an intractable discovery problem into a manageable search process. Our contributions can be summarized as below: • We establish the first theoretical analysis on why training P(h|b) is intractable (combinatorial complexity). • We provide the first training recipe on how to enable the tractable and scalable training of P(h|b) . • We provide an inference recipe that supports more scalable test-time inference for discovery. • We release a dataset of 108,717 processed papers (cost 38,400 GPU hours), along with the full training & inference codebase and trained models. 2 Related Work While a significant body of research focuses on novel inference algorithms for LLM-based discovery ( 20 ; 17 ; 22 ; 14 ) , few studies investigate methods for training LLMs for discovery. Most existing training efforts focus on constructing external feedback mechanisms for generated hypotheses rather than modeling the core conditional probability P(h|b) itself. For instance, 29 ; 12 leverage peer review data to train critique models, which serve as reward signals for the discovery agent. Similarly, in the domain of equation discovery, 2 derive rewards based on the goodness of fit between the proposed hypothesis (equation) and observed data. 5 extract evaluation criteria from scientific literature to construct rubric-based LLM self-evaluators, while 19 train models to retrieve ancillary high-level guidance from a constrained set to assist discovery. 18 attempt to model P(h|b) directly; however, obtaining the reasoning trace towards h from only b via distillation is prohibitive (as discussed in § 6 ), and generating simulated reasoning traces directly from b and the ground truth h as input is very difficult to work ( 26 ) . This work focuses exclusively on training LLMs for scientific discovery, distinct from related fields such as general scientific reasoning ( 1 )