Evidence-Informed LLM Beliefs for Continual Scientific Discovery
Dhruv Agarwal Reece Adamson Andrew McCallum, Peter Clark Ashish Sabharwal Bodhisattwa Prasad Majumder · 2026
Read Evidence-Informed LLM Beliefs for Continual Scientific Discovery by Dhruv Agarwal Reece Adamson Andrew McCallum, Peter Clark Ashish Sabharwal Bodhisattwa Prasad Majumder (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-29182.txt.
Introduction
Agarwal, Adamson, McCallum, Clark, Sabharwal and Majumder improve how language models search for scientific discoveries over long runs. A recent system, AutoDiscovery, uses Bayesian surprise, the belief shift after seeing evidence for a hypothesis, both to score discoveries and to guide which hypotheses to test next. The authors note a mismatch: that system treats surprise as static, while human surprise depends on beliefs that evolve with experience.
Their fix is evidence-informed beliefs: priors updated with evidence from earlier hypotheses, so surprise for new ones is measured against current beliefs. Comparing ways to update beliefs in context, retrieval over prior discoveries, using embeddings to fetch relevant past results, best anticipated eventual posteriors. It flagged 37.5 percent of static surprises as spurious. Adding belief-update filtering and diversity maximisation to the search raised accumulated non-stationary surprise by about thirty-one percent on average across five discovery domains.
Catalog record
| CREATOR | Dhruv Agarwal Reece Adamson Andrew McCallum, Peter Clark Ashish Sabharwal Bodhisattwa Prasad Majumder |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.29182
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Evidence-Informed LLM Beliefs for Continual Scientific Discovery Dhruv Agarwal Reece Adamson Andrew McCallum, Peter Clark Ashish Sabharwal Bodhisattwa Prasad Majumder Abstract Open-ended scientific discovery with large language models (LLMs) increasingly operates as a long-horizon loop of hypothesis search and verification, where a reward signal guides which hypotheses to test next. A notable recent example is AutoDiscovery ( Agarwal et al. 2025b ) , which uses “Bayesian surprise”—the belief shift an LLM undergoes after observing evidence for a hypothesis—as both a discovery metric and a reward for search. We first observe that AutoDiscovery treats surprisal as a static quantity, while surprisal in human reasoning is non-stationary —it is defined relative to beliefs that evolve with experience, a prerequisite for continual scientific discovery. We address this mismatch with evidence-informed LLM beliefs : priors updated with evidence from previous hypotheses to compute non-stationary surprisal for new hypotheses. We compare in-context belief-updating mechanisms and find that embedding-based retrieval-augmented generation over prior discoveries best anticipates eventual posteriors, identifying 37.5% of static surprisals as spurious. We then modify search to avoid these spurious rewards and prioritize hypotheses that remain surprising under non-stationary beliefs. Concretely, we introduce two complementary changes to the original search procedure: belief-update filtering and diversity maximization. Across five discovery domains, our method increases accumulated non-stationary surprisal by 30.62% on average compared to the original search procedure, demonstrating that continual scientific discovery with LLMs requires not only better belief measurement but also search procedures that avoid redundancy and encourage diversity. 1 Introduction Scientific discovery is inherently continual ––each observation alters what should be considered novel, informative, or surprising going forward. This view is central to formal accounts of scientific inquiry, where evidence goes beyond isolated hypothesis verification to also revise the epistemic state of a discovery agent, thus changing the space of plausible future hypotheses ( Alchourrón et al. 1985 ; Gärdenfors 1988 ; Martin and Osherson 1997 ) . In Bayesian accounts of scientific reasoning, this revision is captured by conditioning, where evidence transforms a prior set of beliefs into a posterior set of beliefs, and subsequent inference proceeds from the updated posterior rather than the original prior ( Earman 1992 ; Howson and Urbach 2006 ) . Similarly, computational accounts of how scientific theories evolve emphasize that hypotheses are accepted or rejected not independently, but through their coherence with accumulated explanations and observations ( Thagard 1989 ; Thagard 1992 ; Jansen et al. 2026 ) . Thus, in a continual discovery setting, the belief state should be non-stationary and evolve in light of previous results. For instance, when assessing novelty, once a finding is observed, other hypotheses entailed or strongly suggested by this finding should be considered less novel. Figure 1 : Static vs. non-stationary beliefs. Belief distributions for 7500 hypotheses found by AutoDiscovery across five discovery domains. AutoDiscovery uses static beliefs to score hypotheses using an unchanged LLM prior, which causes discoveries already implied by past evidence from search to spuriously appear novel. Evidence-informed LLM priors move the reference belief state towards the eventual posterior and allow for non-stationary surprisal to be computed instead, lowering surprisal count by 37.43% compared to what was found by the original search. Automated scientific discovery with large language models (LLMs) has begun showing promise in such continual settings, alternating between proposing hypotheses (“search”) and evaluating their support (“verification”) over long horizons ( Lu et al. 2024 ; Yamada et al. 2025 ; Gottweis et al. 2025 ) . A notable recent example of such a system is AutoDiscovery ( Agarwal et al. 2025b ) , which uses “Bayesian surprise” ( Itti and Baldi 2005 ) as a reward for hypothesis search—given a hypothesis H , the system elicits a prior belief P(\theta_{H}) about the support for H according to an LLM, evaluates H using a verification procedure \mathcal{V}_{D} over available data D , then elicits a posterior belief P(\theta_{H}\mid\mathcal{V}_{D}) to compute a reward according to the resulting belief shift. This reward is then used to steer search towards candidate hypotheses that are likely to surprise the LLM as a proxy signal for discovery. However, we observe that in both the surprisal reward and evaluation metric, AutoDiscovery treats the LLM prior as static —each hypothesis is evaluated against the model’s parametric beliefs in isolation, without conditioning on discoveries made earlier in the search trajectory. This static treatment creates a mismatch between LLM-driven discovery and human scientific reasoning—as an evaluation metric, static surprisal overestimates progress by counting derivative hypotheses as successful discoveries; as a search reward, it wastes budget by repeatedly steering the agent toward saturated regions of the hypothesis space. Through a human expert study in neuroscience and social science, we find that 29.54% and 25% of hypotheses found surprising by AutoDiscovery in each domain, respectively, are substantially implied by its previous discoveries rather than being genuinely novel. Akin to Bayesian models of cognition that treat human learning as probabilistic inference over hypotheses, where observations update beliefs that support further prediction and exploration ( Tenenbaum et al. 2006 ; L Griffiths et al. 2008 ; Tenenbaum et al. 2011 ) , we argue that LLM-driven discovery must instead utilize non-stationary surprisal using prior beliefs that are continually updated with evidence from previous hypotheses. We compare different mechanisms for updating beliefs using in-context learning, including a structured memory baseline ( Chhikara et al. 2025 ) , and find that simple top- k embedding-based retrieval-augmented generation (RAG) best integrates prior evidence to anticipate the eventual posterior, lowering total surprisal by 37.43% 1 1 1 Hypotheses where evidence-informed priors match the posteriors after verification. on average. As shown in Figure 1 , the distribution of non-stationary prior beliefs is able to move closer to the experimental posterior. We then investigate whether the search budget lost to spurious surprisal can be reallocated to finding hypotheses that remain surprising under non-stationary beliefs. To do so, we present evidence-informed search in AutoDiscovery introducing two complementary mechanisms: (a) belief-update filtering, to sample hypotheses that cannot be derived in-context using prior discoveries, and (b) diversity maximization, which explicitly prioritizes exploration by selecting hypotheses with the least embedding-based similarity to previous discoveries. Across five discovery domains ( Majumder et al. 2025 ; Gu et al. 2024 ) , these modifications increase accumulated non-stationary surprisal by 30.62% on average over the original search procedure, showing that continual discovery requires search policies that explicitly manage redundancy, belief saturation, and diversity. In summary, our contributions are: • We identify a failure mode of static surprisal in continual LLM-driven discovery: hypotheses are scored against unchanged priors despite accumulating evidence during search. We validate this failure mode with human experts in neuroscience and social science, showing that 29.54% and 25% of hypotheses considered surprising using static beliefs, respectively, are derivable from prior discoveries. • We introduce non-stationary surprisal , which evaluates hypotheses relative to LLM beliefs updated with evidence from previously tested hypotheses. We compare ICL-based belief-updating mechanisms and find that embedding-based RAG best anticipates posterior beliefs, lowering total surprisal count by 37.5% of the number of static surprisals. • We present evidence-informed search for AutoDiscovery with belief-update filtering and diversity maximization, yielding a 30.62% average increase in accumulated non-stationary surprisal across five discovery domains. 2 Background Data-driven discovery. Following