BayesEvolve: Explicit Belief States for Autonomous Scientific Discovery
Xuening Wu, 1 Shan Yu, 2 Qianya Xu, 3 Shenqin Yin 4,† 1 Pfizer, Shanghai, China 2 Independent Researcher, Hangzhou, China 3 University of California San Diego, La Jolla, CA, USA 4 Institute of Humanities and Social Science Data, Fudan University, Shanghai, China † Corresponding author: [email protected] · 2026
Read BayesEvolve: Explicit Belief States for Autonomous Scientific Discovery by Xuening Wu, 1 Shan Yu, 2 Qianya Xu, 3 Shenqin Yin 4,† 1 Pfizer, Shanghai, China 2 Independent Researcher, Hangzhou, China 3 University of California San Diego, La Jolla, CA, USA 4 Institute of Humanities and Social Science Data, Fudan University, Shanghai, China † Corresponding author: [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-30335.txt.
Introduction
Xuening Wu, Shan Yu, Qianya Xu, and Shenqin Yin argue that AI discovery agents should track what they believe, not just what they tried. Language model systems propose hypotheses and run experiments to test them. Most condition on archives of past high-scoring candidates. Archives say what happened, not what is likely true now. Their framework, BayesEvolve, maintains an explicit belief state instead.
Experimental evidence converts into a predictive, uncertainty-aware belief about hypothesis quality. That belief then guides which experiment to run next. Shifted black-box optimization tasks serve as the controlled testbed. Under a fixed evaluation budget, sample efficiency beats memory-guided baselines. The belief state predicts quality on held-out candidate pools well. Ablation tests favor belief-guided selection with an annealed bonus. Late-stage behavior concentrates productively instead of wandering. Program and laboratory domains are left for future work.
Catalog record
| CREATOR | Xuening Wu, 1 Shan Yu, 2 Qianya Xu, 3 Shenqin Yin 4,† 1 Pfizer, Shanghai, China 2 Independent Researcher, Hangzhou, China 3 University of California San Diego, La Jolla, CA, USA 4 Institute of Humanities and Social Science Data, Fudan University, Shanghai, China † Corresponding author: [email protected] |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 14 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.30335
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
BayesEvolve: Explicit Belief States for Autonomous Scientific Discovery Xuening Wu, 1 Shan Yu, 2 Qianya Xu, 3 Shenqin Yin 4,† 1 Pfizer, Shanghai, China 2 Independent Researcher, Hangzhou, China 3 University of California San Diego, La Jolla, CA, USA 4 Institute of Humanities and Social Science Data, Fudan University, Shanghai, China † Corresponding author: [email protected] Abstract Autonomous scientific discovery systems increasingly use large language models (LLMs) to propose new hypotheses, but many such systems condition primarily on experimental memory: archives of high-scoring candidates or heuristic summaries of recent trials. We argue that discovery agents should instead maintain explicit, uncertainty-aware beliefs about hypothesis quality. We introduce BayesEvolve , a belief-guided discovery framework that converts experimental evidence into a predictive belief state and uses this belief to guide future experimentation. As a controlled testbed for belief-guided discovery, we evaluate BayesEvolve on shifted BBOB-style black-box optimization tasks, leaving program and laboratory discovery domains to future work. BayesEvolve improves sample efficiency over memory- and archive-guided LLM baselines under a fixed evaluation budget. We further show that the belief state is predictive on held-out candidate pools, that controlled decision-rule ablations favor belief-guided selection with an annealed uncertainty bonus, and that BayesEvolve exhibits productive late-stage concentration rather than unfocused exploration. 1 Introduction LLM-guided evolutionary search has emerged as a compelling paradigm for automated optimization and discovery. FunSearch ( 4 ) demonstrates that evolutionary selection over LLM-generated programs can recover novel combinatorial results; AlphaEvolve ( 3 ) scales similar ideas to larger codebases and optimization tasks. Despite these successes, many systems use experimental history primarily as memory: the LLM is prompted with examples sampled from an archive of previously evaluated candidates, often biased toward high-scoring examples. This archive-guided design leaves much of the evidence in implicit form. A list of past experiments says what happened, but it does not explicitly encode what the agent currently believes about unevaluated hypotheses, how uncertain those beliefs are, or which experiment would be most informative next. Two costs follow. First, the agent cannot directly reason about predicted quality beyond the observed archive. Second, it may either over-concentrate around early elite candidates or continue exploring without converting evidence into a focused search direction. We propose BayesEvolve , which reframes autonomous discovery as belief-state evolution. Instead of treating past evaluations as unstructured memory, BayesEvolve maintains an explicit predictive belief state over candidate quality. At each step, experimental evidence updates a posterior belief; this belief is exposed to the proposal process and used by an acquisition rule to select future evaluations. In the experiments below, the belief state is implemented with a Gaussian process (GP) posterior over numerical candidates, but the framework is agnostic to the surrogate model and candidate representation. Contributions. • We formulate LLM-guided discovery as explicit belief-state maintenance rather than archive memory alone. • We introduce a belief-guided selection rule with an annealed uncertainty bonus that shifts from exploration to exploitation as evidence accumulates. • We evaluate BayesEvolve on shifted BBOB-style optimization tasks, showing stronger performance than archive- and memory-guided LLM baselines. • We analyze belief quality, decision-rule ablations, and diversity dynamics, showing that BayesEvolve’s belief state is predictive and supports productive late-stage concentration. 2 Related Work Archive-guided LLM evolutionary search. FunSearch ( 4 ) evolves programs using a population of evaluated candidates, while AlphaEvolve ( 3 ) extends LLM-guided evolution to broader engineering problems. These systems demonstrate the power of LLM proposal plus selection, but their historical information is largely represented through archives and scores. BayesEvolve complements this line of work by making predictive beliefs explicit. Bayesian and probabilistic discovery. Bayesian optimization uses posterior beliefs and acquisition functions to select informative evaluations ( 2 ; 5 ) . BayesEvolve borrows this decision-theoretic structure but places it inside an LLM-guided discovery loop, where the belief state is used both to summarize evidence and guide candidate selection. Related probabilistic discovery systems such as ModelSMC ( 7 ) maintain distributions over symbolic model candidates; BayesEvolve focuses on explicit predictive beliefs for general hypothesis quality. Memory-guided LLM agents. Memory buffers and archive summaries are common in LLM-based scientific agents and optimization systems. Such memory can be useful, but it does not by itself provide calibrated predictions or uncertainty estimates over unevaluated candidates. Our experiments compare against archive and heuristic-memory baselines to isolate the value of explicit belief states. 3 BayesEvolve 3.1 Problem Formulation Let \mathcal{H} be a hypothesis space. At step t , the system evaluates a candidate h_{t}\in\mathcal{H} and receives an objective value y_{t}\in\mathbb{R} . In this paper we consider minimization, so lower y_{t} is better. The evaluation history is \mathcal{D}_{t}=\{(h_{i},y_{i})\}_{i=1}^{t}, (1) and the goal is to find a candidate with low objective value under a fixed evaluation budget T . Archive-guided methods condition proposals on a subset of past evaluations, such as top-scoring candidates or recent experimental summaries. BayesEvolve instead maintains an explicit belief state P(y\mid h,\mathcal{D}_{t})=\mathcal{N}(\mu_{t}(h),\sigma_{t}^{2}(h)), (2) where \mu_{t}(h) is the predicted objective and \sigma_{t}(h) is posterior uncertainty. 3.2 Belief-Guided Selection For a candidate pool \mathcal{C}_{t} , BayesEvolve selects the next candidate using an uncertainty-aware score. Because we minimize the objective, the fixed-UCB rule is a_{t}(h)=-\mu_{t}(h)+\beta\,\sigma_{t}(h). (3) Motivated by exploration schedules in reinforcement learning, our final decision rule uses a decaying uncertainty coefficient: a_{t}(h)=-\mu_{t}(h)+\beta_{t}\,\sigma_{t}(h),\qquad\beta_{t}=\beta_{0}\sqrt{\frac{n_{0}}{t}}, (4) where n_{0} is the number of shared initialization evaluations. This encourages broader exploration early and increasingly exploits the belief mean as evidence accumulates. Algorithm 1 BayesEvolve 0: Proposal model \pi_{\mathrm{LLM}} , surrogate model, budget T , initialization size n_{0} 1: Evaluate n_{0} initial candidates to form \mathcal{D}_{t} 2: for t=n_{0}+1 to T do 3: Fit/update belief state P(y\mid h,\mathcal{D}_{t}) 4: Construct candidate pool \mathcal{C}_{t} from LLM proposals and/or archive mutations 5: Compute \mu_{t}(h) and \sigma_{t}(h) for h\in\mathcal{C}_{t} 6: Select h_{t}=\arg\max_{h\in\mathcal{C}_{t}}[-\mu_{t}(h)+\beta_{t}\sigma_{t}(h)] 7: Evaluate y_{t}=f(h_{t}) and update \mathcal{D}_{t}\leftarrow\mathcal{D}_{t}\cup\{(h_{t},y_{t})\} 8: end for 9: return best candidate in \mathcal{D}_{t} 4 Experimental Evaluation 4.1 Setup Benchmark. We evaluate on five shifted BBOB-style minimization functions ( 1 ) in dimension d=5 : Sphere, Ellipsoid, Rastrigin, Rosenbrock, and Ackley. Each function is shifted by a fixed hidden offset, and LLM prompts expose only opaque task IDs (e.g., F01) rather than function names, preventing benchmark-name leakage. Each run uses n_{0}=6 shared random initialization evaluations and a total budget of T=100 evaluations. Results are averaged over five random seeds and five functions; shaded regions and \pm values report standard error. Methods. All LLM-based methods use the same proposal model, gpt-5.4-mini , and differ only in the information provided in context: no memory (Random-LLM), top archive entries (Archive-LLM), recent heuristic memory (Memory-LLM), or BayesEvolve’s explicit belief state. GP-BO is a non-LLM Bayesian optimization baseline. For local ablations, all belief variants use the same shifted benchmark, shared initialization, GP posterior, and candidate-pool mechanism; we compare mean-only selection, UCB ( 5 ) , Thompson sampling ( 6 ) , and expected improvement ( 2 ) . 4.2 Experiment 1: Main Discovery Performance Figure 1: Main discovery performance on shifted BBOB-style optimization tasks. Curves show mean normalized best-so-far objective across five benchmark functions and five random seeds; shaded regions denote standard error. All LLM methods use gpt-5.4-mini ; GP-BO is a non-LLM Bayesian optimization baseline. Lower is better. Table 1: Normalized best-so-far objective at 25, 50, and 100 evaluations. Lower is better. Method 25 evals 50 evals 100 evals