SMCEvolve : Principled Scientific Discovery via Sequential Monte Carlo Evolution

Jiachen Jiang, Huminhao Zhu, Zhihui ZhuDepartment of Computer Science and EngineeringThe Ohio State University {jiang.2880, zhu.4228, zhu.3440}@osu.edu · 2026

Read SMCEvolve : Principled Scientific Discovery via Sequential Monte Carlo Evolution by Jiachen Jiang, Huminhao Zhu, Zhihui ZhuDepartment of Computer Science and EngineeringThe Ohio State University {jiang.2880, zhu.4228, zhu.3440}@osu.edu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-15308.txt.

Introduction

Jiachen Jiang, Huminhao Zhu, and Zhihui Zhu offer SMCEvolve, a principled framework for LLM-driven program evolution toward scientific discovery. Old systems offer no design rules for their parts and no convergence guarantee. Reframing search as sampling from a reward-tilted distribution with a stepwise Monte Carlo sampler yields three principled mechanisms: live parent redrawing, mutation mixes with approval, and auto settling control. A finite-sample analysis bounds the LLM-call budget, and benchmarks show wins over state-of-the-art evolving systems with fewer calls.

Catalog record

CREATORJiachen Jiang, Huminhao Zhu, Zhihui ZhuDepartment of Computer Science and EngineeringThe Ohio State University {jiang.2880, zhu.4228, zhu.3440}@osu.edu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE82179
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.15308

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SMCEvolve : Principled Scientific Discovery via Sequential Monte Carlo Evolution Jiachen Jiang, Huminhao Zhu, Zhihui ZhuDepartment of Computer Science and EngineeringThe Ohio State University {jiang.2880, zhu.4228, zhu.3440}@osu.edu Abstract LLM-driven program evolution has emerged as a powerful tool for automated scientific discovery, yet existing frameworks offer no principled guide for designing their individual components and provide no guarantee that the search converges. We introduce SMCEvolve , which recasts program search as sampling from a reward-tilted target distribution and approximates it with a Sequential Monte Carlo (SMC) sampler. From this view, three core mechanisms emerge as principled components: adaptive parent resampling, mixture of mutation with acceptance, and automatic convergence control. We further provide a finite-sample complexity analysis that bounds the LLM-call budget required to reach a target approximation error. Across math, algorithm efficiency, symbolic regression, and end-to-end ML research benchmarks, SMCEvolve surpasses state-of-the-art evolving systems while using fewer LLM calls under self-determined termination. The code is available at https://github.com/kongwanbianjinyu/SMCEvolve . Figure 1 : LLM-driven program evolution targeting the reward-tilted distribution via Sequential Monte Carlo (SMC). The contour depicts the distribution over the program space; each white dot is a particle (program) in the evolving population, and the dashed circle marks the high-reward region. Starting from particles drawn from the LLM prior p_{0} ( left ), where the high-reward region is rarely covered, the population is driven by the LLM toward new programs that form a sequence of bridging distributions p_{0}\,e^{\beta_{t}R(x)} with increasing reward intensity \beta_{t} , and ultimately concentrates on the target p_{0}\,e^{\beta_{T}R(x)} ( right ). This yields a principled evolutionary framework SMCEvolve with convergence guarantees, in contrast to ad-hoc pipelines. 1 Introduction LLM-driven agents have enabled automated scientific discovery at scale: given the problem description and evaluator, the agent can autonomously search for programs that optimize a target objective, iteratively refining candidates based on evaluation feedback [ 33 , 19 , 26 , 24 , 17 ] . This paradigm has rapidly expanded across diverse domains, including mathematical discovery [ 11 ] , symbolic regression [ 29 ] , materials design [ 1 ] , machine learning [ 4 , 12 ] and end-to-end research automation [ 31 ] . Despite these successes, current agent design remains largely empirical and the area lacks a unifying theoretical framework that guides the design. A typical pipeline, exemplified by AlphaEvolve [ 24 ] , ShinkaEvolve [ 17 ] , and others [ 33 , 19 , 13 , 3 , 32 , 20 ] , maintains a population of candidate programs, prompts an LLM to mutate a selected parent based on context, and adds the evaluated offspring back into the population. The absence of theoretical guidance leaves several limitations. First, there is no principled guide for designing each component within the pipeline: components such as parent selection, context construction, and population management are hand-crafted in isolation and validated through extensive ablations rather than derived from a coherent principle that connects them. Second, the convergence of the pipeline is not guaranteed, leading to substantial randomness and high variance across runs; moreover, existing systems cannot distinguish whether the population has converged to a high-reward region or merely stalled at a local mode , forcing the number of iterations to be fixed in advance—either too small to reach a good solution, or too large and wasting compute. These observations motivate the central question of this work: Can we ground LLM-driven program evolution in a rigorous probabilistic framework that unifies its components and provides convergence guarantees? We address this question from a simple observation: searching for high-reward programs with an LLM can be cast as sampling from a reward-tilted target distribution p^{*}(x\mid q)\propto p_{0}(x\mid q)\,e^{\beta R(x)} , which reweights the LLM prior p_{0} over programs x for a given problem q toward those with high evaluation reward R . Since directly sampling from p^{*} is intractable, we turn to Sequential Monte Carlo (SMC) samplers [ 7 , 6 ] which progressively transport particles from the prior p_{0} toward the target p^{*} through a sequence of bridging distributions with increasing reward weight. Treating each candidate program as a particle, we derive SMCEvolve , a complete evolutionary framework whose three core mechanisms emerge directly from SMC theory: • Adaptive parent resampling. Parents are resampled by importance weights derived from the current bridging distribution, where the influence of reward on selection strengthens as the search progresses—from near-uniform sampling that encourages exploration in early iterations, to sharply reward-focused sampling that drives exploitation in later iterations. This stands in contrast to existing systems, which rely on a fixed selection rule throughout the search. • Mixture of mutation with acceptance. To ensure convergence, the LLM generates multiple proposals at each step, each accepted or rejected with a probability related to the current bridging distribution. To accelerate convergence, we further design a mixture of LLM-driven kernels along two axes—edit scope (local diff vs. full rewrite) and information source (single-parent vs. cross-program inspiration)—and adaptively select among them via Thompson sampling [ 28 ] , which favors kernels that have recently produced high-reward proposals. In contrast, existing systems accept the proposal unconditionally and rely on either a single mutation strategy or a fixed-weight combination of strategies. • Automatic convergence control. The number of iterations is determined adaptively from the state of the population rather than fixed in advance: the search proceeds in small steps when the population is still spread across diverse candidates and in larger steps once it concentrates on high-reward programs, and terminates automatically once it reaches the target distribution. In contrast, existing systems run for a fixed number of iterations specified in advance, without a signal to detect convergence or stalling. Together, these three mechanisms instantiate a complete SMC sampler for LLM-driven program search, and the resulting framework admits formal convergence analysis with finite-sample complexity guarantee. Our main contributions are as follows: • A principled framework for evolutionary program search. We introduce SMCEvolve , the first evolving agent whose components—parent resampling, mutation, and convergence control—are derived from SMC theory rather than hand-crafted in isolation. • Finite-sample convergence analysis. We provide the first convergence guarantee for program evolution, showing that achieving a target approximation error requires a total computational cost bounded explicitly in terms of particle budget, mutation mixing, and reward intensity. • Empirical validation across diverse domains. We evaluate SMCEvolve on multiple domains spanning math [ 24 ] , algorithm efficiency [ 25 ] , symbolic regression [ 30 ] , and LLM pretraining [ 14 ] , where it surpasses state-of-the-art evolving systems on the majority of tasks while consuming fewer LLM calls under automatic convergence control. Figure 2 : Overview of SMCEvolve . Left: the main loop. Starting from N initial programs, each of T iterations (i) reweights and resamples particles, (ii) mutates each parent through a K -step MH chain of LLM proposals and accept/reject updates, and (iii) schedules the next \lambda_{t} via ESS, terminating when \lambda_{t}=1 . Right, top to bottom: the evolving process on circle packing (best-so-far reward across iterations); the mixture of four mutation kernels selected by Thompson sampling; and the automatic convergence control finding \lambda_{t} at the intersection of \mathrm{ESS}(\lambda) with the threshold \kappa N . 2 Method: Program Evolution as Sequential Monte Carlo We formulate program

Read the complete text