LEVI: Stronger Search Architectures Can Substitute for Larger LLMs in Evolutionary Search

Temoor Tanveer · 2026

Read LEVI: Stronger Search Architectures Can Substitute for Larger LLMs in Evolutionary Search by Temoor Tanveer (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-09764.txt.

Introduction

Tanveer argued that evolutionary search with language models wastes frontier-model money on architecture, not intelligence. Frameworks like AlphaEvolve work well. But archives that lose solution diversity force stronger mutation models to compensate. Blind model use spends frontier dollars on edits small models could make. Full-set evaluation burns rollouts on redundant examples. LEVI, a harness-first framework, fixes the search architecture instead.

It keeps diversity from the start in its solution database, routes mutations to the model size each edit deserves, and uses a rank-preserving proxy benchmark for rollout-heavy settings. Across systems-research benchmarks, LEVI topped published frontier runs on a budget 3.3 to 6.7 times smaller. It matched one best score at 35 times lower cost. On prompt optimization, it matched or beat GEPA at under half the rollout budget on four benchmarks.

Catalog record

CREATORTemoor Tanveer
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE92 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.09764

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

LEVI: Stronger Search Architectures Can Substitute for Larger LLMs in Evolutionary Search Temoor Tanveer Abstract LLM-guided evolutionary methods such as AlphaEvolve have proven effective in domains like math, systems research, and algorithmic discovery, but their reliance on frontier models makes each run expensive. We argue this is largely an artifact of how existing frameworks allocate search: archives that fail to preserve solution diversity force compensation through stronger mutation models; blind model use spends frontier dollars on local edits a smaller model could handle; and full-set evaluation wastes rollouts on redundant examples. We introduce LEVI, a harness-first evolutionary framework built on the bet that stronger search architectures can substitute for or even outperform larger LLMs in evolutionary search . LEVI improves on three core components of evolutionary search: a solution database that establishes diversity from the beginning, and then maintains it throughout the run; a smarter mutation router that plays into the strengths of large and small LLMs; and a rank-preserving proxy benchmark for rollout-heavy settings. Across systems-research benchmarks LEVI attains the highest score on a budget 3.3–6.7 × \times smaller than the published frontier-model runs of existing frameworks like ShinkaEvolve, GEPA, and AdaEvolve; on one problem, LEVI matches the existing best at a 35 × \times lower cost. On prompt optimization, LEVI matches or exceeds GEPA at less than half of its rollout budget on four different benchmarks. LEVI is available as an open-source framework at https://github.com/ttanv/levi . Figure 1: LEVI demonstrates that stronger search architecture can outperform larger-budget optimization. Across both code and prompt optimization, LEVI reaches higher final performance while using a fraction of the evaluation budget. Left: on transaction-scheduling code optimization, LEVI exceeds every baseline’s final score within the first \sim 50 evaluations (15x sample efficiency). Right: on HotpotQA prompt optimization with Qwen3-8B, LEVI outperforms GEPA while using fewer than half as many rollouts, reaching its best result with \sim 2.75K rollouts versus GEPA’s \sim 6.87K. 1 Introduction LLM-based evolutionary methods like AlphaEvolve Novikov et al. 2025 have yielded promising results in different easy-to-verify, hard-to-search domains, including math ( Romera-Paredes et al. ; Georgiev et al. 2025 ) , code optimization ( Suwandi et al. 2026 ) , heuristic design ( Liu et al. 2024 ) , systems optimization ( Cheng et al. 2025 ; Zhao et al. 2025 ) , and prompt optimization ( Guo et al. 2024 ; Agrawal et al. 2025 ) . In this paradigm, the user defines the problem and a scoring function, while an evolutionary loop uses an LLM to mutate candidate solutions, evaluates them, and maintains a solution database of promising candidates ( Romera-Paredes et al. ; Novikov et al. 2025 ) . Despite the demonstrated power of the paradigm, existing methods remain costly. Each result can require hundreds or thousands of calls to expensive frontier LLMs. This has been observed in recent works ( Lange et al. 2025 ; Sharma 2025 ; Cemri et al. 2026 ; Liu et al. 2026 ) , where each individual run can cost up to \$30 and often relies on frontier LLMs such as the latest Claude Opus or Gemini Pro. These costs raise the barrier of entry for many researchers and limit the potential of the paradigm. Notably, this reliance on frontier models is not obviously inherent to LLM-guided evolution: the original FunSearch produced novel mathematical results, including the cap set improvement, without using a frontier scale LLM ( Romera-Paredes et al. ) . We argue much of the current cost comes from over-relying on larger models while under-investing in search architecture. We introduce LEVI, a harness-first evolutionary framework that outperforms other methods at a fraction of the cost by making the following bet: stronger search architectures can substitute for or even outperform larger LLMs in evolutionary search. LEVI follows this by improving the search loop along three dimensions, each targeting a different source of inefficiency. First, on the per-evaluation axis, LEVI improves the solution database (the component responsible for maintaining diverse solutions) through diverse initialization paired with flexible, input and output-based behavioral dimensions. Rather than seeding from a single convergent-prone solution, LEVI spends a small fraction of the budget producing an explicitly diverse initial set (including weaker but structurally distinct solutions), and uses those same seeds to calibrate a CVT-MAP-Elites archive whose cells correspond to genuinely distinct algorithmic identities. The archive’s robust diversity dimensions then preserve this diversity throughout the search. Second, on the mutations per dollar axis, LEVI employs role-aware mutations: routing most ordinary mutation calls to smaller models while reserving larger models for rare paradigm shifts. The database and the router compose: strong archival diversity gives small models robustness to their own noise, while paradigm shifts from larger models inject genuinely new families into the archive. Third, on the per-rollout axis, LEVI selects a representative proxy benchmark for settings where evaluation cost dominates; most notably rollout-heavy prompt optimization. The proxy is chosen to preserve the ranking signal of the full benchmark rather than every individual score, since evolutionary selection only depends on choosing better candidates over worse ones. Across seven systems-research benchmarks, LEVI attains the best score on six of seven problems at 3.3–6.7× lower cost than published frontier-model runs of GEPA, OpenEvolve, ShinkaEvolve, AdaEvolve, and EvoX. Under matched-budget controlled comparison with the same model, LEVI shows up to 15x sample efficiency over other methods and continues improving where baselines stagnate. On four prompt-optimization benchmarks, LEVI exceeds GEPA on aggregate at less than half of its rollout budget. Ablations isolate the contribution of each component. 2 Related Work LLM-guided evolutionary frameworks. Several open-source frameworks instantiate the FunSearch ( Romera-Paredes et al. ) and AlphaEvolve ( Novikov et al. 2025 ) paradigm with different design choices, but still leave cost tied to frontier models, full validation, or post-hoc diversity repair. OpenEvolve ( Sharma 2025 ) combines island-based evolution with low-dimensional MAP-Elites ( Mouret and Clune 2015 ) archiving; ShinkaEvolve ( Lange et al. 2025 ) adds weighted archive sampling, novelty filters, LLM novelty judges, and adaptive model selection; AdaEvolve ( Cemri et al. 2026 ) adapts exploration intensity using accumulated improvement; and EvoX ( Liu et al. 2026 ) treats the search strategy itself as an evolvable object. GEPA ( Agrawal et al. 2025 ) targets prompt optimization, using natural-language reflection to mutate prompts and maintaining diversity through per-instance Pareto fronts rather than an explicit archive. LEVI differs by decoupling all three budget axes identified in Section 1 : a CVT-MAP-Elites archive preserves diversity by construction, role-aware routing conditions model choice on mutation type, and proxy-benchmark selection reduces rollout cost in validation-heavy settings. Quality-diversity optimization. LEVI’s archive design draws directly on the quality-diversity (QD) lineage. MAP-Elites ( Mouret and Clune 2015 ) introduced the idea of partitioning solutions into a grid of behavioral cells, each holding the best solution to land there; CVT-MAP-Elites ( Vassiliades et al. 2017 ) replaced the regular grid with a centroidal Voronoi tessellation, which scales gracefully as the number of behavioral dimensions grows and avoids the exponential cell-count explosion of the original. LEVI inherits this construction and adds two practitioner-facing pieces: a bootstrapped seed pass that doubles as descriptor calibration, and a mixed input/output descriptor family that lets the archive express algorithmic identity (e.g. via

Read the complete text