AdaEvolve: Adaptive LLM Driven Zeroth-Order Optimization Mert Cemri, Shubham Agrawal, Akshat Gupta, Shu Liu, Audrey Cheng, Qiuyang Mang, Ashwin Naren, Lutfi Eren Erdogan, Koushik Sen, Matei Zaharia, Alex Dimakis, Ion Stoica Abstract The paradigm of automated program generation is shifting from one-shot generation to inference-time search, where Large Language Models (LLMs) function as semantic mutation operators within evolutionary loops. While effective, these systems are currently governed by static schedules that fail to account for the non-stationary dynamics of the search process. This rigidity results in substantial computational waste, as resources are indiscriminately allocated to stagnating populations while promising frontiers remain under-exploited. We introduce AdaEvolve, a framework that reformulates LLM-driven evolution as a hierarchical adaptive optimization problem. AdaEvolve uses an “accumulated improvement signal” to unify decisions across three levels: Local Adaptation , which dynamically modulates the exploration intensity within a population of solution candidates; Global Adaptation , which routes the global resource budget via bandit-based scheduling across different solution candidate populations; and Meta-Guidance which generates novel solution tactics based on the previously generated solutions and their corresponding improvements when the progress stalls. We demonstrate that AdaEvolve consistently outperforms the open-sourced baselines across 185 different open-ended optimization problems including combinatorial, systems optimization and algorithm design problems 1 1 1 The code is available at https://github.com/skydiscover-ai/skydiscover.git . Figure 1 : AdaEvolve overview. Left: Standard LLM-guided search relies on fixed optimization policies, with static schedules, uniform resource allocation, and rigid prompts. Center: AdaEvolve introduces hierarchical adaptivity by dynamically modulating exploration intensity, reallocating compute across populations of programs (islands), and generating meta-level guidance from a unified improvement signal. Right: AdaEvolve overcomes stagnation, reaching to a best-known score of 2.636 on the Circle Packing (N = 26), surpassing the Human SOTA (2.634) and AlphaEvolve (2.635). 1 Introduction The frontier of Large Language Model (LLM) research has shifted from scaling training parameters to scaling inference-time compute. It is now established that reasoning performance is not fixed after training but scales with the computation expended during search ( 31 ; 4 ) . This insight has transformed algorithm discovery and program generation from a one-shot generation task into a sequential decision-making problem. Current non-evolutionary methods for scaling inference compute using a verifier and an LLM based generator such as Beam Search, Monte Carlo Tree Search or Tree-of-Thoughts generally treat the LLM as a static operator, utilizing fixed sampling temperatures and rigid prompt templates throughout the process. Moreover, these algorithms often struggle to maintain diverse, long-horizon context; a standard Beam Search discards the history of “failed” attempts, losing valuable information about the search landscape, along with the fact that these test-time scaling methods usually underutilize the LLMs capability to make use of the search semantics by incorporating the feedback from the past generations when making future generations. To alleviate these bottlenecks, LLM-guided Evolutionary Algorithms (EAs) have emerged as the dominant strategy for complex program generation, combinatorial optimization and algorithmic discovery ( 28 ; 26 ) . Unlike traditional EAs with random syntactic mutations, LLMs act as semantic mutation operators to navigate discrete, non-differentiable search spaces. However, a critical disparity exists in current frameworks. While the mutation operator (the LLM) is sophisticated and context-aware, the search algorithms controlling it remain surprisingly simple. Canonical systems like OpenEvolve ( 30 ) rely on static, pre-determined schedules. This creates a fragility problem: developers must manually tune hyperparameters like mutation rates, population sizes and solution tactics for every new problem. The rigidity of the fixed exploration rates, prompt templates and uniform sampling strategies (determined before the run begins) ignores the non-stationary dynamics of evolutionary search. If the parameters are too conservative, the search stagnates in local optima; if too aggressive, it fails to refine solutions. For example, in the Circle Packing benchmark, OpenEvolve fails to converge unless a human operator manually stops the run after 100 iterations and restarts it with a “refinement” configuration. Because the algorithm cannot adapt its own behavior based on progress, human intuition is required to bridge the gap. In the domain of continuous optimization, these limitations inspired the idea of adaptive gradient methods like AdaGrad, RMSProp, Adam ( 11 ; 14 ; 17 ) . These algorithms use the first and second moments of the gradients to dynamically adjust the learning rates for each parameter, accelerating updates in flat regions and dampening oscillations in steep ones. While the LLM-based program generation is a gradient-free (zero-th order) optimization problem, we observe that the trajectory of fitness improvements provides a signal analogous to gradient magnitudes. When a search trajectory yields substantial fitness gains, it signals a productive gradient that should be exploited; when gains vanish, it signals stagnation requiring variance or redirection. To this end, we introduce AdaEvolve, a framework that formalizes LLM-driven evolution as a hierarchical dynamic optimization problem. A key advantage of AdaEvolve is its minimal configuration requirement: unlike OpenEvolve, which demands per-task or within-run tuning, AdaEvolve requires only the LLM name and iteration count from the user. Internally, AdaEvolve maintains an accumulated improvement signal G_{t} which is updated as an exponential moving average of squared normalized improvements. This single signal coordinates adaptation across three coupled levels: Level 1: Local Adaptation (Within Island Exploration Intensity), AdaEvolve continuously modulates Exploration Intensity ( I_{t} ) within each subpopulation, automatically shifting from exploration to exploitation as solutions refine, and increasing exploration to as solutions stagnate without manual restart thresholds. At Level 2: Global Adaptation (Across Island Resource Allocation), AdaEvolve treats computational resources as a dynamic budget. Using a multi-armed bandit with globally normalized rewards, it routes compute power to productive populations of programs (islands) while starving those that have plateaued. Finally, if numerical adaptation is insufficient and global progress stalls, the system triggers a meta-level “System 2” intervention, which we call Level 3: Meta-Guidance . At this level, instead of trying to mutate the full code, AdaEvolve generates new high-level solution tactics to redirect the search toward qualitatively different solution approaches. Contributions We make the following contributions to the field of LLM-guided optimization: 1. An Adaptive Framework for Evolution: We introduce AdaEvolve, a novel evolutionary LLM-guided algorithm discovery framework that unifies search intensity, resource allocation and strategy generation under a single adaptive optimizer. By deriving all decisions from the same history based improvement signal, we replace the ad-hoc heuristics of prior works with a cohesive adaptive optimizer. 2. Dynamic, Globally-Normalized Resource Allocation. We propose a new bandit-based scheduler that routes computational budget to the most productive subpopulations. Crucially, we introduce a global normalization mechanism that evaluates improvements relative to the global best solution rather than local history. This prevents resources from being wasted on islands that are merely refining poor solutions (local optima) or resting on the successes of old stale generations, ensuring compute is always directed toward the current frontier of the search. 3. Robust and Strong Generalization. AdaEvolve improves over baselines across 185 different optimization/algorithm discovery problems spanning combinatorial geometry, systems optimization, and algorithm design, using identical hyperparameters throughout. In particular, AdaEvolve reaches or matches the best known human or prior AI solutions (including proprietary models like AlphaEvolve) in 4/6 mathematical optimization tasks, achieves human-competitive or superior performance in 6/7 ADRS systems benchmarks, while consistently improving over the open source baselines in all problems. 2 Related Works Test-Time Scaling and Search Algorithms. Test-time compute scaling laws suggest that increased inference budget can improve model performance ( 31 ) . Techniques such as Chain-of-Thought ( 35 ) and Self-Consistency ( 33 ) exploit this by sampling diverse reasoning paths, while more structured approaches like Monte Carlo Tree Search (MCTS) ( 39 ; 9 ) explicitly build search trees to navigate the solution space. Works such as 1 ; 23 ; 24 ; 10 studied multi-agent scaffolds around LLMs to facilitate complex reasoning, including inference-time evolutionary reasoning mechanisms ( 21 ) . LLM-Guided Evolutionary Search. For automated discovery, LLMs have been incorporated at inference time with search-and-feedback scaffolds using evolutionary optimization that iteratively propose, evaluate, and refine candidate solutions, defining the modern era of Genetic Programming ( 19 ; 18 ) . FunSearch ( 28 ) and Evolution through Large Models (ELM) ( 22 ) demonstrated that LLMs could act as semantic variation operators by solving open combinatorial problems. Subsequently, AlphaEvolve ( 26 ) generalized this approach by maintaining populations of candidate programs iteratively improved via mutation, crossover, and selection across scientific and engineering problems. GEPA ( 2 ) is closely related in spirit to AlphaEvolve-style scaffolds, but targets optimizing prompts of compound LLM systems via LLM-based reflection while maintaining a Pareto set of strong-but-diverse candidates. Related directions also explore evolutionary refinement directly in language space ( 15 ) , including mechanisms that evolve mutation operators or generation policies ( 12 ) . Reflection-guided evolutionary dynamics have also been studied ( 37 ) . Recent work has introduced open-source island-based evolutionary frameworks, including OpenEvolve ( 30 ) and ShinkaEvolve ( 20 ) . While OpenEvolve follows AlphaEvolve closely, ShinkaEvolve targets sample efficiency through improved parent sampling, rejection-sampled code rewrites, and adaptive LLM ensembles. CodeEvolve ( 3 ) similarly studies LLM-guided program evolution within an island-based genetic algorithm framework. SOAR ( 27 ) studies self-improving evolutionary program synthesis via hindsight fine-tuning, while DeltaEvolve ( 16 ) explores context-efficient evolutionary updates. Complementary work studies progress-aware evolution ( 36 ) . However, these existing methods rely on largely fixed resource allocation decided before evolution. AdaEvolve instead introduces an adaptive evolutionary framework that dynamically regulates the exploration-exploitation tradeoff and mitigates progress stagnation without manual threshold tuning. Variants such as ThetaEvolve ( 34 ) , FLEX ( 5 ) and TTT-Discover ( 38 ) explore learning-based adaptations, whereas our work focuses on inference-only evolutionary scaffolds. Adaptive Optimization and Control. Adaptive Gradient Methods in continuous optimization, such as Adam ( 17 ) , RMSProp ( 29 ) , and AdaGrad ( 11 ) , utilize exponential moving averages of gradient moments to normalize updates. AdaEvolve applies a similar principle to discrete search by using the trajectory of fitness improvements as a gradient analogue. 6 used a tournament-based evolutionary algorithm with syntactic mutations to discover optimization algorithms, finding the Lion optimizer. Adaptive Operator Selection (AOS) ( 13 ) approaches traditionally assign credit to mutation operators based on recent performance. Related work also studies structured context evolution and adaptation mechanisms ( 40 ; 32 ) . In contrast, AdaEvolve proposes a unified adaptive paradigm for the open-ended semantic space of LLMs: rather than selecting between fixed operators, our system uses a unified improvement signal to dynamically modulate search intensity, global resource budget, and meta-level guidance. This formulation elevates adaptation to higher levels of the optimization hierarchy, allowing the system to autonomously regulate exploration-exploitation dynamics and replace brittle static schedules of prior frameworks. 3 The AdaEvolve Framework 3.1 Problem Formulation We formalize LLM-driven program synthesis as a hierarchical optimization problem. The objective is to maximize a fitness function \mathcal{F}:\mathcal{P}\to\mathbb{R} over a discrete space of executable programs \mathcal{P} , subject to a computational budget B (which may be measured in iterations or LLM calls). The search is distributed across a dynamic set of K parallel subpopulations, which we call islands . Each island operates asynchronously, maintaining its own local archive of programs, denoted as \mathcal{D}=\{D_{1},\dots,D_{K}\} . At any time step t , an island k executes an evolutionary cycle: 1) Selection: Sample a parent program p from the island’s archive D_{k} 2) Mutation: Use an LLM to generate a child program p^{\prime} 3) Evaluation: Compute the child’s fitness f^{\prime}=\mathcal{F}(p^{\prime}) 4) Update: Add p^{\prime} to the archive D_{k} and update the adaptive state AdaEvolve controls this iterative process. A critical distinction of AdaEvolve is the elimination of manual configuration. Unlike prior frameworks that require users to tune complex configuration files prior to a run (e.g., exploration rates, island counts, prompt templates), AdaEvolve treats these as internal dynamic variables. The only inputs required from the user apart from the evaluator and problem specification are the model name and the total iteration budget. AdaEvolve modulates the search dynamics through three synchronized feedback loops: Level 1 Local Adaptation (within-island exploration intensity), Level 2 Global Adaptation (across-island resource allocation), and Level 3 Meta-Guidance for generating new solution tactics. 3.2 Level 1: Local Adaptation (Within Island Exploration Intensity) Within each island, the fundamental challenge is balancing exploration (searching new regions of the fitness landscape) with exploitation (refining promising solutions). Rather than using a fixed ratio, AdaEvolve continuously adapts this value based on the island’s recent productivity. The Accumulated Improvement Signal. For each island k , we track a scalar signal G_{t}^{(k)} that summarizes the island’s recent improvement history. When a new program p^{\prime} is generated by an LLM mutation operator, we evaluate its fitness as f^{\prime} and compute a normalized improvement magnitude: \displaystyle\delta_{t}^{(k)}=\max\left(\frac{f^{\prime}-f^{*}_{k}}{f^{*}_{k}},0\right) (1) Here, f^{*}_{k} denotes the current best of island k . This normalization makes the signal scale-invariant, helping the algorithm generalize across different use-cases. The accumulated improvement signal is then updated as an exponential moving average of squared improvements: \displaystyle G_{t}^{(k)}=\rho\cdot G_{t-1}^{(k)}+(1-\rho)\cdot(\delta_{t}^{(k)})^{2} (2) where \rho\in[0,1) is a decay factor. During periods of stagnation, (where f^{\prime}\leq f^{*}_{k} ), \delta_{t}=0 , so G_{t}^{(k)}=\rho G_{t-1}^{(k)} , and the signal decays exponentially. Thus, the accumulated improvement signal G_{t}^{(k)} acts as a real-time volatility metric: high values indicate a productive trajectory (“steep gradient”), while low values indicate convergence or stagnation. Dynamic Exploration Intensity. We use G_{t}^{(k)} to compute the exploration intensity I_{t}^{(k)}\in[I_{\min},I_{\max}] that acts as the probability of exploration: \displaystyle I_{t}^{(k)}=I_{\min}+\frac{I_{\max}-I_{\min}}{1+\sqrt{G_{t}^{(k)}+\epsilon}} (3) where I_{\min} and I_{\max} are hyperparameters defining the range of exploration probabilities (we use I_{\min}=0.1 and I_{\max}=0.7 ). High G_{t}^{(k)} indicates that the island k is productive at iteration t , so we have I_{t}^{(k)}\to I_{\min} , favoring exploitation of the current productive trajectory. Conversely, low G_{t}^{(k)} indicates stagnation, so we have I_{t}\to I_{\max} , increasing exploration to escape local optima. At each iteration, we sample the search mode stochastically: with probability I_{t} , the algorithm does exploration and with probability 1-I_{t} the algorithm does exploitation . During exploration, the parents are selected uniformly at random from the islands archive, and we use an exploration prompt that encourages more orthogonal solutions compared to the sampled programs from the island’s archive. During exploitation, parents are selected with proportion to their fitness values, and the mutation operator is prompted to do refinements on the sampled programs. 3.3 Level 2: Global Adaptation (Across Island Resource Allocation) While Level 1 optimizes how each island searches, Level 2 optimizes where the global computational budget is allocated. We model this as a multi-armed bandit problem where each island is an “arm”, and the goal is to route compute to the islands most likely to yield future improvements. Decayed-Magnitude Bandit-Based Island Selection. A naive bandit approach using each island’s local improvement ( \delta_{t}^{(k)} ) as the reward signal fails as it biases selection toward islands with low baseline fitness making trivial refinements (this can also be called as “poor island bias”). Consider the following example: Island 1 at fitness 100 finds a +10 improvement, yielding \delta^{(1)}=0.10 . Island 2 at fitness 1 finds a +0.5 improvement, yielding \delta^{(2)}=0.50 . A bandit using these rewards would favor Island 2 despite Island 1’s improvement being more valuable globally. To resolve this, AdaEvolve normalizes bandit rewards by the global best fitness f^{*}_{\text{global}} (the best across all islands) rather than each island’s local best. When island k improves from f_{k}^{*} to f^{\prime} , the bandit reward r_{t}^{(k)} for an improvement on island k is defined as: \displaystyle r_{t}^{(k)}=\frac{f^{\prime}-f_{k}^{*}}{f^{*}_{\text{global}}} (4) This ensures resources are directed toward globally significant progress; a unit of improvement is valued equally regardless of which island produces it. To prevent islands that are currently stale but had early breakthroughs from dominating allocation decisions, we maintain decayed cumulative rewards R^{(k)} and decayed visit counts V^{(k)} for each island, updated at each iteration as: \displaystyle R_{t}^{(k)} \displaystyle=\rho\cdot R_{t-1}^{(k)}+r_{t}^{(k)},\quad V_{t}^{(k)}=\rho\cdot V_{t-1}^{(k)}+1 (5) We select islands using an Upper Confidence Bound (UCB). Let n_{k} denote the visit count for island k , and N=\sum_{k}n_{k} the total iterations. The selection rule is: \displaystyle k^{*}=\argmax_{k}\left[\frac{R_{k}}{V_{k}}+C\sqrt{\frac{\ln N}{n_{k}}}\right] (6) where C=\sqrt{2} is the exploration constant for the island selection. The ratio R_{k}/V_{k} reflects recent productivity rather than lifetime productivity. Any island with V^{(k)}=0 must be visited at least once. If multiple unvisited islands exist, they are selected uniformly at random. Migration Across Islands. Every M iterations, islands exchange their top programs via ring migration: island k sends its best programs to island \left((k+1)\mod K\right) . Migrated programs update the receiving island’s local best f_{k}^{*} and accumulated signal G^{(k)} (ensuring correct intensity adaptation), but they do not update UCB statistics since the receiving island did not generate the improvement. Dynamic Island Spawning. AdaEvolve dynamically creates new islands when the productivity across all islands stagnates. In particular, when G_{t}^{(k)}\leq\tau_{S} for all islands k at an iteration t for some island spawning threshold \tau_{S} , we decleare all islands stagnated and spawn a new one. In our experiments, we always set \tau_{S}=0.02 for all experiments and show that it is able to get us SOTA results in almost all 180+ problems. In general, islands maintain diversity through isolation and infrequent migration. However, unlike other frameworks that typically use a fixed number of islands, we show that creating new subpopulations adaptively based on need of stagnation improves resource allocation. AdaEvolve uses the current islands until improvement stops and then initializes a new island with a randomly sampled seed program from the archive to explore alternative solutions. 3.4 Level 3: Meta-Guidance (Solution Tactics Generation) If numerical adaptation (Level 1) and resource reallocation (Level 2) fail to yield progress, it implies the search is trapped in a conceptual local optimum: the code is optimized, but the underlying algorithm is suboptimal. Level 3 addresses this by generating solution tactics: high-level algorithmic directives that force a qualitative shift in the search trajectory. When global stagnation is detected, AdaEvolve triggers a “System 2” meta-analysis. This Meta-Guidance for generating solution tactics get triggered when G_{t}^{(k)}\leq\tau_{M} for all islands k at an iteration t for some island Meta-Guidance threshold \tau_{M} . In our experiments, we always set \tau_{M}=0.12 for all experiments. In this level of adaptation, AdaEvolve invokes a separate LLM to analyze the problem specification, evaluator, and recent failed attempts. This meta-analysis identifies why current approaches are insufficient and proposes alternative strategies (e.g., “switch from greedy selection to dynamic programming”). These tactics are then injected into mutation prompts, transforming the task from open-ended improvement to targeted implementation of a specific strategy. If a solution tactic fails to yield progress, the system rotates to alternatives before eventually generating new tactics. This provides a mechanism for escaping solution-space bottlenecks that numerical adaptation alone cannot resolve . We examples of different Meta-Guidance generations in Table 5 . 3.5 Algorithm Summary Algorithm 1 presents the complete procedure. The three levels operate at different timescales: intensity adapts every iteration, island selection operates across iterations, and Meta-Guidance generation triggers when numerical adaptation alone proves insufficient. The additional subroutines in Algorithm 1 are explained in Section A.1 . For island k at iteration t : G_{t}^{(k)} is the accumulated improvement signal, f_{k}^{*} is the local best fitness, f^{*}_{\text{global}} is the best fitness score across all islands, R_{t}^{(k)} and V_{t}^{(k)} are the decayed reward and visit counts, and n_{k} is the raw visit count. Algorithm 1 AdaEvolve – Main Loop 1: Initial program p_{0} , evaluator \mathcal{F} , budget T , starting num of islands K , LLM M 2: Initialize \forall k\in\{1,\ldots,K\} : 3: G_{0}^{(k)}\leftarrow 0 , R_{0}^{(k)}\leftarrow 0 , V_{0}^{(k)}\leftarrow 0 , n_{k}\leftarrow 0 4: f_{k}^{*}\leftarrow\mathcal{F}(p_{0}) , D_{k}\leftarrow\{p_{0}\} 5: f^{*}_{\text{global}}\leftarrow\mathcal{F}(p_{0}) , \mathcal{T}=\emptyset 6: for t=1 to T do 7: // Level 2: Select island via UCB 8: k\leftarrow\textsc{SelectIsland}(t) \triangleright Eq. 6 9: // Level 1: Compute intensity 10: I_{t}^{(k)}\leftarrow I_{\min}+\frac{I_{\max}-I_{\min}}{1+\sqrt{G_{t-1}^{(k)}+\epsilon}} \triangleright Eq. 3 11: // Sample and mutate 12: p , inspires \leftarrow Sample ( {D}_{k} , I_{t}^{(k)} ) \triangleright Alg. 3 13: prompt \leftarrow ContextBuilder ( p , inspires, \mathcal{T} ) \triangleright Alg. 4 14: p^{\prime} \leftarrow Mutate ( M , prompt) \triangleright Alg. 5 15: f^{\prime}\leftarrow\mathcal{F}(p^{\prime}) 16: D_{k}\leftarrow D_{k}\cup\{p^{\prime}\} 17: // Update adaptive state 18: UpdateState ( k , f^{\prime} ) \triangleright Alg. 6 19: // Level 3: Meta-control 20: if GloballyStagnant () \land paradigm = None then 21: \mathcal{T} \leftarrow GenerateParadigm () \triangleright Alg. 2 22: end if 23: end for 24: return \argmax_{p}\mathcal{F}(p) over all archives 4 Experiments We evaluate AdaEvolve on 185 different algorithm design/ optimization problems. These problems are from: mathematical optimization problems (6) discussed in Section 4.2 ; real-world system optimization problems (7) from the ADRS benchmark suite discussed in Section 4.3 ; open-ended challenging algorithm design problems (172) from Frontier-CS benchmark suite discussed in Section 4.4 . We also report numbers on the ARC-AGI-2 task in Appendix C . In all these benchmarks, we demonstrate that AdaEvolve outperforms strong baselines over diverse benchmarks. In Section 4.5 , we provide ablation studies demonstrating the contributions of different components of the AdaEvolve algorithm via comprehensive analysis on two benchmarks. Finally, in Section 4.6 , we provide case studies of different regimes where the combined adaptivity levels and Meta-Guidance yield the largest gains. 4.1 Experimental Setup For the mathematical optimization/algorithm development experiments in Section 4.2 and ADRS benchmark in Section 4.3 , all methods are evaluated using the same backbone model GPT-5 and Gemini-3-Pro, the same evaluator for the fitness scoring, and total iteration budget of T=100 iterations. We report the mean \pm standard deviation over three independent runs as well as the best of these three runs. Because of the great number of problems in Frontier-CS benchmark discussed in Section 4.4 , we use GPT-5 for all the methods across the 172 problems in that benchmark, and run each model for the same number of 50 LLM calls. We compare AdaEvolve against the SOTA evolutionary algorithms with open-source codebases, which are GEPA, ShinkaEvolve and OpenEvolve (introduced in Section 2 ). Whenever applicable, we also report the results of AlphaEvolve and the best human-made results on these benchmarks. 4.2 Mathematical Optimization Benchmarks Table 1 reports results on six mathematical combinatorial optimization problems. These tasks span a range of optimization regimes, from relatively smooth objectives to highly deceptive landscapes with many poor local optima. A description of these problems are provided in Table 7 . Figure 2 : Comparison of the evolutionary algorithms on Circle Packing (Square n=26 ) and Heilbronn Triangles ( n=11 ) problems using GPT-5 backbone for all of them. n is a parameter of the optimization problems we explain in Table 7 . Table 1 : Mathematical optimization benchmarks. We report Mean \pm Std and Best (Max) objective values. Higher is better for all metrics. Bold denotes the best performing method per backbone. Underline denotes results surpassing Human SOTA . ( N values: Square=26, Rect=21, Tri=11, Convex=13, Max=3). The detailed explanations are given in Table 7 . For circle packing (rect) problem with Gemini, AdaEvolve gets 2.36583237, beating the AlphaEvolve reference of 2.36583213. For circle packing (square) problem with Gemini, AdaEvolve gets 2.63598308, beating the AlphaEvolve reference of 2.63586276. Circle Packing (Square) Circle Packing (Rect) Heilbronn (Triangles) Heilbronn (Convex) MinMax Distance Signal Processing Strategy Avg Best Avg Best Avg Best Avg Best Avg Best Avg Best Human – 2.634 – 2.364 – 0.0360 – 0.0306 – 0.2399 – – AlphaEvolve – 2.635 – 2.3658 – 0.0365 – 0.0309 – 0.2398 – – Backbone: GPT-5 OpenEvolve 2.531 \pm .018 2.541 2.267 \pm .014 2.276 0.028 \pm .006 0.028 0.025 \pm .005 0.027 0.226 \pm .003 0.2243 0.569 \pm .047 0.622 GEPA 2.613 \pm .022 2.628 2.326 \pm .023 2.354 0.031 \pm .002 0.032 0.025 \pm .002 0.027 0.232 \pm .120 0.2392 0.689 \pm .014 0.705 ShinkaEvolve 2.464 \pm .083 2.541 2.335 \pm .026 2.358 0.032 \pm .012 0.034 0.023 \pm .005 0.026 0.239 \pm .001 0.2398 0.485 \pm .044 0.533 AdaEvolve 2.629 \pm .001 2.636 2.349 \pm .010 2.361 0.033 \pm .001 0.036 0.027 \pm .001 0.029 0.239 \pm .009 0.2404 0.698 \pm .017 0.718 Backbone: Gemini-3-Pro OpenEvolve 2.541 \pm .000 2.541 2.365 \pm .001 2.366 0.033 \pm .000 0.035 0.028 \pm .009 0.028 0.240 \pm .000 0.2398 0.553 \pm .015 0.565 GEPA 2.620 \pm .002 2.621 2.216 \pm .046 2.232 0.031 \pm .002 0.033 0.023 \pm .001 0.027 0.213 \pm .008 0.2178 0.617 \pm .075 0.680 ShinkaEvolve 2.622 \pm .012 2.636 2.366 \pm .000 2.366 0.035 \pm .001 0.036 0.028 \pm .001 0.029 0.240 \pm .000 0.2398 0.480 \pm .039 0.505 AdaEvolve 2.632 \pm .003 2.636 2.366 \pm .000 2.366 0.036 \pm .001 0.036 0.029 \pm .000 0.029 0.240 \pm .000 0.2404 0.593 \pm .009 0.603 Results. Across all problems in Table 1 , AdaEvolve achieves the best results over other open-source baselines and sometimes exceeds the results of the Human/AlphaEvolve solutions. The largest gains appear on problems with deceptive fitness landscapes, such as Heilbronn Triangle and MinMaxDist , where fixed-policy baselines (OpenEvolve, GEPA, and ShinkaEvolve) frequently plateau after early progress. We show the comparison of these methods in Figure 2 and an illustration of the best programs for the Circle Packing (square) problem generated by GPT-5 for all the open-source methods in Figure 3 . Note that we ran longer (150 total LLM calls), GEPA also reaches 2.63598 in Circle Packing (square) . Figure 3 : GPT-5 best configurations comparisons for the Circle Packing experiment. 4.3 ADRS Systems Benchmarks Table 2 : Comparison on Systems & Data benchmarks. We report Mean \pm Std and Best . Higher is better for all metrics except Cloudcast ( \downarrow ). Bold indicates best automated strategy. Underline indicates results surpassing Human SOTA . Detailed explanations of these benchmarks are given in Table 6 . Telemetry Cloudcast \downarrow EPLB Prism LLM-SQL TXN NS3 Strategy Avg Best Avg Best Avg Best Avg Best Avg Best Avg Best Avg Best Human / SOTA – 0.822 – 626.2 – 0.1265 – 21.89 – 0.692 – 2,725 – 69.0 Backbone: GPT-5 OE .930 \pm .04 .952 926.9 \pm 171 729.8 .127 \pm .00 .1272 26.23 \pm .00 26.23 .710 \pm .01 .716 4,239 \pm 90 4,329 92.2 \pm 4.8 97.3 GEPA .916 \pm .05 .948 689.9 \pm 74 645.7 .134 \pm .01 .1445 26.19 \pm .07 26.23 .713 \pm .00 .713 3,753 \pm 204 3,984 68.9 \pm .00 101.8 Shinka .923 \pm .04 .952 954.8 \pm 125 812.7 .118 \pm .01 .1272 26.26 \pm .00 26.26 .712 \pm .00 .713 4,090 \pm 338 4,329 89.5 \pm 18.7 106.1 AdaEvolve .952 \pm .00 .952 662.3 \pm 0.1 640.5 .134 \pm .01 .1453 26.30 \pm .07 26.37 .746 \pm .03 .775 4,317 \pm 29 4,348 125.2 \pm 6.1 131.8 Backbone: Gemini-3-Pro OE .954 \pm .01 .960 707.8 \pm 40 667.1 .127 \pm .00 .1272 26.24 \pm .01 26.24 .729 \pm .01 .736 4,109 \pm 254 4,274 115.2 \pm 13.2 125.6 GEPA .850 \pm .00 .855 720.4 \pm 46 667.1 .127 \pm .00 .1272 26.16 \pm .03 26.19 .713 \pm .00 .713 3,616 \pm 481 4,167 74.5 \pm 9.5 104.0 Shinka .918 \pm .03 .933 949.8 \pm 73 892.3 .120 \pm .01 .1272 26.25 \pm .01 26.26 .721 \pm .00 .721 3,932 \pm 343 4,255 84.7 \pm 7.7 92.2 AdaEvolve .953 \pm .01 .960 642.1 \pm 5.9 637.1 .145 \pm .00 .1453 26.26 \pm .00 26.26 .743 \pm .01 .752 4,221 \pm 89 4,310 126.0 \pm 5.1 131.8 Table 2 reports results on seven real-world systems optimization tasks from the ADRS 7 benchmark suite. ADRS includes various tasks such as developing MoE expert balancing (Expert Parallelism Load Balancing - EPLB) problems, transaction scheduling problems or algorithm design for minimizing the cost of multi-cloud data storage problems. These tasks involve expensive evaluations, noisy feedback, and heterogeneous objective scales, making fixed exploration schedules and static resource allocation brittle. Results. AdaEvolve achieves the strongest aggregate performance, winning on all seven tasks across both GPT-5 and Gemini-3-Pro model backbones. The largest gains occur on tasks characterized by sparse or bursty improvements, such as TXN , CBL , and CBL-Multi , where fixed strategies either over-exploit early trajectories or fail to reallocate resources after prolonged stagnation. For example, on TXN with GPT-5, AdaEvolve improves performance from 4329 to 4348, while fixed baselines plateau early. On tasks with smoother reward signals, including Prism and LLM-SQL , performance differences are smaller, and AdaEvolve matches or slightly improves upon the strongest fixed baselines. This indicates that adaptivity does not harm performance when static strategies are already well-aligned with the task. Importantly, performance trends are consistent across backbones: relative rankings among methods are largely preserved between GPT-5 and Gemini-3-Pro, suggesting that the gains from adaptive control do not depend on backbone-specific behavior. These results show that adaptive optimization is particularly effective for real-world systems tasks with tight evaluation budgets and infrequent high-magnitude improvements. 4.4 Frontier-CS We also evaluate our framework on Frontier-CS 25 , a challenging benchmark comprised of 172 open-ended computer science problems, ranging from algorithmic optimization to research-level systems tasks, where the global optima are unknown and solutions are evaluated via executable programs rather than static outputs. We used the same GPT-5 model in all methods with equal number (50) of LLM calls. We also include the result of GPT-5 (single-model) model to demonstrate the remarkable capability of these scaffolds, with AdaEvolve increasing mean performance by 3x. Note that due to the hardness of these problems, GPT-5 with single calls gets Median score of 0, meaning more than half of the solutions score 0, showing the necessity of such search algorithms like AdaEvolve. Method Mean Median AdaEvolve \mathbf{61.33} \mathbf{75.15} OpenEvolve 50.75 56.37 ShinkaEvolve 47.79 46.22 GEPA 43.04 33.68 GPT-5 (single call) 20.64 0.0 Table 3 : Frontier-CS Benchmark Results Figure 4 : Score distribution comparison across methods on the Frontier-CS benchmark. 4.5 Ablations We evaluate the contribution of levels of adaptation in AdaEvolve. First, we disable Level 1: Local Adaptation by disabling the intra-island search intensity adaptation based on the improvement signals. Instead, we use fixed 30% exploration and 70% exploitation probabilities as in default OpenEvolve configs. Second, we ablate different features of Level 2: Global Adaptation . First, we disable the bandit based island selection algorithm and replace it by simple round robin based island selection algorithm but keep spawning islands. We also test the dynamic island spawning idea by having a fixed number of 2 islands and 5 islands, respectively. Finally, we ablate Level 3: Meta-Guidance by disabling the generation of new solution tactics as guidance signals to the system. The ablations over Circle Packing and Signal Processing problems show that AdaEvolve benefits from all different adaptive features introduced. Meta-Guidance type of adaptation where we produce additional reflection and guidance to the LLM mutation operators during times of stagnation seem to be the most helpful feature, we its loss causes the worst results in both problems. On the other hand, bandit-based island selection seem to be more helpful for signal processing whereas local adaptation seem to be more helpful for circle packing. Fixed island experiments also indicate that having islands spawn dynamically helps allocate resources better iterations and target stagnations. Table 4 : Ablation results on circle packing and signal processing tasks. We report the mean and standard deviation of 3 runs. Ablation Setting Circle Packing Signal Processing AdaEvolve \mathbf{2.6294\pm 0.003} \mathbf{0.7178\pm 0.019} w/o Local Adaptation 2.5906\pm 0.048 0.6807\pm 0.021 w/o Adaptive Island Selection 2.6180\pm 0.005 0.619\pm 0.0541 w/o Meta-Guidance 2.5213\pm 0.028 0.5476\pm 0.011 Fixed 2 Islands 2.6187\pm 0.007 0.5512\pm 0.024 Fixed 5 Islands 2.5891\pm 0.018 0.6085\pm 0.081 4.6 Case studies: AdaEvolve runtime adaptations (a) Signal processing run with annotations. (b) Circle packing run with annotations. Figure 5 : AdaEvolve adapts search behavior across tasks. (Left) Signal Processing: exploration transitions to refinement as improvement signals accumulate. (Right) Circle Packing: the evolved strategy breaks stagnation and drives near-optimal layouts. We also present some detailed case studies on signal processing and circle packing tasks for AdaEvolve using the GPT-5 model as a backbone to illustrate how different adaptive components of the algorithm benefits mitigating local search minimas 4.6.1 Signal Processing We study the signal processing task from 30 , which requires synthesizing a causal filtering program for a noisy, non-stationary time series. Performance is measured by a combined objective capturing fidelity, smoothness, lag, and false trend changes. Figure 5(a) shows the best-so-far score of AdaEvolve improving from 0.4990 to 0.7177 within 64 iterations (+43.8%). Early in search, the accumulated improvement signal G_{t}^{(k)} remains near zero, inducing high search intensity and exploration-dominant sampling within islands. Parents are selected primarily for diversity, yielding only modest gains ( 0.4990\rightarrow 0.5115 by iter 10). As improvements accumulate, G_{t}^{(k)} increases and sampling shifts toward refinement of higher-performing parents. At iter 14, refinement using Savitzky–Golay smoothing produces a sharp improvement from 0.5210 to 0.5862 (+14.6%). As productivity becomes uneven across islands, UCB-based island selection allocates a larger fraction of iterations to the most productive island. Periodic ring migration propagates strong programs across islands, enabling continued refinement. At iter 45, refinement using an alternative low-pass operator improves performance to 0.6674 , with further gains to 0.6716 by iter 51. Dynamic island spawning is not triggered in this run, as global improvement remains non-zero. When numerical refinement begins to saturate, AdaEvolve activates Meta-Guidance. The meta prompt conditions mutation on the evaluator structure and recent failure patterns, introducing alternative smoothing operators. This enables spline-based smoothing to be explored, yielding a final improvement to 0.7177 at iter 64 (+6.9%). 4.6.2 Circle Packing Next, we study the circle packing task, which seeks to pack N disjoint circles inside a unit square so as to maximize the sum of their radii. Figure 5(b) plots the best-so-far score achieved by AdaEvolve over optimization iterations. The score improves from 0.9598 at initialization to 2.636 by iter 65 (+173.4%). At the start of search, two islands run in parallel under adaptive exploration–exploitation, with early sampling biased toward exploration. At iter 1, random initialization discovers a dense feasible layout, improving the score from 0.9598 to 2.4390 (+154.2%). Subsequent local refinement improves this layout to 2.5414 by iter 7, after which progress stalls between iters 7 and 15. At iter 15, global stagnation triggers Meta-Guidance, which injects an optimization-based refinement tactic. This enables continuous optimization over circle positions using SLSQP. At iter 16, exploitation applies this solution tactic to a strong layout, improving the score from 2.5414 to 2.6095 (+2.7%). In contrast, runs without meta guidance remain stuck near 2.514 . Further constraint-aware refinement improves performance to 2.6121 by iter 20, and migration propagates these improved layouts across islands. After iter 30, sampling shifts decisively toward exploitation, concentrating search pressure on refining the best layouts rather than exploring new configurations. Local refinement of a hex-staggered configuration improves the score from 2.6121 to 2.6228 (+0.4%), with additional fine-grained refinements yielding 2.6229 at iter 32 and 2.6233 at iter 40. Migration at iters 45 and 60 continues to propagate the strongest layouts. Sampling remains exploitation-heavy, with local refinement focused on closing the remaining gap. Small but consistent gains are achieved at iter 55 ( 2.6236 ) and iter 65 ( 2.636 ), after which no further improvement is observed, indicating convergence. 5 Conclusion In this work, we present AdaEvolve, an adaptive evolutinary framework that only uses the fitness scores of an objective to optimize program generation for diverse algorithmic and real life systems problems. By unifying local exploration for different subpopulations of solutions, global resource routing and meta-level strategy generation under a single adaptive controller that uses the accumulated improvement signals of the past programs in the evolutionary process, our method can adapt to the non-stationary dynamics of new algorithm discovery. Across 185 algorithm design and optimization problems, spanning 6 mathematical optimization, 7 ADRS systems tasks, and 172 algorithm design tasks from the Frontier-CS benchmark suite, we show that AdaEvolve consistently outperforms open sourced baselines and often match or exceed the best human or AI generated solutions including proprietary models like AlphaEvolve. Appendix A AdaEvolve Implementation Details A.1 AdaEvolve Algorithm Subroutines Here we include the subroutines mentioned in Algorithm 1 , which are Algorithm 2 , Algorithm 3 , Algorithm 5 , and Algorithm 6 explained below. Algorithm 2 GenerateSolutionTactics 1: Global best program p^{*}_{\text{global}} ; best score f^{*}_{\text{global}} ; list of past tactics \mathcal{T} tried with scores; problem specification S ; evaluator code E ; system message S_{\text{tactic}} 2: \mathsf{prompt}\leftarrow\textsc{ComposePrompt}(S,E,p^{*}_{\text{global}},f^{*}_{\text{global}},\mathcal{T}) 3: \mathsf{response}\leftarrow\textsc{LLM}(S_{\text{tactic}},\mathsf{prompt}) 4: \mathcal{T}_{\mathrm{new}}\leftarrow\textsc{Parse}(\mathsf{response}) 5: \mathcal{T}\leftarrow\mathcal{T}\cup\mathcal{T}_{\mathrm{new}} 6: return \mathcal{T}_{\mathrm{new}} Algorithm 3 Sample – Adaptive Parent Selection 1: Archive A , intensity I 2: u\sim\text{Uniform}(0,1) 3: if uf_{k}^{*} then 4: \delta\leftarrow(f_{\text{child}}-f_{k}^{*})/(|f_{k}^{*}|+\epsilon) // local norm. 5: G_{t}^{(k)}\leftarrow\rho\cdot G_{t-1}^{(k)}+(1-\rho)\cdot\delta^{2} 6: r\leftarrow(f_{\text{child}}-f_{k}^{*})/(|f^{*}_{\text{global}}|+\epsilon) // global norm. 7: f_{k}^{*}\leftarrow f_{\text{child}} 8: if f_{\text{child}}>f^{*}_{\text{global}} then 9: f^{*}_{\text{global}}\leftarrow f_{\text{child}} 10: end if 11: else 12: G_{t}^{(k)}\leftarrow\rho\cdot G_{t-1}^{(k)} // decays during stagnation 13: end if 14: R_{t}^{(k)}\leftarrow\rho\cdot R_{t-1}^{(k)}+r ; V_{t}^{(k)}\leftarrow\rho\cdot V_{t-1}^{(k)}+1 ; n_{k}\leftarrow n_{k}+1 A.2 AdaEvolve Prompts We report the prompts used by AdaEvolve. Mode context — Exploitation –PARENT SELECTION CONTEXT This parent was selected from the archive of top-performing programs. It has demonstrated strong performance, but there is likely still room for significant improvement. –OPTIMIZATION GUIDANCE - This solution works well, but don’t assume it’s optimal - meaningful improvements are still possible - You may refine the existing approach OR introduce better algorithms if you identify a clear opportunity - Consider: algorithmic improvements, better data structures, more efficient libraries, parallelization - Optimizations like vectorization, caching, and numerical stability improvements are valuable - If you see a fundamentally better approach, pursue it - but ensure correctness is maintained - Think critically: what assumptions does this solution make? Can they be relaxed or improved? –PARENT METRICS {metrics_str} Your goal: Improve upon this solution - whether through refinement or strategic redesign. Mode context — Exploration –PARENT SELECTION CONTEXT This parent was selected through diversity-driven sampling to explore different regions of the solution space. It may or may not represent optimal performance. –EXPLORATION GUIDANCE - Consider alternative algorithmic approaches or techniques - Experiment with different methods or approaches - Don’t be constrained by the parent’s approach - it’s a starting point, not a template - Look for opportunities to try fundamentally different algorithms or novel techniques - Balance creativity with correctness - new ideas should still produce valid solutions –PARENT METRICS {metrics_str} Your goal: Discover new approaches that might outperform current solutions. Solution Tactics (injected into evolution user message) –BREAKTHROUGH IDEA - IMPLEMENT THIS The search has stagnated globally. You MUST implement this breakthrough idea: **IDEA:** {idea} **HOW TO IMPLEMENT:** {description} **TARGET METRIC:** {what_to_optimize} **CAUTIONS:** {cautions} **APPROACH TYPE:** {approach_type} **CRITICAL:** - You MUST implement the breakthrough idea - Ensure the tactics are actually used in your implementation (not just mentioned in comments) - Correctness is essential - your implementation must be correct and functional - Verify output format matches evaluator requirements - Make purposeful changes that implement the idea - Test your implementation logic carefully Tactics generator — system message ( S_{\text{tactics}} ) You are an expert algorithm researcher proposing breakthrough (high-leverage) ideas. First, deeply analyze the evaluator code to infer: the true objective, constraints/validations, failure modes, and what is actually rewarded or penalized. Then analyze the current best program to identify the algorithmic approach, why it works, and the specific bottlenecks preventing further improvement. Propose only ideas that are correct, implementable under the available libraries, and likely to improve the score. Each idea must be fundamentally different from previously tried failures, and must explicitly target a distinct weakness or metric revealed by the evaluator. Prefer simple, robust mechanisms over complex pipelines. Avoid suggesting vague directions: name concrete techniques, functions, and key parameters. Stage 1 — Understand the evaluation signal. Carefully read the evaluator code to determine what is actually being optimized: the primary objective, any secondary metrics, constraints, validation rules, and sources of penalties or failure. Identify which quantities the program can influence and which are fixed by the evaluator. Stage 2 — Analyze the current best program. Study the current best program before proposing new ideas. Identify the algorithmic approach it uses, why it achieves the current best score, and what structural or algorithmic limitations are preventing further improvement. Focus on concrete bottlenecks rather than superficial weaknesses. Stage 3 — Account for past attempts. Review previously tried tactics and their outcomes. Do not repeat failed approaches or close variants. If an approach failed, reason about the underlying cause (e.g., mismatch to problem structure, constraint violations, instability) and avoid that class of ideas unless the root cause is explicitly addressed. Stage 4 — Propose diverse tactics. Generate multiple ideas that are fundamentally different from one another. Each idea must be correct with respect to the evaluator, implementable with available libraries, and explicitly target a distinct weakness or metric identified in earlier stages. Each proposal should include a clear explanation of why it is likely to improve the score. Stage 5 — Make ideas concrete and robust. Be specific and actionable: name exact libraries, functions, methods, and key parameters. Prefer simple, robust mechanisms over complex multi-stage pipelines. Anticipate edge cases, numerical issues, and constraint handling. Stage 6 — Sanity-check before answering. Before finalizing, verify that each idea is feasible, non-redundant with past failures, sufficiently diverse, and aligned with what the evaluator truly rewards. A.3 Solution Tactics Generates Examples We present examples in Table 5 for tactics generated for different use cases. Table 5: Example tactics produced by the tactic generator across domains. Each tactic pairs a high-level solution strategy with a representative computational approach. Use case Meta-Guidance Solution Tactics Approach type Math / equation systems Solve nonlinear systems using a trust-region root finder scipy.optimize.root Exploit structure by directly solving linear systems scipy.linalg.solve Isolate scalar roots with bracketed search scipy.optimize.brentq Iterate toward equilibrium with damped fixed-point updates Fixed-point iteration Generate symbolic expressions before numerical evaluation sympy.lambdify + solver Continuous optimization Perform constrained minimization under geometric constraints scipy.optimize.minimize (SLSQP) Escape poor basins via multi-start global search Multi-start + local refine Initialize layouts using Voronoi structure, then refine locally Voronoi + optimizer Enforce feasibility through convex-hull constraints scipy.spatial.ConvexHull Optimize box-constrained parameters with quasi-Newton updates L-BFGS-B Combinatorial / assignment Construct solutions greedily using score-ordered candidates Greedy heuristic Compute minimum-cost matchings exactly Linear sum assignment Improve configurations through swap-based neighborhoods Local search Relax discrete constraints into a linear program scipy.optimize.linprog Prioritize decisions with a score-driven heap Priority-queue greedy Signal / filtering Suppress impulsive noise with median filtering scipy.signal.medfilt Preserve trends via polynomial smoothing Savitzky–Golay filter Balance noise and fidelity with adaptive Wiener filtering Wiener filter Aggregate robust statistics over sliding windows Percentile filter Apply learned structure through custom convolution kernels scipy.ndimage.convolve A.4 Code Structure AdaEvolve architecture: main components Entry and orchestration. The MainController initializes the search by loading configuration, instantiating the AdaEvolve database and manager, inserting the initial program, and invoking a single asynchronous evolution loop. The controller does not directly interact with islands, archives, or adaptation logic. Evolution manager. The AdaEvolveManager owns the evolution loop. At each iteration, it (i) requests a parent and inspirations from the database, (ii) constructs a mode-aware prompt (optionally augmented with sibling, retry, or tactics context), (iii) generates a child program via the LLM, (iv) evaluates the child through the evaluator, and (v) returns results to the database. The manager never manipulates archives or adaptation state directly. Database as system state. The AdaEvolveDatabase is the sole owner of global search state. It encapsulates islands, archives, adaptive signals, migration, spawning, and tactics tracking. All sampling, insertion, and iteration-finalization logic is centralized in the database. Islands and archives. Islands are logical indices. Each island maintains its population via a per-island archive. Archives implement parent sampling, inspiration sampling, elite replacement, and genealogy tracking, but do not perform evaluation or adaptation. Adaptive control. Per-island adaptive state accumulates improvement signals and produces a search intensity that determines exploration, exploitation, or balanced sampling. A global UCB-based adapter selects the next island at the end of each iteration. Adaptation state is updated only when programs are added to the database. Evaluator. The evaluator is owned by the manager and invoked exactly once per generated child. It executes the candidate program, returns metric values, and optionally emits artifacts. The database never calls the evaluator. Tactic mechanism. A tactics tracker monitors global stagnation signals maintained by the database. When triggered, the manager injects a tactics instruction into subsequent prompts. Tactics usage and lifecycle are tracked centrally and updated only on successful additions. Iteration boundary. At the end of each iteration, the manager delegates to the database to finalize state updates, including adaptive updates, island selection, migration, dynamic island spawning, and checkpointing. We outline the overall code organization and the interaction between the controller, islands, archives, and evaluators. Appendix B Benchmark Details We describe the tasks used in evaluation, including objective definitions, evaluation costs, and sources of noise. B.1 ADRS ADRS benchmarks 7 (Table 6 ) comprise real-world systems optimization tasks with discrete design choices, noisy evaluators, and heterogeneous objectives, making them representative and challenging testbeds for adaptive search. Table 6: ADRS systems benchmarks. Each task specifies a concrete systems optimization objective. Task Objective Problem description Telemetry Repair Repair buggy network telemetry pipelines Automatically fix data processing logic to improve correctness and confidence calibration. Cloudcast Optimize multi-cloud data transfer cost Select routing and placement strategies to minimize monetary transfer cost across providers. Expert Parallelism Load Balancer (EPLB) Balance expert-parallel load across GPUs Reduce stragglers by redistributing expert assignments while preserving throughput. Model Placement (Prism) Optimize model-to-GPU placement cost Assign model components to GPUs to minimize global execution cost under capacity constraints. LLM-SQL Reorder tabular data for prefix efficiency Improve prefix-cache hit rates by reordering rows or columns without altering semantics. Transaction Scheduling (TXN) Minimize makespan in transaction execution Schedule dependent transactions to reduce overall completion time. Datacenter TCP Congestion Control (NS3) Maximize throughput and minimize queue latency Tune congestion control behavior under realistic network simulation workloads. B.2 AlphaEvolve Math The AlpaEvolve 26 mathematical problems (Table 7 ) consist of classical combinatorial optimization problems with known formulations, providing controlled testbeds for evaluating search efficiency and convergence behavior. Table 7: Mathematical optimization benchmarks used in AdaEvolve. Each task is defined exactly as in Appendix B of the AlphaEvolve paper. Problem Objective (exact task definition) Circle Packing (Square) N{=}26 Pack N disjoint circles inside a unit square so as to maximize the sum of their radii . Circle Packing (Rectangle) N{=}21 Pack N disjoint circles inside a rectangle of perimeter 4 so as to maximize the sum of their radii . Heilbronn Problem (Triangle) N{=}11 Place N points on or inside a triangle of unit area so that the minimum area of any triangle formed by the points is maximized . Heilbronn Problem (Convex Region) N{=}13 Place N points on or inside a convex region of unit area so that the minimum area of any triangle formed by the points is maximized . MinMax Distance N{=}3 For given N and dimension d , find N points in \mathbb{R}^{d} that maximize the ratio between the minimum and maximum pairwise distances . Signal Processing Optimize a continuous signal processing objective under noisy evaluation, where candidate programs transform an input signal and are scored by an external evaluator. Appendix C AdaEvolve: Additional Results We evaluate AdaEvolve on an additional benchmark family to assess generalization behavior beyond optimization-centric tasks. ARC-AGI-2 Tasks 8 evaluate abstract and compositional reasoning across 120 benchmark instances. Experiments follow the evaluation protocol described in Section 4.1. For ARC-AGI-2, OpenEvolve (OE) and AdaEvolve operate under a matched inference budget, using 30 LLM calls per task for solution evolution on the training split, with final evaluation performed on the test split. Unlike prior optimization benchmarks, ARC-AGI-2 is not explicitly designed for evolutionary search. Moreover, standard ARC evaluation assumes a strict train–test separation, whereas evolutionary frameworks typically perform adaptation at test time. We therefore treat this experiment as an exploratory analysis of cross-domain robustness rather than a direct optimization comparison. Extending evolutionary evaluation protocols to such reasoning benchmarks remains an important direction for future work. Table 8: AdaEvolve performance on ARC-AGI-2 benchmarks. Values denote final accuracy under a matched inference budget. Backbone OpenEvolve AdaEvolve GPT-5 42% 49% Gemini-3-Pro 44% 50% These results suggest that AdaEvolve maintains performance gains even on reasoning-oriented tasks, indicating robustness beyond traditional optimization settings.