What Makes an LLM a Good Optimizer? A Trajectory Analysis of LLM-Guided Evolutionary Search
Xinhao Zhang , Xi Chen , François Portet , Maxime Peyrard · 2026
Read What Makes an LLM a Good Optimizer? A Trajectory Analysis of LLM-Guided Evolutionary Search by Xinhao Zhang , Xi Chen , François Portet , Maxime Peyrard (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-19440.txt.
Introduction
Zhang and colleagues run a large study of LLM-guided evolutionary search, gathering search paths for 15 language models across 8 tasks. Recent work shows promise in orchestrating language models inside evolutionary and agentic optimization systems, yet the drivers of the gains remain poorly understood. Zero-shot problem-solving skill correlates with final outcomes but accounts for just part of the variance. Models with similar starting skill often take very different search paths, and strong optimizers act as local refiners, making frequent small gains while narrowing search in semantic space.
Catalog record
| CREATOR | Xinhao Zhang , Xi Chen , François Portet , Maxime Peyrard |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 67089 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.19440
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
What Makes an LLM a Good Optimizer? A Trajectory Analysis of LLM-Guided Evolutionary Search Xinhao Zhang , Xi Chen , François Portet , Maxime Peyrard Abstract Recent work has demonstrated the promise of orchestrating large language models (LLMs) within evolutionary and agentic optimization systems. However, the mechanisms driving these optimization gains remain poorly understood. In this work, we present a large-scale study of LLM-guided evolutionary search, collecting optimization trajectories for 15 LLMs across 8 tasks. Although zero-shot problem-solving ability correlates with final optimization outcomes, it explains only part of the variance: models with similar initial capability often induce dramatically different search trajectories and outcomes. By analyzing these trajectories, we find that strong LLM optimizers behave as local refiners, producing frequent incremental improvements while progressively localizing the search in semantic space. Conversely, weaker optimizers exhibit large semantic drift, with sporadic breakthroughs followed by stagnation. Notably, various measures of solution novelty do not predict final performance; novelty is beneficial only when the search remains sufficiently localized around high-performing regions of the solution space. Our results highlight the importance of trajectory analysis for understanding and improving LLM-based optimization systems and provide actionable insights for their design and training. 1 Introduction Large language models (LLMs) are increasingly deployed as search operators in iterative optimization systems ( 23 ; 35 ) . Across diverse domains, such as prompt optimization ( 2 ; 17 ; 11 ) and scientific discovery ( 37 ; 8 ; 32 ; 14 ) , LLMs are embedded into evolutionary or agentic loops as black-box optimizers where they repeatedly propose candidate solutions, receive feedback, and refine solutions iteratively. While such LLM-guided evolutionary workflows have been shown to deliver substantial empirical gains, the mechanisms underlying these improvements remain poorly understood. In particular, even under strictly controlled optimization loops, selection rules, and evaluation functions, different LLMs exhibit vastly different optimization trajectories and final performances. This observation motivates the central question of this work: what explains such large model-to-model differences in optimization performance? Are these differences primarily a reflection of base model capability, or do they arise from more subtle differences in the exploration–exploitation dynamics induced by the models? Figure 1: Different optimization trajectories for two LLMs with similar zero-shot performance on TSP-60. Each point represents a candidate solution, colored by generation. Gemini-1.5-Pro (left) displays sustained fitness improvement and progressive localization. Mistral-7B-Instruct (right) maintains high novelty but fails to exploit it into fitness gains. To address these questions, we conduct a large-scale study of LLM-based evolutionary optimization, collecting optimization trajectories for 15 LLMs across 4 task families (8 tasks), resulting in 72K analyzed candidate solutions. As expected, zero-shot performance correlates positively with final optimization outcomes. However, this relationship explains partially the variance: models with nearly identical zero-shot performance can diverge quickly after evolution, following qualitatively distinct optimization trajectories (see Figure 1 ). To explain this residual gap, we turn to the classical exploration–exploitation trade-off underlying evolutionary algorithms ( 40 ) . In LLM-driven metaheuristics, the mutation operator is no longer fully random but is strongly shaped by the LLM’s prior toward producing improved solutions conditioned on parent candidates and their fitness feedback. Consequently, exploration is more constrained than in classical, non-LLM-driven evolution. Under this view, optimization processes should benefit primarily from higher novelty and diversity, which would expose the system to a broader range of potentially useful regions in the search space. Surprisingly, our results contradict this intuition. We find that the most successful trajectories are not those exhibiting high novelty, but rather those characterized by frequent and sustained breakthroughs , where a breakthrough represents an incremental improvement of the best-so-far fitness. In other words, what distinguishes strong optimization runs is more of the ability to reliably produce incremental improvements repeatedly. This is different from typical behavior observed in meta-heuristics, where large breakthroughs occur at rare intervals, followed by long plateaus or small refinements ( 31 ) . This interpretation is also supported by our perturbation experiments, where we directly manipulate the refinement behaviour of the search trajectory through model mixing, leading to predictable changes in optimization performance. To further elucidate when and why breakthroughs happen, we analyze the geometry of optimization trajectories in semantic space . By embedding candidate solutions and characterizing within-generation distributions with entropy-based and dispersion measures, we reveal a clear distinction between strong and weak optimizers. Effective LLM operators progressively localize their search around high-performing regions of semantic space, whereas weaker optimizers continue to diffuse and drift across distant regions. A generation-level mixed-effects analysis further uncovers an interesting interaction between novelty and semantic dispersion: novelty increases the probability of breakthroughs only when the search remains sufficiently localized. Outside this regime, novelty is largely unproductive. Contributions. We make the following contributions: (i) We conduct a large-scale, controlled study of LLM-based evolutionary optimization and release the resulting optimization trajectories. (ii) We show that differences in optimization performance between LLMs are only partially explained by zero-shot capability, unveiling a distinct notion of optimizable ability . (iii) We identify effective LLM optimizers as local refiners , whose trajectories progressively localize in semantic space and yield frequent incremental breakthroughs, and we support this mechanism through perturbation experiments that highlight the role of refinement behavior. (iv) We demonstrate that novelty is not inherently beneficial; its utility is conditional on the geometric regime of search, and it becomes productive only when search remains localized. (v) We derive practical implications for model selection and for learning better search operators, showing that smaller or cheaper models can outperform stronger base models when they exhibit more reliable refinement behavior. More broadly, our semantic trajectory analysis offers a reusable framework for studying LLM-driven optimization processes. Our findings suggest that, rather than solely pursuing general-purpose capability, future work may benefit from understanding, controlling, training models as effective search operators ( 41 ) emphasizing local refinement and error correction. 2 Related Work Evolutionary Computation with LLMs LLMs are increasingly integrated into evolutionary computation frameworks ( 47 ; 46 ; 4 ; 42 ) , revitalizing meta-heuristic optimization. Unlike classical approaches that rely on stochastic operators to explore optimization landscapes ( 18 ) , LLM-assisted methods instantiate variation operators through the semantic priors of LLMs ( 21 ; 35 ; 12 ; 10 ) . These frameworks have demonstrated strong empirical performance across domains including combinatorial optimization ( 48 ; 51 ) and scientific discovery ( 49 ; 29 ; 5 ; 1 ; 54 ) . Recent work has further extended these approaches to algorithm discovery in open-ended scenario ( 28 ; 14 ; 36 ) , as well as more advanced settings incorporating co-evolution or meta-reflection to mitigate limited global search perspectives ( 26 ; 50 ) . Our work complements these efforts by analyzing the search behavior and optimization trajectories induced by LLMs. Trajectory analyses can also inform the design of agentic systems ( 22 ; 52 ; 53 ; 25 ) . Related to our work are behaviour-space studies ( 45 ) and LAS landscape analyses ( 27 ) , which similarly associate effective optimization with sustained improvements and increased exploitation. We extend these findings with a unified cross-model, cross-task analysis using semantic entropy measures. Evaluating LLMs as Search Operators The evaluation paradigm for LLMs has evolved accordingly. Early optimization