Semantics-Aware Bilevel Co-Evolution: Towards Automated Multicomponent Algorithm Design

Zhiyao Zhang, Shenghao Wu, Xingyu Wu, and Kay Chen Tan · 2026

Read Semantics-Aware Bilevel Co-Evolution: Towards Automated Multicomponent Algorithm Design by Zhiyao Zhang, Shenghao Wu, Xingyu Wu, and Kay Chen Tan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-29953.txt.

Introduction

Zhang and three colleagues propose STABLE, a method that designs algorithms with several connected components on its own, using language-model-guided evolutionary search. Earlier search methods either rewrote whole designs, losing good parts, or polished parts inside a few fixed layouts, and both ignored algorithm semantics.

STABLE organises candidate designs into layered, modular structures drawn from domain knowledge. It then evolves two levels together: the high-level layout and the low-level components themselves, so updates stay coordinated. At each level a semantic model records how components link and fit together, and why, guiding the language model as it generates and scores candidates. In experiments, STABLE's designs beat human-designed baselines and leading search methods.

Catalog record

CREATORZhiyao Zhang, Shenghao Wu, Xingyu Wu, and Kay Chen Tan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE63 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.29953

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Semantics-Aware Bilevel Co-Evolution: Towards Automated Multicomponent Algorithm Design Zhiyao Zhang, Shenghao Wu, Xingyu Wu, and Kay Chen Tan Abstract Large language model (LLM)-assisted evolutionary search (LES) has emerged as a promising paradigm for automated algorithm design. However, existing LES methods usually suffer from two inherent limitations when facing the automated design of real-world complex algorithms that usually consist of multiple components. The first limitation is that they either focus on modifying entire algorithms, making it difficult to reuse high-quality components, or concentrate on component refinement within a limited set of predefined multicomponent configurations. The second limitation is the insufficient explicit modeling and exploitation of algorithm semantics (i.e., algorithm information related to in-depth algorithmic behavioral logic). These limitations severely degrade search efficiency and hinder effective exploration of complex design spaces. Therefore, this paper proposes STABLE ( S eman t ics- A ware B ilevel Co- E volution), an LES method purpose-built for automated multicomponent algorithm design that jointly introduces structural algorithm formulation and semantics-driven evolution. In STABLE, complex algorithms are organized into hierarchical and modular architectures rooted in domain knowledge, aligning the search space with their intrinsic compositional traits. Based on this structured algorithm formulation, STABLE simultaneously optimizes high-level multicomponent configurations and low-level functional components, enabling coordinated cross-level updates while maintaining suitable granularities for design space exploration. At each level, STABLE establishes a multi-faceted semantic model to assist LLMs in capturing structural correlations, functional compatibilities, and inherent rationalities among algorithm components. This semantic model serves as the core guidance for evolutionary search, enabling principled algorithm generation and informed algorithm evaluation. Extensive experiments demonstrate that the algorithms generated by STABLE outperform both human-designed baselines and those from state-of-the-art LES methods. I Introduction Optimization problems are widely encountered in numerous fields, and efficient optimization solving is vital to driving technological progress and engineering innovation [ 50 ] . However, the traditional design of optimization algorithms relies heavily on researchers’ professional experience and domain expertise, involving tedious processes such as operator design and parameter tuning. This not only consumes considerable time and effort but also makes it challenging to adapt to the growing complexity and scale of optimization problems. Against this background, automatic algorithm design (AAD) has become the pursuit of engineers and researchers [ 24 , 41 , 37 ] . Recently, as a phenomenal class of generative artificial intelligence, large language models (LLMs) have exhibited remarkable capabilities in natural language understanding and knowledge reasoning across diverse applications, including code generation, academic paper drafting, and scientific theorem discovery [ 16 , 39 ] . This notable advancement has motivated researchers to integrate LLMs with evolutionary computation to tackle AAD tasks [ 20 ] . Such emerging methods are recognized as LLM-assisted evolutionary search (LES) [ 11 ] . Distinctively empowered by population-based iterative search, LES regards each algorithm as an individual in the population and leverages LLMs as the genetic operator for algorithm generation. In this paradigm, well-designed prompts containing algorithm information (e.g. codes) serve as the core medium to guide the search direction of LLMs in exploring the algorithm space, thereby fundamentally shaping the overall performance of the generated algorithms. To date, many LES methods have been proposed for the automated design of heuristics or single algorithm components. However, the automated design of complete multicomponent algorithms such as various multiobjective evolutionary algorithms (MOEAs) remains underexplored, which are highly relevant to practical and challenging application scenarios. For such AAD tasks, there is a fundamental mismatch between the search paradigms of existing LES methods and the structural formulation of complex evolutionary algorithms. Existing LES methods typically rely on flat formulation: treating candidate algorithms as monolithic objects for direct optimization. However, complex algorithms usually follow a hierarchical and compositional structure [ 54 ] : high-level strategies emerge from the synergistic interaction of modular components, whose behaviors in turn depend on lower-level design configurations and algorithmic decisions. When such algorithms are constrained to a flat formulation, the search is forced to either operate on entire algorithms, resulting in coarse-grained exploration, or to optimize fine-grained components in isolation [ 15 ] . The former fails to reuse high-quality components during algorithm evolution, essentially rebuilding entire algorithms from scratch each generation and discarding valuable component-level knowledge. The latter, while allowing component refinement, is confined to a limited set of multicomponent configurations, unable to explore novel interactions among components beyond predefined combinations. [ 23 ] . As a result, the search becomes structurally ill-posed and lacks suitable granularity to effectively traverse the algorithm design space. Beyond the above search-formulation mismatch, a more fundamental issue persists: the search lacks an explicit characterization of the functional architecture inherent to algorithms, which belongs to intrinsic algorithm semantics, i.e., algorithm information closely tied to in-depth algorithmic behavioral logic. By ignoring component roles and their interdependencies in prompts, LLMs are restricted to superficial syntactic modifications, with little insight into how such changes influence algorithm functionality [ 20 ] . As a result, the search becomes semantically under-constrained. Offspring algorithms are generated by LLMs through statistical imitation of training examples, rather than through reasoning about the functional consequences of component assembly [ 45 ] . More critically, this shortfall propagates to the algorithm evaluation phase. Lacking semantics awareness, the search cannot reliably estimate the potential of different regions in the design space. Evaluation resources are thus allocated in a nearly uniform or weakly adaptive manner, leading to severe inefficiency. Importantly, this inefficiency stems not only from the high computational cost of algorithm performance evaluations (APEs) [ 45 ] , but also from the search’s inability to prioritize promising candidate algorithms according to their semantic merit. To address the above issues, we propose S eman t ics- A ware B i l evel Co- E volution (STABLE), a unified framework specially tailored for automated multicomponent algorithm design (AMAD) that incorporates structured algorithm formulation and semantics-aware evolution. At its core, STABLE transcends conventional flat algorithm formulations by organizing complex algorithms as assemblies of interacting components across multiple abstraction levels based on domain-specific expert prior knowledge. This structured formulation aligns the organization of the search space with the intrinsic compositional nature of complex algorithms. Building on this formulation, STABLE establishes a bilevel co-evolutionary framework, where the upper level optimizes full algorithm structures and the lower level fauces on fine-grained modular component improvement. The framework enables coordinated cross-level evolution that systematically reuses and propagates high-quality components across emerging multicomponent configurations, transforming local design knowledge into global architectural advantage to effectively explore the complex design space. Furthermore, STABLE incorporates five‑dimensional semantic modeling to capture the inherent interdependencies among algorithm components. Operating on both code structural similarity and component functional similarity, this model lifts LLM‑driven search from the level of syntactic token rearrangement to that of semantic compositionality, enabling more semantically informed algorithm generation and algorithm performance evaluation. The contribution of this paper is two-fold. First, we propose STABLE, which is the first LES method specially to achieve effective AMAD. This method provides a principled and extensible framework for organizing and evolving complex algorithms in a structured manner. Second, we introduce two AMAD tasks: constrained MOEA design and surrogate-assisted MOEA design. Experiments conducted on these two tasks verify the effectiveness of STABLE. The reminder of paper is structured in the following

Read the complete text