DesignX: Human-Competitive Algorithm Designer for Black-Box Optimization

Hongshu Guo, Zeyuan Ma, Yining Ma, Xinglin Zhang, Wei-Neng Chen, Yue-Jiao Gong · 2025

Read DesignX: Human-Competitive Algorithm Designer for Black-Box Optimization by Hongshu Guo, Zeyuan Ma, Yining Ma, Xinglin Zhang, Wei-Neng Chen, Yue-Jiao Gong (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-17866.txt.

Introduction

Hongshu Guo and co-authors present DesignX, a system that designs optimization algorithms on its own, in a 2025 paper. Crafting a black box optimizer by hand takes months of expert tuning for each new problem family. DesignX aims to deliver a tailored solver in seconds.

A library of hundreds of parts from decades of research forms the parts bin. Two learning agents divide the work: one assembles structure, the other sets the knobs, trained together across ten thousand varied problems. The resulting optimizers beat human crafted ones by wide margins on protein docking, machine learning tuning, and drone routing tests. The patterns it finds may teach human designers new tricks.

Catalog record

CREATORHongshu Guo, Zeyuan Ma, Yining Ma, Xinglin Zhang, Wei-Neng Chen, Yue-Jiao Gong
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE88 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-17866

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

DesignX: Human-Competitive Algorithm Designer for Black-Box Optimization Hongshu Guo, Zeyuan Ma, Yining Ma, Xinglin Zhang, Wei-Neng Chen, Yue-Jiao Gong Abstract Designing effective black-box optimizers is hampered by limited problem-specific knowledge and manual control that spans months for almost every detail. In this paper, we present DesignX , the first automated algorithm design framework that generates an effective optimizer specific to a given black-box optimization problem within seconds. Rooted in the first principles, we identify two key sub-tasks: 1) algorithm structure generation and 2) hyperparameter control. To enable systematic construction, a comprehensive modular algorithmic space is first built, embracing hundreds of algorithm components collected from decades of research. We then introduce a dual-agent reinforcement learning system that collaborates on structural and parametric design through a novel cooperative training objective, enabling large-scale meta-training across 10k diverse instances. Remarkably, through days of autonomous learning, the DesignX-generated optimizers continuously surpass human-crafted optimizers by orders of magnitude, either on synthetic testbed or on realistic optimization scenarios such as Protein-docking, AutoML and UAV path planning. Further in-depth analysis reveals DesignX’s capability to discover non-trivial algorithm patterns beyond expert intuition, which, conversely, provides valuable design insights for the optimization community. We provide DesignX’s inference code at https://github.com/MetaEvo/DesignX . 1 Introduction Black-box optimization (BBO) lies at the core of scientific and industrial advances, such as electronic design automation [ 1 ] , molecular design [ 2 ] and AutoML [ 3 ] . Yet, BBO is challenging due to unavailable objectives and derivatives, and complex, diverse properties that demand extensive expert knowledge. Evolutionary Computation (EC) is widely recognized as a robust derivative-free paradigm for BBO [ 4 ] . Since the 1990s, numerous EC variants such as genetic algorithms [ 5 ] , differential evolution [ 6 ] , particle swarm optimization [ 7 ] , and evolution strategies [ 8 ] have emerged. Despite shared core paradigm, they rely on expert-designed adaptive operators [ 9 ] and hyperparameter control [ 10 ] to achieve the best performance on a particular BBO class or instance. However, manually redesigning optimizers for each new BBO problem is neither scalable nor practical. Recently, an emerging research avenue termed as Meta-Black-Box-Optimization (MetaBBO) [ 11 ] has emerged, which automates algorithm design (AAD) through a bi-level paradigm: a meta-level learns a policy to guide low-level BBO optimizer. By meta-training [ 12 ] over a distribution of problems, MetaBBO can generate customized algorithms for both seen and unseen instances. Despite the success, existing MetaBBO approaches merely focus on learning specific sub-tasks of AAD for EC. Specifically, optimizer design involves two sequential sub-tasks (see Figure 1 , top left): (1) determining the algorithm workflow, and (2) control its internal hyperparameters. Existing work addresses the former via algorithm selectors [ 13 , 14 , 15 ] or workflow generators [ 16 , 17 , 18 , 19 ] , and the latter through reinforcement learning (RL) [ 20 ] for online control [ 21 , 22 , 23 , 24 ] . While learning a single sub-task eases training, it often results in sub-optimal designs and limits potential performance gains. Figure 1 : Left : Compared to manual design process, DesignX replaces human experts by two learnable agents. Right : Four dashed lines denote average performances of well-known human-crafted optimizers in decades. During pre-training, DesignX surprisingly discovers powerful optimizers superior to the ones crafted by human experts. In this paper, we advance MetaBBO research by proposing the first unified framework that jointly learns both sub-tasks of algorithm design—workflow generation and hyperparameter control, so as to enable the discovery of human-competitive optimizers in an end-to-end fashion. This is achieved through several key innovations. Firstly, we extend and enrich the Modular-BBO modularization system in [ 24 ] , resulting in a more comprehensive system: Modular-EC. Specifically, since Modular-BBO is primarily constructed for DE optimzier, Modular-EC integrates more diverse sub-modules in ES, GA and PSO into its sub-module library. Modular-EC now supports representing different optimizer types, enhancing the capacity of Modular-BBO. Building on the upgraded Modular-EC, we develop a dual-agent reinforcement learning system (see Figure 1 , bottom left), where both agents are Transformer-based [ 25 ] : 1) Agent-1 autoregressively samples valid optimizer workflows conditioned on the problem instance; 2) Agent-2 dynamically adjusts hyperparameters during optimization by incorporating real-time feedback. A novel cooperative reward scheme encourages both agents to make mutually conditioned decisions, jointly optimizing for maximum performance. We train this dual-agent system on a large-scale problem set of 10k synthetic instances, and observe it consistently discovering optimizers that outperform expert-crafted baselines (see Figure 1 , right). Remarkably, through days of autonomous learning, the DesignX-generated optimizers continuously surpass human-crafted optimizers by orders of magnitude, either on synthetic testbed or on realistic optimization scenarios such as Protein-docking, AutoML and UAV. Furthermore, the testing results clearly demonstrate the novelty and superiority of DesignX against up-to-date MetaBBO baselines. To summarize, the contributions of this paper are in three folds: • The first MetaBBO framework that achieves fully end-to-end AAD for BBO problems, paving the way of developing foundation model in this domain. • We obtain a well-performing model (DesignX) through large-scale training, capable of designing powerful optimizers for diverse, unseen, realistic problems • Further in-depth analysis reveals the importance of the proposed novel designs, providing first-hand insights on non-trivial algorithm patterns beyond expert intuition. 2 Related Works We review the development of Automated Algorithm Design (AAD) over the past decades. Early efforts by Schmidhuber et al. [ 26 ] applied Genetic Programming (GP) to recursively improve another GP in a self-referential manner. Later, GP was applied to design full algorithm templates [ 27 ] , but difficulties in genotype design and expensive evaluations limited its scalability for BBO problems. Recent MetaBBO approaches integrate machine learning techniques such as reinforcement learning (RL) and large language models (LLMs) to develop more flexible and generalizable optimizers [ 28 , 11 ] . These RL-based methods like DEDQN [ 14 ] and DEDDQN [ 13 ] focused on operator selection and hyperparameter control within fixed algorithm structures. More recent methods leverage Transformer architectures for enhanced control [ 23 , 29 ] , including ConfigX [ 24 ] and Q-Mamba [ 30 ] , which implement online and offline RL, respectively. Other works explored Transformer-based generation of algorithm components. SYMBOL [ 31 ] learned to compose new operators as symbolic sequences. ALDes [ 17 ] tokenized common algorithmic modules and turned workflow design into sequence generation. GLHF [ 32 ] simulated DE operators with trainable modules optimized through gradient descent. Though these models were relatively small, they achieved strong performance. With LLM-scale models, capabilities expand further. LLMs can search reward functions [ 33 ] , optimize neural architectures [ 34 ] , act as optimizers based on previous search trajectories [ 35 ] , or generate algorithm code from problem descriptions [ 36 , 19 , 18 ] . However, existing work focuses on only one sub-task of AAD: either generating workflows or controlling parameters. No prior method jointly addresses both, which motivates our proposed DesignX to enable end-to-end algorithm design. 3 Methodology 3.1 Modular-EC Existing EC optimizers commonly comprise a series of algorithm modules. A massive array of novel algorithm modules have been proposed in

Read the complete text