Meta-Black-Box Optimization Can Do Search Guidance for Expensive Constrained Multi-Objective Optimization
Yukun Du, Haiyue Yu, Jiang Jiang, Shuaiwen Tang, Xiaotong Xie, Haobo Liu, Chongshuang Hu, Shengkun Chang · 2026
Read Meta-Black-Box Optimization Can Do Search Guidance for Expensive Constrained Multi-Objective Optimization by Yukun Du, Haiyue Yu, Jiang Jiang, Shuaiwen Tang, Xiaotong Xie, Haobo Liu, Chongshuang Hu, Shengkun Chang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-10260.txt.
Introduction
Yukun Du and seven colleagues shift the focus of meta black-box optimization from how to search to where to search. Existing methods train a neural policy to control a low-level optimizer, but they largely ignore which region deserves attention. Their 2026 paper presents MetaSG-SAEA, a bi-level framework for expensive constrained multi-objective problems, where each evaluation is costly.
A meta-policy guides a surrogate-assisted evolutionary algorithm, which replaces most costly evaluations with cheap predictions. The guidance rests on Max-Min Constraint-Calibrated Inequality, a compact region abstraction that maps varied constraint scores onto an ordered scalar level. Diffusion-based population initialization then turns region guidance into starting solutions. Across diverse benchmarks MetaSG-SAEA beat state-of-the-art baselines and generalized across problem distributions.
Catalog record
| CREATOR | Yukun Du, Haiyue Yu, Jiang Jiang, Shuaiwen Tang, Xiaotong Xie, Haobo Liu, Chongshuang Hu, Shengkun Chang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.10260
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Meta-Black-Box Optimization Can Do Search Guidance for Expensive Constrained Multi-Objective Optimization Yukun Du, Haiyue Yu, Jiang Jiang, Shuaiwen Tang, Xiaotong Xie, Haobo Liu, Chongshuang Hu, Shengkun Chang Abstract Existing Meta-Black-Box Optimization (MetaBBO) methods focus on how to search when controlling optimizers, but largely overlook where to search . We propose MetaSG-SAEA, a bi-level MetaBBO framework for expensive constrained multi-objective optimization problems (ECMOPs), in which a meta-policy provides search guidance to the low-level Surrogate-Assisted Evolutionary Algorithm (SAEA). To achieve this, we introduce Max–Min Constraint-Calibrated Inequality (MM-CCI), a compact, problem-agnostic region abstraction that maps heterogeneous constraint evaluations to an ordered scalar level; we further provide a theoretical analysis of its fundamental properties. Building on this region abstraction, we adopt diffusion-based population initialization to translate the meta-policy’s region-level guidance into solution-level priors for the SAEA. To make MetaSG-SAEA scalable, we construct an attention-based state representation across varying problem dimensions, population sizes, and numbers of objectives and constraints. Experimental results demonstrate that MetaSG-SAEA outperforms state-of-the-art baselines across diverse benchmarks and exhibits the ability to generalize across problem distributions. 1 Introduction Black-Box Optimization (BBO) considers problems where the objective is accessible only through function evaluations, without analytical forms or gradients. This setting has motivated extensive work in Evolutionary Computation (EC), leading to many effective, human-designed black-box optimizers ( 43 ; 56 ) . However, their transferability is often limited, as an optimizer that performs well on one class of problems may degrade on others and typically requires substantial manual adaptation ( 9 ; 13 ; 55 ) . Figure 1 : Bi-level paradigm of existing MetaBBOs. To improve transferability, recent Meta-Black-Box Optimization (MetaBBO) methods commonly follow a bi-level paradigm (see Figure 1 ), where a neural policy is meta-trained over a task distribution to output control decisions for a low-level BBO optimizer ( 28 ; 59 ) . The policy typically takes Exploratory Landscape Analysis (ELA) descriptors as inputs to summarize the current search state and inform its decisions ( 35 ; 26 ) . Based on their control mechanisms and roughly ordered by increasing control-space complexity ( 52 ; 30 ) , representative approaches include Algorithm Selection (AS), Algorithm Configuration (AC), Solution Manipulation (SM), and Algorithm Generation (AG). Despite this progress, most existing MetaBBO paradigms are not tailored to evaluation-limited, expensive settings ( 8 ) , often implicitly assuming abundant function evaluations and focusing on how to search rather than where to search . In expensive BBO, ineffective exploration can rapidly deplete the evaluation budget, making it crucial to identify and prioritize promising regions ( 51 ; 39 ; 20 ) . This perspective is consistent with surrogate-based optimizers, such as Surrogate-Assisted Evolutionary Algorithms (SAEAs), which improve query efficiency by substituting most costly evaluations with surrogate predictions and selecting the next samples via an infill criterion under a tight budget ( 19 ; 23 ) . However, such sampling rules are typically heuristic, hand-crafted, and often problem-specific, which limits their adaptability and transferability ( 8 ; 31 ) . This motivates combining MetaBBO with surrogate-based optimization, where a meta-policy provides adaptive, data-driven guidance on where to sample in expensive settings. Yet, meta-guided search for surrogate-based optimization remains largely underexplored, primarily due to several fundamental challenges: 1) Compact and problem-agnostic region abstraction. A key challenge is to construct a region representation that is compact enough for stable meta-policy learning and problem-agnostic enough for cross-task generalization, while retaining a well-defined ranking of search priority to enable effective guidance. 2) Effective guidance without excessive restriction. The challenge is how to guide the underlying optimizer to steer sampling toward selected regions for improved query efficiency, while preserving its intrinsic dynamics and avoiding overly constraining control. 3) ELA representation for search guidance. Existing work rarely develops ELA representations tailored to region-level guidance ( 34 ; 33 ; 38 ) . In expensive BBO, where landscape information must be inferred from sparse evaluations, the lack of such representations makes it difficult for a meta-policy to reliably guide the search and generalize across tasks. To enable effective search guidance in MetaBBO, we propose MetaSG-SAEA, a novel MetaBBO framework in which an SAEA serves as the low-level optimizer, while a meta-learned policy guides the SAEA’s search for expensive constrained multi-objective optimization problems (ECMOPs). MetaSG-SAEA is designed to address the aforementioned challenges by integrating the following key techniques: (i) We introduce the Max–Min Constraint-Calibrated Inequality (MM-CCI) , which maps each solution’s constraint evaluations to a compact, problem-agnostic scalar region level in [0,1] , simplifying region partitioning and enabling the meta-policy to efficiently learn search guidance without relying on a complex control space. Additionally, we provide a theoretical analysis and proof of MM-CCI. (ii) To implement region-level guidance, we employ diffusion-model-based population initialization to warm-start the SAEA, steering the search toward the target region while preserving its intrinsic evolutionary dynamics without imposing tight constraints. (iii) We replace hand-crafted ELA with an attention-based representation that aggregates objective values and region-level signals from MM-CCI. This design scales across different problem dimensions, population sizes, and numbers of objectives and constraints. In conclusion, our research offers a new perspective in the MetaBBO field, focusing on region-level search guidance, while providing an effective approach for tackling ECMOPs. 2 Related Works 2.1 Meta-Black-Box-Optimization MetaBBO views algorithm design as a meta-level learning problem over a distribution of optimization tasks ( 55 ; 27 ) . Given a set of problem instances sampled from a distribution \mathcal{P} , a meta-level policy \pi_{\theta} is trained to guide a low-level black-box optimizer \mathcal{O} based on its observed optimization states. The objective of MetaBBO is to learn a policy that maximizes the expected performance improvement of the optimizer across tasks ( 4 ; 12 ; 22 ) . Formally, the meta-objective is defined as J(\theta)=\mathbb{E}_{f\sim\mathcal{P}}\!\left[R(\mathcal{O},\pi_{\theta},f)\right]\approx\frac{1}{N}\sum_{i=1}^{N}\sum_{t=1}^{T}\mathrm{perf}\!\left(\mathcal{O},a_{i,t},f_{i}\right), (1) where N is the total number of training tasks, and R(\cdot) represents total reward accumulated by following the meta-policy, a_{i,t}=\pi_{\theta}(\bm{s}_{i,t}) denotes the algorithm design decision produced by the meta-policy from the optimization state \bm{s}_{i,t} at step t , and \bm{s}_{i,t} is obtained via ELA, i.e., \bm{s}_{i,t}=\Lambda_{\theta}(\mathcal{H}_{i}^{t}) , which maps the available optimization history \mathcal{H}_{i}^{t} into a compact state representation ( 11 ) . By maximizing this meta-objective, MetaBBO seeks an optimal meta-policy that improves the performance of the underlying optimizer over a distribution of optimization problems, rather than adapting to a single instance ( 24 ) . Figure 2 : MetaSG-SAEA search guidance process. (left) The framework of MetaSG-SAEA. (right) The Meta-policy takes objective values and computed MM-CCI levels as input to determine the search regions. The evaluated solutions within the decision region are passed to the diffusion model for training, which generates the initial population. During the environmental selection phase of the evolutionary algorithm, individuals are selected based on the MM-CCI priority predicted by the surrogate model. This process effectively implements Search Guidance for SAEA. Existing MetaBBO methods can be broadly categorized by the control space of the meta-policy, i.e., which component of the low-level optimization process is learned and adapted. AS learns to pick a solver from a candidate pool given the current optimization state ( 2 ; 48 ) . AC which dynamically adjusts hyperparameters or operators ( 49 ; 8 ) . SM operates directly in the solution space by generating, perturbing, or refining solutions,