Do We Really Need to Approach the Entire Pareto Front in Many-Objective Bayesian Optimisation?
Chao Jiang, Jingyu Huang, Miqing Li · 2026
Read Do We Really Need to Approach the Entire Pareto Front in Many-Objective Bayesian Optimisation? by Chao Jiang, Jingyu Huang, Miqing Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-09417.txt.
Introduction
Jiang, Huang, and Li ask whether many-objective Bayesian optimisation really needs to approach the entire Pareto front. With more than three objectives, solutions needed to represent the full front typically grow substantially. That challenge is acute in Bayesian optimisation, where only a few hundred solutions are evaluated. Since only one solution is ultimately deployed, the authors propose a single-point-based search framework. Its acquisition function, expected single-point improvement, is proven convergent and beats state-of-the-art methods on benchmarks.
Catalog record
| CREATOR | Chao Jiang, Jingyu Huang, Miqing Li |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 116057 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.09417
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Do We Really Need to Approach the Entire Pareto Front in Many-Objective Bayesian Optimisation? Chao Jiang, Jingyu Huang, Miqing Li Abstract Many-objective optimisation, a subset of multi-objective optimisation, involves optimisation problems with more than three objectives. As the number of objectives increases, the number of solutions needed to adequately represent the entire Pareto front typically grows substantially. This makes it challenging, if not infeasible, to design a search algorithm capable of effectively exploring the entire Pareto front. This difficulty is particularly acute in the Bayesian optimisation paradigm, where sample efficiency is critical and only a limited number of solutions (often a few hundred) are evaluated. Moreover, after the optimisation process, the decision-maker eventually selects just one solution for deployment, regardless of how many high-quality, diverse solutions are available. In light of this, we argue an idea that under a limited evaluation budget, it may be more useful to focus on finding a single solution of the highest possible quality for the decision-maker, rather than aiming to approximate the entire Pareto front as existing many-/multi-objective Bayesian optimisation methods typically do. Bearing this idea in mind, this paper proposes a s ingle p oint-based m ulti- o bjective search framework (SPMO) that aims to improve the quality of solutions along a direction that leads to a good tradeoff between objectives. Within SPMO, we present a simple acquisition function, called expected single-point improvement (ESPI), working under both noiseless and noisy scenarios. We show that ESPI can be optimised effectively with gradient-based methods via the sample average approximation (SAA) approach and theoretically prove its convergence guarantees under the SAA. We also empirically demonstrate that the proposed SPMO is computationally tractable and outperforms state-of-the-arts on a wide range of benchmark and real-world problems. 1 Introduction Multi-objective optimisation problems (MOPs) ( 35 ; 131 ) involve scenarios where multiple objectives need to be optimised simultaneously. Unlike single-objective optimisation problems which typically have a single optimal solution, in MOPs there is a set of optimal solutions known as Pareto optimal solutions. The corresponding points in the objective space form what is known as the Pareto front. In general, a multi-objective optimisation algorithm aims to generate a set of solutions that well approximate the Pareto front, from which the decision-maker chooses a solution to deploy based on their preferences. In modern applications, optimisation is becoming increasingly complex, with a growing number of requirements and objectives that need to be considered at the same time ( 85 ; 48 ; 81 ) . Taking the car cab design as an example, there are up to nine objectives to be optimised ( 29 ) , including cabin space, fuel efficiency, acceleration time, and road noise at various speeds. This has given rise to a new research topic, many-objective optimisation, focusing on MOPs involving more than three objectives ( 55 ; 71 ) . At the same time, many real-world multi-/many-objective optimisation problems are black-box and costly in terms of solution evaluation. This is evident across a range of fields, including chemistry ( 96 ; 108 ; 34 ) , materials science ( 80 ; 83 ; 99 ) , and transportation ( 29 ; 56 ; 16 ; 28 ) . For example, in vehicle design optimisation, it can take about 20 hours to evaluate a vehicle design ( 125 ; 25 ) . To tackle such problems, multi-objective Bayesian optimisation (MOBO) is a very effective approach ( 40 ) , along with other alternatives (e.g., surrogate-assisted evolutionary algorithms ( 61 ; 79 ) ). Over the past decades, a variety of effective MOBO methods have emerged, including scalarisation-based methods ( 66 ; 94 ; 82 ) which convert a multi-objective problem into a number of single-objective problems, and Pareto-based methods which consider Pareto dominance relations over objectives ( 24 ; 36 ; 117 ) . Most works aim to find a good approximation of the entire Pareto front. However, with the increase of the objective number, the number of solutions needed to adequately represent the problem’s Pareto front typically grows substantially. For example, for a 10-objective problem, it normally needs 220 points (i.e., \binom{12}{3} ) even if only three divisions on each objective are considered ( 22 ) . This difficulty is especially pronounced in Bayesian optimisation, where often only a few hundred solutions can be generated and evaluated. With such a limited budget, it is highly unlikely for an optimisation algorithm to reach or even be close to the Pareto front. On top of that, after the optimisation process, the decision-maker eventually selects just one solution to deploy, regardless of how many high-quality, diverse solutions are provided. Given the above, this paper argues an idea that under a very limited evaluation budget, it may be more useful to focus on finding a single solution of the highest possible quality for the decision-maker, rather than aiming to approximate the entire Pareto front. That is, we may not need to care about diversifying solutions to represent the entire Pareto front, but focus on improving the quality of a single solution. Figure 1 illustrates this idea in a bi-objective case. As can be seen from the figure, in contrast to aiming for a set of diversified solutions which existing MOBO methods typically do ( 70 ; 82 ) , our method aims for a single solution with better convergence (i.e., closer to the Pareto front). Although it may yield a worse hypervolume (HV) value ( 133 ) compared to the diverse solution set obtained by existing methods, it may be more likely to be chosen by the decision-maker as it achieves a more favourable trade-off among the objectives. Figure 1: An illustration of our idea in a bi-objective case, in comparison with existing methods that aim to search for the entire Pareto front. The red points represent (nondominated) solutions that existing methods may obtain, and the blue point represents what our method aims for. It can be seen that the red points are much more diversified, hence, as a whole, having a better hypervolume (HV) value ( 133 ) . However, the blue point has better convergence (i.e., closer to the Pareto front) than any single red point, which may be more likely to be preferred by the decision-maker. Bearing this idea in mind, this paper proposes a single point-based multi-objective search framework, called SPMO. The contributions of this work can be summarised as follows. • We propose a novel MOBO search framework that does not aim to approximate the entire Pareto front, but rather focuses on improving the quality of solutions along a single direction that leads to a good tradeoff between objectives. • Within SPMO, we present a simple acquisition function, called Expected Single-Point Improvement (ESPI). We show that ESPI can be optimised effectively with gradient-based methods via the sample average approximation (SAA) approach from 6 and also theoretically prove its theoretical convergence guarantees under the SAA. • We consider both noiseless and noisy cases, resulting in two versions of the proposed ESPI. • We verify SPMO through an extensive experimental study, including in comparison with various state-of-the-arts, under both sequential and batch optimisation settings, through sensitivity analysis, with different metrics embedded, and on a range of benchmark and