Uncertainty-Aware Dual-Ranking Strategy for Offline Data-Driven Multi-Objective Optimization

Huanbo Lyu, Daniel Herring, Shiqiao Zhou, Miqing Li, Zheming Zuo, Jelena Ninic, James Andrews, Fabian Spill, Shuo Wang* · 2025

Read Uncertainty-Aware Dual-Ranking Strategy for Offline Data-Driven Multi-Objective Optimization by Huanbo Lyu, Daniel Herring, Shiqiao Zhou, Miqing Li, Zheming Zuo, Jelena Ninic, James Andrews, Fabian Spill, Shuo Wang* (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-06459.txt.

Introduction

Huanbo Lyu and co-authors improve offline optimization, where candidate designs are judged only by surrogate models trained on fixed data. Surrogate errors can flip which candidates look best, misleading the whole search. Earlier fixes leaned on Gaussian process uncertainty, which ties the method to one model family and heavy computation.

Their dual-ranking strategy ranks candidates twice: once by predicted quality and once by an uncertainty-aware score, using whatever surrogate supplies both numbers. Candidates that are strong and reliable on both rankings rise to the front. Wide experiments, including ablations and sensitivity checks, showed the strategy stays effective and robust across different surrogate types.

Catalog record

CREATORHuanbo Lyu, Daniel Herring, Shiqiao Zhou, Miqing Li, Zheming Zuo, Jelena Ninic, James Andrews, Fabian Spill, Shuo Wang*
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-06459

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Uncertainty-Aware Dual-Ranking Strategy for Offline Data-Driven Multi-Objective Optimization Huanbo Lyu, Daniel Herring, Shiqiao Zhou, Miqing Li, Zheming Zuo, Jelena Ninic, James Andrews, Fabian Spill, Shuo Wang* Abstract Offline data-driven Multi-Objective Optimization Problems (MOPs) rely on limited data from simulations, experiments, or sensors. This scarcity leads to high epistemic uncertainty in surrogate predictions. Conventional surrogate methods such as Kriging assume Gaussian distributions, which can yield suboptimal results when the assumptions fail. To address these issues, we propose a simple yet novel dual-ranking strategy, working with a basic multi-objective evolutionary algorithm, NSGA-II, where the built-in non-dominated sorting is kept and the second rank is devised for uncertainty estimation. In the latter, we utilize the uncertainty estimates given by several surrogate models, including Quantile Regression (QR), Monte Carlo Dropout (MCD), and Bayesian Neural Networks (BNNs). Concretely, with this dual-ranking strategy, each solution’s final rank is the average of its non-dominated sorting rank and a rank derived from the uncertainty-adjusted fitness function, thus reducing the risk of misguided optimization under data constraints. We evaluate our approach on benchmark and real-world MOPs, comparing it to state-of-the-art methods. The results show that our dual-ranking strategy significantly improves the performance of NSGA-II in offline settings, achieving competitive outcomes compared with traditional surrogate-based methods. This framework advances uncertainty-aware multi-objective evolutionary algorithms, offering a robust solution for data-limited, real-world applications. Code — https://anonymous.4open.science/r/26559AAAI Introduction In real-world scenarios, many Multi-Objective Optimization Problems (MOPs) involve multiple conflicting objectives, with lacking analytical functions or simulation models for direct evaluation ( 27 ) . Consequently, data-driven Multi-Objective Evolutionary Algorithms (MOEAs) have gained prominence by combining predictive data-driven techniques with the robust search capabilities of MOEAs . These methods have proven effective in various applications, including trauma systems, airfoil design, energy systems, and smart building optimization ( 17 ; 34 ; 24 ; 26 ; 25 ) . Despite their success, offline data-driven MOEAs encounter a significant challenge: objective values are estimated using surrogate models ( i.e. data-driven methods), but no new data is available to update the models or conduct real evaluations. Even with a noise-free offline dataset, the approximation uncertainty from surrogate models can largely affect optimization performance ( 18 ; 34 ) . This uncertainty may misguide the search process, resulting in suboptimal solutions. In real-world scenes e.g. optimizing indoor layouts in smart buildings to minimize predicted energy consumption and thermal comfort, this uncertainty can trigger suboptimal space configurations. To mitigate this uncertainty, various ensemble learning-based methods have been proposed, such as selective surrogate ensembles ( 34 ) , perturbation-based ensemble surrogates ( 22 ) and ensemble surrogates with tri-training ( 16 ) . Nevertheless, these methods do not directly incorporate uncertainty information into the optimization process. Consequently, the accumulation of prediction errors during optimization can sharply compromise the search process, potentially leading to suboptimal outcomes ( 24 ) . In offline data-driven MOPs , Kriging is commonly adopted as a surrogate model due to its ability to yield uncertainty estimates, including predicted means and standard deviations ( 23 ) . Several methodologies leverage this information, such as adaptive model selection ( 24 ) , probabilistic selection mechanisms ( 24 ) and extensions to constrained MOPs ( 35 ; 36 ) . However, Kriging suffers from high computational complexity, scaling at O(N^{3}) ( 15 ) , and its reliance on Gaussian data distribution assumptions can impair predictive accuracy. Thus, there is a pressing need for surrogate models that can efficiently manage datasets, improve predictive performance, and provide reliable uncertainty quantification. This work presents a novel dual-ranking strategy for offline data-driven MOEAs under uncertainty, with the following major contributions. • Flexible Integration with Surrogate Models. The dual-ranking strategy seamlessly integrates with various surrogate models that provide uncertainty quantification, such as Kriging, Quantile Regression (QR) ( 20 ) , Monte Carlo Dropout (MCD) ( 12 ) , and Bayesian Neural Network (BNN) ( 4 ) . It incorporates predictive results and uncertainty estimates into an adjusted fitness function to enhance optimization robustness. • Enhanced Survival Selection in NSGA-II. The dual-ranking strategy is applied during the survival selection phase of Non-dominated Sorting Genetic Algorithm II (NSGA-II) . It performs non-dominated sorting on both the original and adjusted fitness functions, computing each solution’s rank by averaging its ranks across the two sorts for each non-dominated front, thereby improving solution diversity and quality. • Comprehensive Evaluation. The approach is rigorously evaluated against state-of-the-art methods on 14 synthetic and real-world benchmark problems, demonstrating superior performance and effectiveness in handling uncertainty in multi-objective optimization. Preliminaries Multi-Objective Optimization We consider the MOPs of the following form: minimize \displaystyle\boldsymbol{f}(\boldsymbol{x})=\left(f_{1}(\boldsymbol{x}),f_{2}(\boldsymbol{x}),\ldots,f_{K}(\boldsymbol{x})\right) subject to \displaystyle\boldsymbol{x}\in S (1) where \boldsymbol{x} is the decision vector, K\geq 2 is the total number of objectives, and S is the feasible region in the decision space. A solution \boldsymbol{x}_{1}\in S dominates another solution \boldsymbol{x}_{2}\in S , indicated as \boldsymbol{x}_{1}\prec\boldsymbol{x}_{2} , if f_{k}(\boldsymbol{x}_{1})\leq f_{k}(\boldsymbol{x}_{2}) for all k=1,\ldots,K and f_{k}(\boldsymbol{x}_{1})<f_{k}(\boldsymbol{x}_{2}) for at least one k=1,\ldots,K . The set of solutions that cannot be dominated by any other feasible solution is the Pareto Set (PS) , and the set of their objective values is the Pareto Front (PF) . Offline Data-Driven Multi-Objective Optimization In offline data-driven MOPs , there is no explicit mathematical expression for the objective function, nor is it possible to acquire or evaluate new data points from real-world experiments or physical simulations during the optimization process ( 24 ; 27 ) . Only a pre-collected dataset is available, and this offline dataset remains fixed during optimization. The objective functions are approximated by training surrogate models on this offline dataset. Uncertainty In offline data-driven MOPs , uncertainty may arise from the estimation errors. This uncertainty, introduced by surrogate models, can misguide the search process, resulting in the selection of solutions with worse underlying objective values. For example, in Figure 1 , we consider a minimization problem with two objectives f_{1},f_{2} , and two underlying solutions, \boldsymbol{A} (blue) and \boldsymbol{B} (red), shown in the objective space. Based on the surrogate evaluations, f_{\text{sur}}(\boldsymbol{A}) is better than f_{\text{sur}}(\boldsymbol{B}) in both objectives, implying \boldsymbol{A}\prec\boldsymbol{B} . However, the real value f_{\text{real}}(\boldsymbol{A}) (triangle) is worse than f_{\text{real}}(\boldsymbol{B}) in both objectives, meaning that \boldsymbol{B}\prec\boldsymbol{A} . This example shows that relying solely on surrogate evaluations can lead to incorrect selection during optimization. Therefore, uncertainty information should be incorporated into the optimization algorithm to mitigate such issues. Figure 1: Example of solution ranking in a multi-objective minimization problem, showing how surrogate evaluations ( f_{\text{sur}}(\boldsymbol{A}) , f_{\text{sur}}(\boldsymbol{B}) ) may misjudge the Pareto dominance relation due to prediction uncertainty, with the dashed circle denoting the uncertainty interval. Surrogate Modeling In data-driven MOPs , the surrogate model \mathcal{M} aims to predict the objective values of a potential solution \boldsymbol{x} , and is trained on the given offline dataset \mathcal{D} where no new data can be acquired. For each objective, a surrogate model is trained, resulting in a total of K surrogate models. For a given solution \boldsymbol{x} , the k -th objective value f_{k}(\boldsymbol{x}) estimated from the surrogate model \mathcal{M}_{k} can be represented as: \displaystyle f_{k}(\boldsymbol{x})\approx\mathcal{M}_{k}(\boldsymbol{x}). (2) Our work will be evaluated using surrogate models trained by following machine learning methods. Kriging The Kriging model ( 23 ; 24 ) estimates the output at a new sample \boldsymbol{x} as: \displaystyle\hat{y}=\mu(\boldsymbol{x})+\epsilon(\boldsymbol{x}), (3)

Read the complete text