Profile Bayesian Optimization for Expensive Computer Experiments

Courtney Kyger, James Fernandez, John A. Grunenwald, James Braun, Annie S. Booth · 2025

Read Profile Bayesian Optimization for Expensive Computer Experiments by Courtney Kyger, James Fernandez, John A. Grunenwald, James Braun, Annie S. Booth (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-23581.txt.

Introduction

Courtney Kyger and four co-authors introduce profile Bayesian optimization, a method for tuning expensive computer simulations. Their motivating problem is a diffuser in a rotating detonation combustion engine: the simulation reports energy lost through diffusion. Engineers want the lowest possible loss as a function of the diffuser's length, one control parameter, while other design parameters vary as nuisances.

Standard Bayesian optimization hunts a single best point and ignores most of the control parameter's range. The profile version instead maps the best achievable response at every value of the control parameter. A two-stage acquisition scheme balances exploring new lengths against refining known optima, with deep and shallow Gaussian process surrogates tracking uncertainty. On benchmarks and on the engine problem, it beat traditional Bayesian optimization and earlier profile methods. The point is to tune the whole curve, not just one peak.

Catalog record

CREATORCourtney Kyger, James Fernandez, John A. Grunenwald, James Braun, Annie S. Booth
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-23581

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Profile Bayesian Optimization for Expensive Computer Experiments Courtney Kyger, James Fernandez, John A. Grunenwald, James Braun, Annie S. Booth Abstract We propose a novel Bayesian optimization (BO) procedure aimed at identifying the “profile optima” of a deterministic black-box computer simulation that has a single control parameter and multiple nuisance parameters. The profile optima capture the optimal response values as a function of the control parameter. Our objective is to identify them across the entire plausible range of the control parameter. Classic BO, which targets a single optimum over all parameters, does not explore the entire control parameter range. Instead, we develop a novel two-stage acquisition scheme to balance exploration across the control parameter and exploitation of the profile optima, leveraging deep and shallow Gaussian process surrogates to facilitate uncertainty quantification. We are motivated by a computer simulation of a diffuser in a rotating detonation combustion engine, which returns the energy lost through diffusion as a function of various design parameters. We aim to identify the lowest possible energy loss as a function of the diffuser’s length; understanding this relationship will enable well-informed design choices. Our “profile Bayesian optimization” procedure outperforms traditional BO and profile optimization methods on a variety of benchmarks and proves effective in our motivating application. Keywords: expected improvement, Gaussian process, deep Gaussian process, surrogate, triangulation candidates, uncertainty quantification 1 Introduction Computer simulations (or “computer experiments”) are becoming increasingly relevant in physical and engineering sciences, where they may supplement physical experimentation that is costly, dangerous, or infeasible. In this work we tackle profile optimization of black-box computer simulations, seeking the optimal response value over the full support of a specified “control parameter.” Profile optimization can provide crucial information about trade-offs between performance and an important parameter, thereby supporting informed decision making. Let f:\mathcal{X}\rightarrow\mathbb{R} denote a black-box simulation that accepts d -dimensional input \mathbf{x}\in\mathcal{X}\subset\mathbb{R}^{d} and returns scalar y=f(\mathbf{x}) . Inputs are further delineated into a single control parameter x^{\star}\in\mathcal{X}^{\star}\subset\mathbb{R} and nuisance parameters \mathbf{x}^{-\star}\in\mathcal{X}^{-\star}\subset\mathbb{R}^{d-1} such that \mathbf{x}=[x^{\star},\mathbf{x}^{-\star}] , \mathcal{X}=\{\mathcal{X}^{\star},\mathcal{X}^{-\star}\} , and f(\mathbf{x})=f(x^{\star},\mathbf{x}^{-\star}) . For a given control parameter, the profile optima of f is defined as T(x^{\star}):=\min_{\mathbf{x}^{-\star}\in\mathcal{X}^{-\star}}f(x^{\star},\mathbf{x}^{-\star})\;\;\forall\;\;x^{\star}\in\mathcal{X}^{\star}, (1) providing the minimum response that can be obtained for any value of the control parameter. To visualize this in a simple setting, Figure 1 portrays the two-dimensional Branin function ( 41 ) scaled to \mathcal{X}=[0,1]^{2} with the resulting T(x^{\star}) . (a) (b) (c) Figure 1 : Branin function with one control parameter and one nuisance parameter (left), with the true T(x^{\star}) (center). Right panel shows the location of T(x^{\star}) in \mathcal{X} (solid white), an LHS design of size n=10 (white circles), and the vertical slice that features later in Figure 2 (dashed white). Our real-world motivation stems from the design of a jet engine: a rotating detonation combustor (RDC) that pushes hot air through a diffuser to power a gas turbine. Computational fluid dynamics simulations compute the flow through the diffuser, estimating the energy lost through diffusion as a function of the design parameters (i.e., curvature, bypass locations, and diffuser length). The longest diffuser length will result in the smallest energy loss regardless of the remaining parameter values, but shorter diffusers are more cost-effective and practical. Our objective is to estimate the profile optima in energy loss as a function of diffuser length to facilitate effective decision-making concerning the diffuser’s design. The key challenge in estimating T(x^{\star}) is the computational expense of evaluating the computer simulation. Simplified versions of our RDC simulation require 10 minutes of computation to produce a single observation, even with high performance parallel computing. Higher fidelity versions may require several hours. When simulation data is limited, as in our motivating application, a surrogate model is essential. Surrogates are trained on observations of the simulator in order to provide predictions and uncertainty quantification (UQ) at unobserved inputs. Gaussian process (GP) surrogates are the “go-to” choice ( 35 ; 31 ; 12 ) , but in their canonical form they may be too rigid to accommodate the complexity of modern computer simulations for physical systems. Deep Gaussian processes ( 7 , DGPs;) offer increased flexibility by warping the input space through latent Gaussian layers and have been gaining significant attention as surrogates for nonstationary simulations ( 30 ; 23 ; 38 ; 47 , e.g.,) . Crucially, our contribution is suitable for both GP and DGP surrogates. Direct optimization of expensive computer experiments, i.e., \min_{\mathbf{x}\in\mathcal{X}}f(\mathbf{x}) , is a well studied problem, usually tackled through Bayesian optimization ( 9 ; 28 ; 44 , BO;) . BO involves a greedy feedback loop where design points are sequentially selected based on information from a surrogate model that has been trained on the previously observed data and is updated after each new acquisition. Common acquisition strategies include maximization of expected improvement ( 16 ; 48 , EI;) and Thompson sampling ( 42 ) . Naturally, BO methods that target the global optimum are ill-equipped for profile optimization as they are not designed to explore the entire control parameter space. 10 proposed “profile expected improvement” (PEI) to remedy this disconnect. PEI modifies traditional EI in order to target the profile optima instead of the global optimum, but it has its own challenges. Acquisitions based on PEI, as proposed by 10 , are computationally expensive to obtain as the requisite computations are incompatible with numerical optimizers. We suspect this is the reason they only provided results on two-dimensional problems. Even when we adapt the implementation to facilitate faster acquisitions (more on this in Section 3 ), PEI tends to over-exploit and under-explore, resulting in acquisitions clustered near the global optimum. The tendency to under-explore is a well-known limitation of traditional EI ( 29 ; 1 ; 6 ) , and our simulations (Section 4 ) show that PEI tends to inherit this same fate. We propose a novel profile Bayesian optimization (PBO) procedure to effectively estimate T(x^{\star}) with limited observations of the black-box function f(\mathbf{x}) . We leverage joint posterior draws from a Bayesian GP or DGP surrogate to estimate T(x^{\star}) with thorough uncertainty quantification. We select the next acquisition, \mathbf{x}_{n+1} , in two stages: first, choosing x^{\star}_{n+1} based on exploration of \mathcal{X}^{\star} , then choosing \mathbf{x}^{-\star}_{n+1} based on exploitation of T(x^{\star}_{n+1}) through optimization of PEI along the x^{\star}_{n+1} slice. The intentional exploration of the first step provides effective coverage of the control parameter space, while the exploitation of the second step hones in on the profile optima. We also propose a strategic adaptation of triangulation candidates ( 11 , “tricands”;) to alleviate computational bottlenecks in our procedure. The remainder of this paper is organized as follows. Section 2 reviews the essential building blocks of our method. Section 3 details our PBO procedure. Section 4 provides a variety of synthetic examples to validate our approach against state-of-the-art alternatives. Finally, we present the results of our method on the RDC in Section 5 and conclude in Section 6 . 2 Building Blocks In this section, we detail some of the building blocks that are necessary for our contribution, including GP and DGP surrogates, traditional expected improvement, and profile expected improvement. Throughout, we use lowercase letters to represent scalars, bold lowercase letters to represent vectors, and bold uppercase letters to represent matrices. Specifically, let \mathbf{X} denote a

Read the complete text