Bayesian Optimization with Lower Confidence Bounds for Minimization Problems with Known Outer Structure

Katrin Baumgärtner [email protected], Moritz Diehl [email protected] · 2025

Read Bayesian Optimization with Lower Confidence Bounds for Minimization Problems with Known Outer Structure by Katrin Baumgärtner [email protected], Moritz Diehl [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-14015.txt.

Introduction

Katrin Baumgartner and Moritz Diehl adapt Bayesian optimization to problems with partly known structure in a 2025 study. Classic Bayesian optimization treats the whole objective as unknown and learns it from noisy trials. In many engineering problems, though, the outer loss is known and only an inner input-output model must be learned.

Their lower confidence bound method exploits that known outer structure when choosing new trials. Analysis focuses on convex losses with probabilistic models that are linear in their parameters. Regret bounds show how quickly the search settles near the best point. Using known structure should waste fewer expensive experiments.

Catalog record

CREATORKatrin Baumgärtner [email protected], Moritz Diehl [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-14015

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Bayesian Optimization with Lower Confidence Bounds for Minimization Problems with Known Outer Structure Katrin Baumgärtner [email protected], Moritz Diehl [email protected] Abstract This paper considers Bayesian optimization (BO) for problems with known outer problem structure. In contrast to the classic BO setting, where the objective function itself is unknown and needs to be iteratively estimated from noisy observations, we analyze the case where the objective has a known outer structure —given in terms of a loss function—while the inner structure —an unknown input-output model—is again iteratively estimated from noisy observations of the model outputs. We introduce a novel lower confidence bound algorithm for this particular problem class which exploits the known outer problem structure. The proposed method is analyzed in terms of regret for the special case of convex loss functions and probabilistic parametric models which are linear in the uncertain parameters. Numerical examples illustrate the superior performance of structure-exploiting methods compared to structure-agnostic approaches. Katrin Baumgärtner and Moritz Diehl † † heading: ?? 2025 1- 3/25; Revised ??/25 ??/25 21-0000 † † shortheadings: LCB-BO for Minimization Problems with Known Outer Structure / Baumgärtner and Diehl † † firstpage: 1 † † editor: My editor keywords Bayesian optimization, grey-box optimization, lower confidence bound, linear bandit, regret bound 1 Introduction In recent years, Bayesian optimization (BO) has received a lot of attention from various fields. In machine learning, BO has been successfully used to optimize the performance of learning algorithms by selecting optimal hyperparameters ( Falkner et al. 2018 ) . Similarly, BO has been used in control engineering to tune controllers in closed-loop simulations and experiments ( Berkenkamp et al. 2016 ; Berkenkamp et al. 2023 ; Kudva et al. 2024 ) . In process control, where the system dynamics can often not be modeled accurately or accurate models are too expensive to be used for real-time feedback control, model-plant mismatch can significantly deteriorate the control performance. In this context, BO has been used to optimize a control objective while taking into account model uncertainties ( del Rio Chanona et al. 2021 ) . For many control applications, however, the objective function is often not completely unknown, as is assumed in the standard BO framework. Typically, the outer loss function is known—often even chosen by the control engineer—, while the inner function, the system model, is unknown. This motivates the extension of the BO framework with novel approaches exploiting this known outer structure. Before introducing this problem setup in more detail, we briefly review the problem assumptions underlying standard, in the following also referred to as structure-agnostic , BO approaches. In the classic BO setup, an optimization problem of the following form is considered: \displaystyle u_{*}\in\arg\min_{u\in\mathcal{U}}\penalty\ \varphi_{*}(u) (1) with compact domain \mathcal{U}\subseteq\mathbb{R}^{n} and continuous objective function \varphi_{*}:\mathcal{U}\rightarrow\mathbb{R} . Crucially, \varphi_{*} is not known a priori and we can only learn about \varphi_{*} from noisy observations y^{\varphi}=\varphi_{*}(u)+v^{\varphi} where v^{\varphi} denotes zero-mean noise. In particular, no gradient information is available. The problem might thus be referred to as zero-order black-box optimization. As minimizing the unknown objective directly is not possible, BO algorithms compute the next evaluation point by instead optimizing a surrogate objective, in the literature referred to as acquisition function ( Mockus et al. 1978 ) . For the classic setting ( 1 ), various acquisition functions have been considered in the BO literature. We refer the interested reader to the excellent tutorial on BO by Brochu et al. 2010 for a detailed overview on commonly used acquisition functions. Most relevant for this paper is the lower confidence bound (LCB) 1 1 1 Or upper confidence bound (UCB) if a maximization problem is considered which is the more common case in classic BO. . This acquisition function corresponds to a probabilistic lower bound on the true objective \varphi_{*} which is minimized in each iteration in order to determine the next evaluation point u . Intuitively, the motivation behind the LCB approach—sometimes referred to as optimism in the face of uncertainty —is the following: If we evaluate at the minimum of the LCB acquisition function and the lower bound is tight at this minimum, then we have evaluated at a point with low objective value ( exploitation ). In contrast, if the lower bound is underestimating the true objective value at the point of evaluation, then we are able to improve the estimated model of the objective ( exploration ). In contrast to the classic BO problem ( 1 ), we consider a slightly different setup in this paper: The unknown function, in the following referred to as model or output function, f_{*}:\mathcal{U}\rightarrow\mathcal{Z}\subseteq\mathbb{R}^{m},u\mapsto z, is potentially multivariate and enters the optimization problem via a known loss function l , i.e. we consider the problem \displaystyle u_{*}\in\arg\min_{u\in\mathcal{U}}\penalty\ \varphi_{*}(u)\quad\text{where}\quad\varphi_{*}(u)=l(u,f_{*}(u)), (2) with known loss function l:\mathcal{U}\times\mathbb{R}^{m}\rightarrow\mathbb{R} and unknown output function f_{*}:\mathcal{U}\rightarrow\mathcal{Z}\subseteq\mathbb{R}^{m} . Both l and f_{*} are assumed to be continuous. As before, we may learn about f_{*} via noisy observations y=z+v with zero-mean output noise v . Note that in contrast to the standard setting ( 1 ) where observations of the scalar objective are given, we assume that (potentially) multivariate observations of the model outputs—but not of the objective—are available. This setup, which might be classified as grey-box optimization, is a generalization of the classic black-box setting outlined above which we obtain for l(u,z)=z\in\mathbb{R} . Similarly to the classic black-box setting setting, where a probabilistic model of the objective is iteratively updated with new observations, we will assume that a probabilistic model of the output function is available which allows us to compute parametric model confidence bounds of the form: \displaystyle\Prop\left[f_{*}(u)\in\hat{\mathcal{Z}}(u;\gamma,\mathcal{I})\penalty\ \forall u\in\mathcal{U}\right]\geq 1-p, (3) where we call \hat{\mathcal{Z}}(u;\gamma,\mathcal{I})\subset\mathbb{R}^{m} the model confidence set and 1-p the confidence level. The scalar hyperparameter \gamma allows us to scale the confidence set such that the prescribed confidence level is met. In addition, the confidence set will be conditioned on the available observations, i.e. at time instant n , the observations (u_{1},y_{1}),\ldots,(u_{n},y_{n}) are given and summarized by \mathcal{I}_{n} . Such a model confidence bound is for instance available if we consider parametric models of the form z=f(u,\theta) where f(u,\theta)=A(u)\theta is linear in the unknown parameters \theta ( linear-in-parameters , LIP). In this case, the model confidence sets can be described by ellipsoids parametrized by the mean and covariance associated with the uncertainty in the parameters \theta ( Lattimore and Szepesvári 2020 ) . Similarly, model confidence bounds might be derived for Gaussian processes (GP) which are a widely used model class in classic BO ( Brochu et al. 2010 ; Abbasi-Yadkori et al. 2011a ) . The main contribution of this paper is an extension of the lower confidence bound (LCB) algorithm to minimization problems with known outer problem structure as given in ( 2 ). The method relies on the assumption that a tractable representation of the model confidence sets ( 3 ) is available. We analyze the method in detail providing a regret analysis for the case where LIP models and convex costs are considered. In numerical experiments, we compare the proposed approach to a zero-order iterative learning approach, which is based on a deterministic model, Thompson sampling and the classic LCB approach. 1.1 Related Work The investigated grey-box setting is typical for control and robotics applications

Read the complete text