Dynamic Priors in Bayesian Optimization for Hyperparameter Optimization
Lukas Fehring, Marcel Wever, Maximilian Spliethöver, Leona Hennig, Henning Wachsmuth, Marius Lindauer · 2025
Read Dynamic Priors in Bayesian Optimization for Hyperparameter Optimization by Lukas Fehring, Marcel Wever, Maximilian Spliethöver, Leona Hennig, Henning Wachsmuth, Marius Lindauer (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-02570.txt.
Introduction
Lukas Fehring and five co-authors let human experts keep steering an automated tuning process instead of handing over control at the start. Bayesian optimisation is the standard tool for tuning machine learning hyperparameters. It normally absorbs expert knowledge only in the initial settings, even though practitioners learn more as the search runs and may want to intervene. Their framework, DynaBO, accepts fresh user priors at any point in the run.
New priors enter through the acquisition function as preferences that are weighted strongly at first and then decay, which preserves the method's long-run convergence guarantees. A safeguard based on the surrogate model can detect a misleading prior and refuse it. The authors prove near-certain convergence, robustness against deceptive advice, and faster convergence when the advice is good. Across a range of benchmarks DynaBO beat leading competitors for every kind of prior tested.
Catalog record
| CREATOR | Lukas Fehring, Marcel Wever, Maximilian Spliethöver, Leona Hennig, Henning Wachsmuth, Marius Lindauer |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-02570
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Dynamic Priors in Bayesian Optimization for Hyperparameter Optimization Lukas Fehring, Marcel Wever, Maximilian Spliethöver, Leona Hennig, Henning Wachsmuth, Marius Lindauer Abstract Hyperparameter optimization (HPO), for example, based on Bayesian optimization (BO), supports users in designing models well-suited for a given dataset. HPO has proven its effectiveness on several applications, ranging from classical machine learning for tabular data to deep neural networks for computer vision and transformers for natural language processing. However, HPO still sometimes lacks acceptance by machine learning experts due to its black-box nature and limited user control. Addressing this, first approaches have been proposed to initialize BO methods with expert knowledge. However, these approaches do not allow for online steering during the optimization process. In this paper, we introduce a novel method that enables repeated interventions to steer BO via user input, specifying expert knowledge and user preferences at runtime of the HPO process in the form of prior distributions. To this end, we generalize an existing method, π \pi BO, preserving theoretical guarantees. We also introduce a misleading prior detection scheme, which allows protection against harmful user inputs. In our experimental evaluation, we demonstrate that our method can effectively incorporate multiple priors, leveraging informative priors, whereas misleading priors are reliably rejected or overcome. Thereby, we achieve competitiveness to unperturbed BO. 1 Introduction Hyperparameter optimization (HPO) is concerned with automatically optimizing the hyperparameters of machine learning algorithms for a given task. A task often consists of a dataset, a configuration space, and a performance measure ( Hutter et al. 2019 ) . HPO is effective on classical machine learning ( Eggensperger et al. 2021 ; Bansal et al. 2022 ; Pfisterer et al. 2022 ) as well as on deep neural networks and transformers for computer-vision and natural language processing ( Müller et al. 2023 ; Wang et al. 2024 ; Rakotoarison et al. 2024 ; Pineda Arango et al. 2024 ) . Nevertheless, users often disregard HPO in favor of maintaining manual hyperparameter configuration control ( Bouthillier & Varoquaux 2020 ; Van der Blom et al. 2021 ; Kannengießer et al. 2025 ) . The reluctance is amplified in the case of knowledgeable experts ( Kannengießer et al. 2025 ) . At the same time, explainability methods for HPO ( Wang et al. 2019 ; Sass et al. 2022 ; Zöller et al. 2023 ) seek to provide users with insights into the optimization process, often motivating adaptations to HPO. However, approaches that allow practitioners to steer the optimization process, instead of restarting it, remain largely underexplored. Nevertheless, they could tackle expert users’ perceived lack of control ( Kannengießer et al. 2025 ) , thus possibly furthering HPO methods’ acceptance. Recently, initial steps have been taken toward collaborative automated machine learning (AutoML) approaches, subsuming HPO, in view of a more human-centered AutoML paradigm ( Lindauer et al. 2024 ) . More specifically, Hvarfner et al. 2022 and Mallik et al. 2023 propose user-centric interfaces for Bayesian optimization (BO) ( Jones et al. 1998 ) and Hyperband ( Li et al. 2017 ) , respectively. Using explicit user priors on the location of the optimal configuration, the interfaces enable users to bias the optimization process. Hvarfner et al. 2024 extend this idea by building a general framework that enables users to encode properties of the optimized function, such as the maximum achievable performance, into the optimization process. These approaches show that informative priors can significantly enhance performance, while misleading priors do not break the optimization process, and the associated performance deterioration can be recovered from in the long run. Although these developments represent progress toward human-centered BO, the proposed level of interaction remains limited, as the approaches lack the possibility of user-enabled online control. Figure 1: Overview of the proposed dynamic Bayesian optimization ( DynaBO ) method. Provided a dataset, a performance measure, a configuration space, and an optional initial prior, the loop iteratively selects new hyperparameter configurations. At each step, a candidate configuration is evaluated, and it is assessed. The process continues until an optimized configuration is identified. The framework allows users to steer the optimization process by dynamically adding priors at runtime. In this paper, we propose an approach for dynamic Bayesian optimization, dubbed DynaBO , to advance the interactivity of BO-based HPO by enabling, but not requiring, users to inject knowledge on potentially well-suited regions of the hyperparameter configuration space. This user knowledge is provided in the form of user priors and can be injected at any point during the process, as illustrated in Fig. 1 . When multiple priors are supplied simultaneously or in close succession, they are stacked and their effects are combined. This (i) allows users to continuously steer the optimization process, and (ii) enables them to use HPO in the typical rapid-prototyping workflows of machine learning practitioners ( Studer et al. 2021 ) where users oversee and direct the construction of the continuously updated model. These advantages are enhanced by an informed user, e.g., through utilizing explainability methods for HPO ( Hutter et al. 2014 ; Moosbauer et al. 2021 ; Segel et al. 2023 ) , which provide actionable insights. Concretely, DynaBO generalizes the work of Hvarfner et al. 2022 from a single to multiple priors provided by users over time. Importantly, DynaBO maintains \pi BO’s speedup for informative priors, and retains its theoretical convergence properties despite misleading priors. To tackle the nevertheless significant anytime performance deterioration due to misleading priors, we propose an additional mechanism for their detection and potential rejection. This mechanism is based on an assessment of the provided priors using acquisition functions and the already trained surrogate model, therefore requiring no significant overhead. Our experimental evaluation on a multitude of real-world HPO tasks reveals substantial speedups of DynaBO over vanilla BO and \pi BO ( Hvarfner et al. 2022 ) for informative priors. At the same time, while \pi BO suffers from performance deterioration due to a single misleading prior, our prior rejection mechanism enables DynaBO to achieve competitiveness with vanilla BO even when exposed to misleading priors repeatedly. 2 Hyperparameter Optimization Hyperparameter optimization (HPO) is concerned with finding a suitable hyperparameter configuration of a learner for a given task, typically defined by a labeled dataset D and a loss function \ell that evaluates predictive quality ( Bischl et al. 2023 ) . Given an input space \mathcal{X} and an output (label) space \mathcal{Y} , D=\{(x^{(k)},y^{(k)})\}_{k=1}^{N} is a finite sample drawn from a joint probability distribution P(\mathcal{X},\mathcal{Y}) . D is split into a training set D_{T} and validation set D_{V} . We consider a loss function \ell:\mathcal{Y}\times P(\mathcal{Y})\rightarrow\mathbb{R} that evaluates the quality of predictions in terms of the true label and a probability distribution over \mathcal{Y} . Given a hyperparameter configuration \lambda\in\Lambda from a configuration space \Lambda , and dataset D_{T} , the learner produces a hypothesis h_{\lambda,D_{T}}\in\mathcal{H}:=\{h\mid h:\mathcal{X}\rightarrow P(\mathcal{Y})\} , that is, a mapping from inputs to probability distributions over \mathcal{Y} . Since the hyperparameter configuration \lambda influences both the hypothesis space \mathcal{H} and the inductive behavior of the learner, selecting a well-suited hyperparameter configuration with respect to the dataset and the loss function is key to achieving peak performance. The objective of HPO is to find a configuration \lambda^{\ast} that leads to a hypothesis