Multi-Objective Causal Bayesian Optimization
Shriya Bhatija, Paul-David Zuercher, Jakob Thumm, Thomas Bohné · 2025
Read Multi-Objective Causal Bayesian Optimization by Shriya Bhatija, Paul-David Zuercher, Jakob Thumm, Thomas Bohné (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-14755.txt.
Introduction
Shriya Bhatija and co-authors extend a smart trial-and-error method to problems where several goals compete and causes are mapped, in a 2025 paper. In many systems, testing an intervention is costly, but a causal map shows which levers move which outcomes. Causal Bayesian optimisation uses that map to reach the best setting with few tests. Real decisions, though, rarely chase one goal: cost, safety, and quality pull apart.
The authors define the multi-goal version of the problem and ask which levers could ever be worth touching. They show the whole task splits into several ordinary multi-goal searches. Their algorithm then shares effort among those searches, chasing the biggest expected gain in the trade-off frontier each round. Tests on made-up and real causal maps beat methods that ignore the causal structure, they report.
Catalog record
| CREATOR | Shriya Bhatija, Paul-David Zuercher, Jakob Thumm, Thomas Bohné |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 76 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-14755
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Multi-Objective Causal Bayesian Optimization Shriya Bhatija, Paul-David Zuercher, Jakob Thumm, Thomas Bohné Abstract In decision-making problems, the outcome of an intervention often depends on the causal relationships between system components and is highly costly to evaluate. In such settings, causal Bayesian optimization ( cbo ) can exploit the causal relationships between the system variables and sequentially perform interventions to approach the optimum with minimal data. Extending cbo to the multi-outcome setting, we propose multi-objective causal Bayesian optimization ( mo-cbo ), a paradigm for identifying Pareto-optimal interventions within a known multi-target causal graph. We first derive a graphical characterization for potentially optimal sets of variables to intervene upon. Showing that any mo-cbo problem can be decomposed into several traditional multi-objective optimization tasks, we then introduce an algorithm that sequentially balances exploration across these tasks using relative hypervolume improvement. The proposed method will be validated on both synthetic and real-world causal graphs, demonstrating its superiority over traditional (non-causal) multi-objective Bayesian optimization in settings where causal information is available. 1 Introduction Decision-making problems arise in a variety of domains, such as healthcare, manufacturing or public policy, and involve manipulating variables to obtain an outcome of interest. In many such domains, interventions are inherently costly, and practical applications are subject to budgetary constraints. Moreover, these systems are often governed by causal mechanisms, which can be exploited to efficiently approach optimal outcomes in a targeted and cost-efficient manner. A well-established strategy for optimizing such expensive-to-evaluate black-box functions is Bayesian optimization ( Shahriari et al., 2016 ) , but it cannot leverage the causal structure between its input variables. To this end, causal Bayesian optimization ( cbo ) ( Aglietti et al., 2020 ) was introduced to generalize Bayesian optimization to settings where causal information is available. While existing cbo variants focus on optimizing a single objective, real-world systems often require simultaneous optimization of multiple outcomes. Here, the aim is to establish optimal trade-offs between objectives, a so called Pareto front, instead of identifying a single objective’s global optimum. As an example, consider the graph in Figure 1 (a), depicting the causal relationships between prostate specific antigen ( psa ) and its risk factors ( Ferro et al., 2015 ) . For patients sensitive to Statin medications, the aim is to determine how to reduce the relevant risk factors to minimize both Statin and psa simultaneously. Figure 1 (b) shows how the optimal trade-offs between the targets could behave. Figure 1: mo-cbo problem in healthcare. (a) Causal graph where red, grey, and orange nodes depict target, manipulative, and non-manipulative variables, respectively. (b) The solution consists of interventions that yield optimal trade-offs between the targets. Figure 2: Overview of the mo-cbo methodology. We propose multi-objective causal Bayesian optimization ( mo-cbo ) as a method that generalizes cbo to such optimization problems involving multiple outcome variables. A visualization of our methodology is given in Figure 2 , highlighting some of the key contributions of our work: 1. We formally define mo-cbo as a new class of optimization problems. 2. We provide a formal method to reduce the search space of mo-cbo problems, thereby disregarding sets of variables that are not worth intervening upon based on the graph topology. 3. We propose Causal ParetoSelect , an efficient algorithm for the exploration of multiple intervention strategies in parallel, guided by a custom acquisition function. 4. We experimentally show that our approach can surpass traditional (non-causal) multi-objective Bayesian optimization in settings where causal relationships are known, achieving more cost-effective, diverse, and accurate solutions. To the best of our knowledge, there exists no other multi-objective optimization method in the literature that can consider the causal structure. We prove that our mo-cbo methodology establishes optimal trade-offs between target variables, which state-of-the-art methods cannot reach for all experimental setups. 1.1 Related Work We combine multi-objective Bayesian optimization ( mobo ) and techniques from causal inference to achieve multi-objective causal Bayesian optimization. Developments in mobo range from single-point methods ( Knowles, 2006 ; Zuluaga et al., 2013 ; Belakaria et al., 2020 ) and batch methods ( Zhang et al., 2010 ; Konakovic Lukovic et al., 2020 ; Daulton et al., 2021 ) to the derivations of efficient acquisition functions ( Couckuyt et al., 2014 ; Henrández-Lobato et al., 2014 ) . Most relevant for our work is dgemo ( Konakovic Lukovic et al., 2020 ) , a well-established mobo algorithm that employs a novel batch selection strategy emphasizing on sample diversity in the input space. Leveraging tools from causal inference to make causally-informed decisions is a field called causal decision-making. Within this field, there is a growing body of research specifically focused on advancing cbo ( Aglietti et al., 2020 ) . These advancements include extensions such as constrained cbo ( Aglietti et al., 2023 ) , dynamic cbo ( Aglietti et al., 2021 ) , and various other variants ( Branchini et al., 2023 ; Gultchin et al., 2023 ; Sussex et al., 2023 ; Sussex et al., 2024 ; Ren & Qian, 2024 ; Zeitler & Astudillo, 2024 ) . They are all designed to optimize a single target variable, rendering them infeasible for applications with multiple outcomes. 2 Preliminaries In this paper, random variables and their realizations are denoted in the upper and lower case, respectively. Sets and vectors are written in bold. For a set \mathbf{X} , its power set is denoted as \mathbb{P}(\mathbf{X}) . 2.1 Multi-objective Bayesian optimization Multi-objective Bayesian optimization simultaneously minimizes (or, maximizes) a set of black-box objectives f_{1},\dots,f_{m}:\mathbf{X}\rightarrow\mathbb{R} with minimal function evaluations. Due to potential conflicts between objectives, it aims to find trade-off solutions, known as Pareto optima: Definition 2.1 (Pareto optimality) . A point x\in\mathbf{X} is called Pareto-optimal if there is no other x^{\prime}\in\mathbf{X} such that f_{i}(x)\geq f_{i}(x^{\prime}) for all 1\leq i\leq m , and f_{i}(x)>f_{i}(x^{\prime}) for at least one 1\leq i\leq m . The set of Pareto-optimal points in \mathbf{X} is called Pareto set , denoted \mathcal{P}_{s} . The Pareto front is the image of the Pareto set under the objective functions, given by \mathcal{P}_{f}=\{\mathbf{f}(x)=(f_{1}(x),\dots,f_{m}(x))\ |\ x\in\mathcal{P}_{s}\} . At each iteration of a mobo algorithm, prior data is used to fit a surrogate model of the objectives, for which Gaussian processes ( Rasmussen, 2004 ) are predominantly used. Based on the surrogates, an approximation \tilde{\mathcal{P}}_{f} of the Pareto front is computed. The next point/batch to be evaluated is determined by maximizing the acquisition function , which estimates the utility of evaluating the objectives at a given point/batch. The most commonly used acquisition function is the hypervolume indicator \mathcal{H} ( Zitzler & Thiele, 1999 ) . The larger the hypervolume, the better \tilde{\mathcal{P}}_{f} approximates the true Pareto front. To determine how much the hypervolume would increase if a batch of samples \mathbf{B}\subseteq\mathbf{X} was added to the current approximation, hypervolume improvement is used: \text{HVI}(\mathbf{f}(\mathbf{B}),\tilde{\mathcal{P}}_{f})=\mathcal{H}(\tilde{\mathcal{P}}_{f}\cup\mathbf{f}(\mathbf{B}))-\mathcal{H}(\tilde{\mathcal{P}}_{f}). (1) Since dgemo ( Konakovic Lukovic et al., 2020 ) is the relevant mobo algorithm for our work, we briefly describe its batch selection strategy. It considers hypervolume improvement as well as sample diversity in the input space. To this end, the so called diversity regions \mathcal{R}_{1},\dots,\mathcal{R}_{K} are constructed by using the current Pareto front approximation to group the optimal points based on their performance properties in the input space. Formally, a