Collaborative Contextual Bayesian Optimization
Chih-Yu Chang, Qiyuan Chen, Tianhan Gao, David Fenning, Chinedum Okwudire, Neil Dasgupta, Wei Lu, Raed Al Kontar · 2026
Read Collaborative Contextual Bayesian Optimization by Chih-Yu Chang, Qiyuan Chen, Tianhan Gao, David Fenning, Chinedum Okwudire, Neil Dasgupta, Wei Lu, Raed Al Kontar (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-18912.txt.
Introduction
Chang and seven colleagues propose Collaborative Contextual Bayesian Optimization, a framework for many clients to learn designs for each context jointly. Contextual optimization must map each context to its best design, weighing exploration across contexts with exploitation within each. The framework supports online collaboration and offline start from peer beliefs, with private messaging. The authors prove slow regret growth and test the method in simulations and a real hot rolling application. It beats existing approaches even when clients differ.
Catalog record
| CREATOR | Chih-Yu Chang, Qiyuan Chen, Tianhan Gao, David Fenning, Chinedum Okwudire, Neil Dasgupta, Wei Lu, Raed Al Kontar |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 69129 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.18912
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Collaborative Contextual Bayesian Optimization Chih-Yu Chang, Qiyuan Chen, Tianhan Gao, David Fenning, Chinedum Okwudire, Neil Dasgupta, Wei Lu, Raed Al Kontar Abstract Discovering optimal designs through sequential data collection is essential in many real-world applications. While Bayesian Optimization (BO) has achieved remarkable success in this setting, growing attention has recently turned to context-specific optimal design, formalized as Contextual Bayesian Optimization (CBO). Unlike BO, CBO is inherently more challenging as it must approximate an entire mapping from the context space to its corresponding optimal design, requiring simultaneous exploration across contexts and exploitation within each. In many modern applications, such tasks arise across multiple potentially heterogeneous but related clients, where collaboration can significantly improve learning efficiency. We propose CCBO , Collaborative Contextual Bayesian Optimization, a unified framework enabling multiple clients to jointly perform CBO with controllable contexts, supporting both online collaboration and offline initialization from peers’ historical beliefs, with an optional privacy-preserving communication mechanism. We establish sublinear regret guarantees and demonstrate, through extensive simulations and a real-world hot rolling application, that CCBO achieves substantial improvements over existing approaches even under client heterogeneity. The code to reproduce the results can be found at this URL . Identifying an optimal design that yields the best possible response is critical in many applications, where the relationship between the design and the response is typically unknown. This problem is known as a black-box optimization task ( 14 ) where the search for the optimal response is naturally framed as solving a maximization problem. More specifically, the goal is to identify the optimal design x^{*}=\arg\max_{x}~f(x) , where f is the response function and x represents the design variable(s). Bayesian optimization (BO) has been established, both theoretically and empirically, as an effective and efficient framework for black-box optimization under limited experimental budgets. BO leverages historical observations to construct a probabilistic surrogate model, which encodes the current belief about the underlying response function. An acquisition function (AF), defined on top of the surrogate, then guides the sequential search by balancing exploration and exploitation. At each iteration, the design that maximizes the AF is selected, its response is observed, and this new data point is incorporated into the historical dataset to update the surrogate model until the evaluation budget is exhausted. For recent surveys on BO and its advances, see ( 14 ; 23 ) . In many real-world applications, the goal is not to identify a single optimal design, but to find context-specific optimal designs. For instance, in medical treatment, the optimal drug dosage (the design) may depend on a patient’s age or weight (the context). Similarly, in manufacturing, the optimal operating parameters may change with target product specifications. The BO counterpart of such problems has been recently referred to as Contextual BO (CBO). More specifically, the response function in CBO is modeled as f(x,c) , where x and c denote the design and context variables, respectively. At each iteration, a context-design pair is selected for evaluation (i.e., to observe its response). Here, it is worth noting that in some settings, the context is controllable and can be deliberately chosen by the experimenter, while in others it may be observed externally and cannot be controlled. For example, in additive manufacturing, one may optimize printing parameters such as speed or laser power while treating the target part thickness as the context; in this case, the experimenter can choose/control which thickness to test at each iteration. In this paper, we focus on the controllable-context setting, where the learner is free to select which contexts to sample in order to efficiently approximate the context-specific optimal design x^{*}(c)=\arg\max_{x}f(x,c) by sequentially collecting context-design-response observations. This setting is often referred to as offline CBO (OCBO) ( 7 ) , which forms an important branch of CBO. Given this formulation, BO is a special case of CBO in which the context space collapses to a single point ( 5 ; 1 ) . From a practical perspective, a central benefit of CBO is that it can act as a recommendation system . In particular, once the context-specific optimal design function x^{*}(c) is learned, it can serve as a recommender: for any observed context c (e.g., a target part thickness), one can immediately obtain the optimal design variables (printing speed and laser power) by evaluating x^{*}(c) , without restarting the experimentation process. That said, while practically relevant, CBO is substantially more resource-consuming than BO, as it introduces a new challenge: estimating an entire function that maps contexts to their corresponding optimal designs, instead of identifying a single optimal point. This requires exploration across the context space, in addition to the usual exploration-exploitation tradeoff within each context. Fortunately, many modern applications involve multiple related clients or experimental units, where collaboration can significantly improve learning efficiency. For example, similar manufacturing machines operating at different locations may seek to collaborate so that context-specific optimal designs can be learned more efficiently by borrowing strength from each other. With the rise of collaborative and distributed learning paradigms such as federated learning ( 27 ; 29 ) bringing collaboration into optimal design has become more important than ever. Motivated by this opportunity, we propose Collaborative Contextual BO ( CCBO ), a unified framework that enables multiple clients to jointly perform CBO through cross-client collaboration. To the best of our knowledge, this is the first collaborative approach explicitly designed to enhance the efficiency of CBO. The main contributions of this work are summarized as follows: • Collaborative CBO framework : We introduce a unified framework for CBO that enables multiple, potentially heterogeneous , clients to jointly learn the mapping x^{*}(c) by sharing information across related tasks, improving sample efficiency compared to independent optimization. The framework also supports an offline collaborative initialization mode, where a single client benefits from peers’ historical knowledge without requiring coordinated experimentation. • Disagreement-driven switching : We propose a novel decision mechanism that identifies contexts where local and global recommendations differ and uses this disagreement to guide information sharing. This is coupled with an adaptive switching strategy that balances collaborative and client-specific decisions over time. • Theoretical guarantees : We establish sublinear regret for the proposed method, showing that it consistently improves its approximation of context-specific optimal designs as more data are collected. The remainder of this paper is organized as follows. In Sec. 1 , we review the related literature. In Sec. 2 , we provide the mathematical formulation of the problem. The proposed algorithm is introduced in Sec. 2.2 . Its theoretical properties are established in Sec. 3 and 2.3 . Sec. 4 presents extensive evaluations of the proposed algorithm on multiple benchmarks under varied settings. A real-world application to metal manufacturing is then demonstrated in Sec. 5 . Finally, we conclude the paper in Sec. 6 , where we also discuss limitations and directions for future work. 1 Related Works As highlighted earlier, the key distinction between BO and CBO is that CBO requires the learner to approximate a context-dependent optimal design function x^{*}(c) rather than identifying a single global optimum. Existing work on CBO can be broadly categorized based on whether the design and/or context spaces are treated as discrete or continuous. The discrete case is often studied under the contextual bandit problem framework and has been