On Data-Driven Robust Optimization With Multiple Uncertainty Subsets: Unified Uncertainty Set Representation and Mitigating Conservatism
Yun Li, Neil Yorke-Smith, Tamas Keviczky · 2025
Read On Data-Driven Robust Optimization With Multiple Uncertainty Subsets: Unified Uncertainty Set Representation and Mitigating Conservatism by Yun Li, Neil Yorke-Smith, Tamas Keviczky (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-11867.txt.
Introduction
Yun Li, Neil Yorke-Smith, and Tamas Keviczky present a study from twenty twenty-five on robust plans when the unknown comes in many clumps. In data driven robust design, the set of possible bad cases is key. A union of many subsets gives a tight, flexible set. Two gaps block its use in control: hard math, and plans that play too safe.
They give one mixed integer form for the whole union set. The worst case then falls out of a single solve. A new aim blends robust and distribution robust views to trim the safe bias. A column and constraint method makes the sums run fast. Three case studies back the scheme.
Catalog record
| CREATOR | Yun Li, Neil Yorke-Smith, Tamas Keviczky |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 66 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-11867
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
On Data-Driven Robust Optimization With Multiple Uncertainty Subsets: Unified Uncertainty Set Representation and Mitigating Conservatism Yun Li, Neil Yorke-Smith, Tamas Keviczky Abstract Constructing uncertainty sets as unions of multiple subsets has emerged as an effective approach for creating compact and flexible uncertainty representations in data-driven robust optimization (RO). This paper focuses on two separate research questions. The first concerns the computational challenge in applying these uncertainty sets in RO-based predictive control. To address this, a monolithic mixed-integer representation of the uncertainty set is proposed to uniformly describe the union of multiple subsets, enabling the computation of the worst-case uncertainty scenario across all subsets within a single mixed-integer linear programming (MILP) problem. The second research question focuses on mitigating the conservatism of conventional RO formulations by leveraging the structure of the uncertainty set. To achieve this, a novel objective function is proposed to exploit the uncertainty set structure and integrate the existing RO and distributionally robust optimization (DRO) formulations, yielding less conservative solutions than conventional RO formulations while avoiding the high-dimensional continuous uncertainty distributions and incurring high computational burden typically associated with existing DRO formulations. Given the proposed formulations, numerically efficient computation methods based on column-and-constraint generation (CCG) are also developed. Extensive simulations across three case studies are performed to demonstrate the effectiveness of the proposed schemes. Journal: Journal of Process Control 1 Introduction Decision-making under uncertainty has gained increasing attention in both scientific research and engineering applications. One of the solutions for handling uncertainties in decisions is robust optimization (RO). By representing uncertainties via uncertainty sets, RO can ensure constraint satisfaction for all possible uncertainties without incurring an unaffordable computational burden and requiring the complete information of uncertainty distributions ( Ben-Tal and Nemirovski, 1998 ; Ben-Tal et al., 2009 ; El Ghaoui et al., 1998 ) . Despite the popularity and effectiveness of RO formulations, it is well-known that the optimal solution of RO problems can be conservative owning to two main factors. The first factor contributing to the conservatism of the robust optimal solution is how the uncertainty set is represented. In recent years, with the availability of abundant measurement data and machine learning techniques, data-driven approaches have been developed to construct compact uncertainty sets by uncovering and exploiting the latent features of the uncertainty data, see Shang et al. (2017) ; Shang and You (2019) ; Ning and You (2017) ; Ning and You (2018) ; Bertsimas et al. (2018) ; Cheramin et al. (2021) and references therein. Among these data-driven approaches, one innovative methodology is constructing the uncertainty set as a union of multiple subsets, see Ning and You (2017) ; Ning and You (2018) ; Li et al. (2024a) and references therein. By adopting such a methodology, the data-driven uncertainty set is able to adapt to irregular uncertainty distributions and ensure compactness, which is beneficial for reducing the conservatism of the corresponding robust optimal solutions. It should be noted that, while the methodology of representing uncertainty sets as unions of multiple subsets has been proven to be effective in several applications, such as power system operation ( Zhao and You, 2022 ) and building climate control ( Hu and You, 2023 ) , this uncertainty set representation together with the existing column-and-constraint generation (CCG)-based algorithm could result in computationally demanding optimization problems when applied in robust predictive control settings, which is generally neglected in the existing works. One widely adopted algorithmic solution for solving two-stage RO problems is the so-called CCG algorithm ( Zhao and Zeng, 2012 ; Zeng and Zhao, 2013 ) . When applying the existing CCG algorithm to solve the RO problem with multiple uncertainty subsets, each uncertainty subset entails solving one optimization problem to compute the worst-case uncertainty in each iteration of the CCG algorithm ( Ning and You, 2017 ) . As elaborated in Section 3 , the total number of uncertainty subsets in RO-based predictive control problems could increase exponentially with the length of the prediction horizon, which leads to computationally demanding or even intractable problems and limits the applicability of the existing approaches. The second major factor influencing the conservatism of RO solutions is how the objective function is designed. In conventional RO formulation, the objective function represents the worst-case performance, which can lead to conservative optimal solutions ( Ben-Tal and Nemirovski, 1998 ; Ben-Tal et al., 2009 ; Bertsimas and den Hertog, 2022 ; Ning and You, 2017 ) . For mitigating the conservatism of the optimal solution, some alternative objective functions are proposed, such as minimizing the expected performance in stochastic optimization (SO) ( Birge and Louveaux, 2011 ; Calafiore and Campi, 2006 ; Campi and Garatti, 2008 ) and optimizing the worst-case expected performance in distributionally robust optimization (DRO) ( Hanasusanto et al., 2015 ; Mohajerin Esfahani and Kuhn, 2018 ; Bertsimas et al., 2010 ; Bertsimas and den Hertog, 2022 ; Wei, 2020 ; Kuhn and Shafiee, 2024 ) . However, despite the effectiveness of these existing objective functions, they either require approximating the probability distribution of uncertainties, which could be high-dimensional and is non-trivial to obtain in practice, or entail solving a computationally demanding optimization problem. For example, in Moment-based DRO formulation ( Hanasusanto et al., 2015 ) , a semi-definite programming problem needs to be solved; in scenario-based SO ( Calafiore and Campi, 2006 ) and Wasserstein-based DRO formulation ( Mohajerin Esfahani and Kuhn, 2018 ) , the consideration of a large number of uncertainty scenarios leads to large-scale optimization problems and increased computational burden. Furthermore, the existing design of conservatism-reduced objective functions does not exploit the structure of uncertainty sets, especially the promising option of representing the uncertainty set as a union of multiple subsets in data-driven RO settings. By considering that the uncertainty set consists of multiple subsets, this paper mainly investigates two separate research questions: 1) how to properly represent the uncertainty set to deal with the computational challenge when applying it in RO-based predictive control problems ; and 2) how to exploit the uncertainty set structure to design new objective function for mitigating the conservatism of the robust optimal solution . The main contributions of this paper are summarized as follows: 1. A monolithic representation of the uncertainty set consisting of multiple subsets is proposed for RO-based predictive control problems. Given the proposed representation, a computationally efficient CCG algorithm is developed such that only a single MILP problem needs to be solved to compute the worst-case uncertainty scenario across all uncertainty subsets regardless of the length of the prediction horizon. In comparison, conventional solutions entail solving a set of optimization problems whose number grows exponentially with the prediction horizon ( Ning and You, 2017 ; Zeng and Zhao, 2013 ) . 2. Aiming at reducing the conservatism for optimizing the worst-case performance in conventional RO formulations, a novel objective function exploiting the structure of the uncertainty set together with a CCG-based computation method are proposed. By combining conventional RO and DRO formulations, the proposed objective function not only achieves less conservative solutions than conventional RO formulations but also avoids approximating the continuous and possibly high-dimensional uncertainty distribution and incurring high computational burden as with the existing SO and DRO formulations, especially in the case of fully adaptive recourse decision