Data-Driven Distributionally Robust Mixed-Integer Control through Lifted Control Policy

Xutao Ma, Chao Ning, Wenli Du, Yang Shi · 2025

Read Data-Driven Distributionally Robust Mixed-Integer Control through Lifted Control Policy by Xutao Ma, Chao Ning, Wenli Du, Yang Shi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-05469.txt.

Introduction

Xutao Ma, Chao Ning, Wenli Du, and Yang Shi tackle control of uncertain linear systems when the controller must also make integer choices. Their setting is finite-horizon distributionally robust mixed-integer control. Finding an optimal causal feedback policy is computationally formidable for most ambiguity sets. The team proposes a distributionally robust lifted control policy that handles a rich class of Wasserstein metric-based ambiguity sets.

Theory backs the method with an asymptotic performance analysis and a tight non-asymptotic bound. Numerical experiments show the approach beating existing methods from the literature. The work aims at high-quality approximate solutions where exact ones are out of reach.

Catalog record

CREATORXutao Ma, Chao Ning, Wenli Du, Yang Shi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE75 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-05469

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Data-Driven Distributionally Robust Mixed-Integer Control through Lifted Control Policy Xutao Ma, Chao Ning, Wenli Du, Yang Shi Abstract This paper investigates the finite-horizon distributionally robust mixed-integer control (DRMIC) of uncertain linear systems. However, deriving an optimal causal feedback control policy to this DRMIC problem is computationally formidable for most ambiguity sets. To address the computational challenge, we propose a novel distributionally robust lifted control policy (DR-LCP) method to derive a high-quality approximate solution to this DRMIC problem for a rich class of Wasserstein metric-based ambiguity sets, including the Wasserstein ambiguity set and its variants. In theory, we analyze the asymptotic performance and establish a tight non-asymptotic bound of the proposed method. In numerical experiments, the proposed DR-LCP method empirically demonstrates superior performance compared with existing methods in the literature. I Introduction In the context of stochastic control, the probability distribution of uncertain disturbance is assumed to be perfectly known. However, in real-world scenarios, the underlying disturbance distribution is only partially observed from the historical uncertainty data. Therefore, any single estimated distribution based on this partial information inevitably deviates from the true one, resulting in poor control performance or even an unstable system [ 1 , 2 ] . To overcome such drawback of stochastic control, distributionally robust control (DRC) has emerged as a paradigm to hedge against this distribution deviation [ 3 , 4 , 5 , 6 , 7 , 8 , 9 , 10 , 11 , 12 ] . In the literature, statistical information such as the moment of different orders can be leveraged to construct a DRC problem [ 7 , 8 , 13 ] . More recently, the Wasserstein metric has been favored to cast a Wasserstein DRC problem thanks to its asymptotic convergence and tractable reformulation [ 6 , 14 , 15 , 16 ] , and many efficient solution algorithms have been developed [ 17 , 18 ] . With the merit of hedging against distributional ambiguity, DRC has been successfully applied to various control problems, such as model predictive control [ 7 , 19 , 20 , 21 , 22 ] , reinforcement learning [ 23 , 24 ] , and motion control [ 25 , 26 ] . However, the existing research on DRC considers only continuous controls in the system, neglecting the incorporation of integer controls, which model critical control actions in practice, such as the on/off decisions of machines in the process industry [ 27 ] . It is widely acknowledged that deriving an optimal control policy is computationally prohibitive for most DRC problems, due to the need to optimize over the infinite-dimensional space of all the admissible control policies. To address this computational challenge, approximate solution methods have been developed in previous research. Using a parameterized class of feedback control policies is a frequently adopted method to address dynamic control problems [ 28 , 29 ] . In reference [ 8 ] , an affine control policy (ACP) was employed to address moment-based DRC problems. However, the ACP excludes nonlinear control policies and typically leads to over-conservative control actions. For Wasserstein DRC problems, references [ 6 ] and [ 16 ] adopted a Wasserstein penalty relaxation and derived control policies for linear-quadratic Wasserstein DRC problems. However, their approach can only be applied to quadratic value function cases, while this condition typically does not hold for mixed-integer control problems. Therefore, there arises a pressing need to develop a unified approximate solution method that derives high-quality policies for both continuous and integer controls in DRC problems. To fill the research gaps, we propose a DR-LCP method by using the lifted control policy (LCP) to solve finite-horizon mixed-integer DRC problems under a class of Wasserstein-type ambiguity sets. The LCP was introduced by [ 30 ] and [ 31 ] , and the recent work [ 32 ] used the LCP to solve distributionally robust optimization (DRO) problems under relaxed Wasserstein ambiguity sets. Going beyond the previous research, we conduct an asymptotic performance analysis and establish a tight non-asymptotic performance bound of the proposed method, which can help us understand the performance of the proposed LCP method theoretically. Moreover, we develop an equivalent reformulation technique to derive the best LCP of the DRC problems under several Wasserstein-type ambiguity sets (including the standard Wasserstein ambiguity set) without any relaxation. Numerical experiments on a classic inventory control problem fully verify the superior performance of the proposed DR-LCP method compared with existing methods in the literature. The major contributions of this paper are summarized as follows. • We propose a novel DR-LCP method to use LCP to solve DRC problems under a class of Wasserstein-type ambiguity sets. • Theoretically, we conduct an asymptotic performance analysis and establish a tight non-asymptotic performance bound of the proposed DR-LCP method. The rest of the paper is structured as follows. Section II presents the DRMIC problem considered in this paper. The LCP formulation is introduced in Section III . We then conduct asymptotic and non-asymptotic analysis of the proposed method in Section IV . In Section V , we develop a solution methodology to find the optimal LCP solution to the DRMIC problem for a class of Wasserstein metric-based ambiguity sets. Subsequently, numerical experiments on an inventory control problem are conducted in Section VI . Conclusions are drawn in Section VII . Notation: Throughout the paper, bold symbols are used exclusively to denote vectors and matrices. \mathcal{T} is the control horizon. \boldsymbol{\xi}=(\boldsymbol{\xi}_{1}^{T},\cdots,\boldsymbol{\xi}_{\mathcal{T}}^{T})^{T} is the overall uncertain disturbance, where \boldsymbol{\xi}_{t}=({\xi}_{t,1},\cdots,{\xi}_{t,n_{\xi}})^{T} corresponds to n_{\xi} dimensional disturbance realized in time t and {\xi}_{t,i} is the i th dimension of \boldsymbol{\xi}_{t} . \boldsymbol{\xi}_{[t]}=(\boldsymbol{\xi}_{1},\cdots,\boldsymbol{\xi}_{t})^{T} represents disturbance up to time t . \varXi , \varXi_{[t]} , \varXi_{t} , and \varXi_{t,i} are support of \boldsymbol{\xi} , \boldsymbol{\xi}_{[t]} , \boldsymbol{\xi}_{t} , and {\xi}_{t,i} , respectively. The disturbance and support with superscript \ast stand for the corresponding lifted versions. \|\cdot\| represents 1-norm and \|\cdot\|_{\ast} is its dual norm, i.e. , \infty -norm. conv (\cdot) is the operator of taking the convex hull. [N] represents the set \{1,\cdots,N\} . II Problem Statement We consider an uncertain linear system with both continuous and integer controls, given as follows. {\boldsymbol{x}_{t+1}=\boldsymbol{A}_{t}\boldsymbol{x}_{t}+\boldsymbol{B}_{t}\boldsymbol{u}_{t}+\boldsymbol{C}_{t}\boldsymbol{\gamma}_{t}+\boldsymbol{D}_{t}\boldsymbol{\xi}_{t}}, (1) where \boldsymbol{x}_{t}\in\mathbb{R}^{n_{x}} is the state of the system, \boldsymbol{u}_{t}\in\mathbb{R}^{n_{u}} is the continuous control input, \boldsymbol{\gamma}_{t}\in{\mathbb{Z}}^{n_{\gamma}} is the integer control input, and \boldsymbol{\xi}_{t}\in\varXi_{t}\subset\mathbb{R}^{n_{\xi}} is the uncertainty in the form of disturbance. System ( 1 ) is subject to the linear constraint \begin{gathered}\sum_{t=1}^{\mathcal{T}}\tilde{\boldsymbol{A}}_{t}\boldsymbol{x}_{t}+\tilde{\boldsymbol{B}}_{t}\boldsymbol{u}_{t}+\tilde{\boldsymbol{C}}_{t}\boldsymbol{\gamma}_{t}+\tilde{\boldsymbol{D}}_{t}\boldsymbol{\xi}_{t}\leq\boldsymbol{q},\forall\boldsymbol{\xi}\in\varXi,\end{gathered} (2) where \tilde{\boldsymbol{A}}_{t},\tilde{\boldsymbol{B}}_{t},\tilde{\boldsymbol{C}}_{t},\tilde{\boldsymbol{D}}_{t} are the coefficient matrices. Concretely, constraint ( 2 ) can represent safety requirements, such as the need for the state to remain within a polyhedral safety set under any uncertainty realizations. In this paper, we assume that the uncertainty support \varXi is a hyperrectangle, which is crucial for the reformulation of the proposed method. Assumption 1 . The uncertainty support \varXi is a hyperrectangle. To handle the disturbance of the system, modeling of the joint distribution of \boldsymbol{\xi}=(\boldsymbol{\xi}_{1}^{T},\cdots,\boldsymbol{\xi}_{\mathcal{T}}^{T})^{T} is necessary. However, the true joint distribution of the disturbance is not perfectly known and is only partially observed from the data \widehat{\boldsymbol{\xi}}^{s},s=1,\cdots,N . Therefore, we can leverage the information in the data to construct a data-driven ambiguity set \mathscr{B}(\widehat{\boldsymbol{\xi}}^{1},\cdots,\widehat{\boldsymbol{\xi}}^{N}) . Based on the ambiguity set \mathscr{B} , we aim to find a causal disturbance feedback policy \boldsymbol{\pi}(\cdot)=(\pi^{u},\pi^{\gamma})=(\boldsymbol{u}_{1}^{\pi}(\cdot),\cdots,\boldsymbol{u}_{\mathcal{T}}^{\pi}(\cdot),\boldsymbol{\gamma}_{1}^{\pi}(\cdot),\cdots,\boldsymbol{\gamma}_{\mathcal{T}}^{\pi}(\cdot))

Read the complete text