Data-driven Distributionally Robust Control Based on Sinkhorn Ambiguity Sets
Riccardo Cescon, Andrea Martin, Giancarlo Ferrari-Trecate · 2025
Read Data-driven Distributionally Robust Control Based on Sinkhorn Ambiguity Sets by Riccardo Cescon, Andrea Martin, Giancarlo Ferrari-Trecate (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-20703.txt.
Introduction
Riccardo Cescon, Andrea Martin, and Giancarlo Ferrari-Trecate design controllers, in a 2025 preprint, that stay safe when the noise hitting a system is only partly known. Modern control systems face uncertainty that is hard to model exactly. A strong approach plans against a whole set of plausible noise distributions. That set is usually built around data samples with a Wasserstein distance. With few samples, though, the safety promise can fade fast. The authors add a smoothing penalty drawn from recent machine learning work.
Their sets, called Sinkhorn ambiguity sets, penalize drifting too far from a reference distribution. For finite-horizon linear control, the best robust policy can be found by convex programming. As the smoothing knob rises, that policy slides between two known answers. One is the pure Wasserstein robust solution, the other the plain stochastic one. A numerical test shows the method holds up when data is scarce.
Catalog record
| CREATOR | Riccardo Cescon, Andrea Martin, Giancarlo Ferrari-Trecate |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-20703
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Data-driven Distributionally Robust Control Based on Sinkhorn Ambiguity Sets Riccardo Cescon, Andrea Martin, Giancarlo Ferrari-Trecate Abstract As the complexity of modern control systems increases, it becomes challenging to derive an accurate model of the uncertainty that affects their dynamics. Wasserstein Distributionally Robust Optimization (DRO) provides a powerful framework for decision-making under distributional uncertainty only using noise samples. However, while the resulting policies inherit strong probabilistic guarantees when the number of samples is sufficiently high, their performance may significantly degrade when only a few data are available. Inspired by recent results from the machine learning community, we introduce an entropic regularization to penalize deviations from a given reference distribution and study data-driven DR control over Sinkhorn ambiguity sets. We show that for finite-horizon control problems, the optimal DR linear policy can be computed via convex programming. By analyzing the relation between the ambiguity set defined in terms of Wasserstein and Sinkhorn discrepancies, we reveal that, as the regularization parameter increases, this optimal policy interpolates between the solution of the Wasserstein DR problem and that of the stochastic problem under the reference distribution. We validate our theoretical findings and the effectiveness of our approach when only scarce data are available on a numerical example. I Introduction Standard stochastic optimal control theory relies on the assumption that a precise statistical description of the noise is available. However, in practice, its probability distribution is often observable only through a finite collection of noise samples. While these can be used to approximate the true distribution, such an estimate can be unsatisfactory for control design as it is heavily based on the quality of the collected data and the available prior knowledge of the unknown variables. When poor statistical information about the uncertainty is used to design controllers, one might face unexpected system behaviors with possible catastrophic out-of-sample performance [ 1 , 2 , 3 ] . Motivated by this observation, Distributionally Robust Optimization (DRO) has emerged as a promising paradigm to deal with uncertainty. It considers a minimax stochastic optimization problem over a neighborhood of the nominal distribution defined in terms of a distance in the space of probabilities. In this way, the solution can be robustified against the most averse distribution which is close in some sense to a nominal one, while the degree of conservatism of the underlying optimization can be modulated by adjusting how far the worst distribution can be from the nominal one. For choosing a proper ambiguity set, one needs to strike a balance between computational tractability and expressivity. In particular, the ambiguity set should be rich enough to cover all relevant distributions, while avoiding pathological distributions that could result in overly conservative decisions. Several methods have been explored for quantifying the similarity between probability distributions, such as the Kullback–Leibler divergence and the total variation distance [ 4 ] . Another possibility is to define the ambiguity set with distributions sharing moment information [ 5 ] . Among these, recent literature has highlighted the advantages of using metrics related to optimal transport (OT). In particular, ambiguity sets based on the Wasserstein metric [ 6 ] provide great expressiveness along with strong statistical out-of-sample guarantees. Thanks to these properties, Wasserstein ambiguity sets have been employed for designing DR control policies. In [ 7 ] the authors introduced a generalization of the finite-horizon LQG problem with noise belonging to a Wasserstein ball centered at a Gaussian nominal distribution. Other works focused on the infinite-horizon of the same problem when the nominal distribution is Gaussian [ 8 ] while [ 9 , 10 ] consider an empirical center. Among other contributions that exploit the Wasserstein metric, [ 11 , 12 , 13 , 14 ] , and [ 15 ] consider the design of tube-based predictive control schemes. More fundamentally, [ 16 ] provides exact characterizations of how Wasserstein ambiguity sets propagate through the system dynamics. Despite such encouraging results, the current Wasserstein DRO framework suffers from the following limitations. First, guaranteeing that the true distribution lies within the Wasserstein ambiguity set with high probability requires choosing a radius that is inversely proportional to the number of available data. If only a few noise samples are available, the corresponding radius may become too large, resulting in overly conservative policies. Second, from a modeling perspective, when the true distribution is continuous, Wasserstein DRO might not capture its nature. In fact, [ 17 ] showed that when the nominal distribution has finite support, the worst-case distribution will also be finitely supported. Motivated by these challenges, this paper makes the following three contributions. First, inspired by recent results in the machine learning and optimization community [ 18 , 19 , 20 ] , we use the Sinkhorn discrepancy [ 21 ] to define ambiguity sets and accordingly formulate a Sinkhorn DR finite-horizon control problem. Differently from the Wasserstein metric, this allows us to penalize deviations from a reference distribution and thus combine data with prior information about the true distribution. Second, we prove that, despite the additional entropic regularization term in the discrepancy, the Sinkhorn DR linear-quadratic control problem can be expressed as a finite-dimensional convex program when the prior is Gaussian. To do so, we specialize the strong duality result of [ 22 ] to the case of quadratic loss function and transportation cost given by the Euclidean norm, and leverage the system level parametrization of linear dynamic controllers [ 23 ] . Last, we derive relations between Sinkhorn and Wasserstein ambiguity sets, showing that the Sinkhorn policy interpolates between the solution of the Wasserstein DR optimal control problem and the \mathcal{H}_{2} stochastic problem under the reference distribution. These extremes are recovered when the regularization term vanishes or grows unbounded, respectively. These findings are validated with numerical examples. Notation . Throughout the paper, given a measurable set \mathcal{Z} , we will denote by \mathcal{P}(\mathcal{Z}) the set of probability distributions supported on \mathcal{Z} . We write \mu\ll\nu to denote that a measure \mu is absolutely continuous with respect to \nu . If \mu,\nu are two measures, \mu\times\nu represents the product measure. Let [n] be the set of indices \{1,\dots,n\} . The space of all positive semidefinite matrices of size d is denoted by \mathbb{S}^{d} . We denote by \|\cdot\| the Euclidean norm. Given a positive definite matrix A\in\mathbb{R}^{d\times d} , we denote the weighted norm as \|\cdot\|_{A} . The Frobenius norm of a matrix X\in\mathbb{R}^{m\times d} is \|X\|_{F} . The determinant of a square matrix A is denoted by |A| . Finally, the notation \star^{\top}AB is short for B^{\top}AB . II Problem Formulation and Preliminaries We consider the discrete-time linear time-varying system x_{t+1}=A_{t}x_{t}+B_{t}u_{t}+E_{t}w_{t}\,, (1) where x_{t}\in\mathbb{R}^{d},u_{t}\in\mathbb{R}^{m},w_{t}\in\mathbb{R}^{p} , A_{t}\in\mathbb{R}^{d\times d},B_{t}\in\mathbb{R}^{d\times m},E_{t}\in\mathbb{R}^{d\times p} for all t\in\{0,\dots,N-1\} , where N\in\mathbb{N} denotes the length of the control horizon. The evolution of ( 1 ), starting from the initial condition x_{0}\in\mathbb{R}^{d} , is characterized by the vectors \bm{x}=(x_{0}^{\top},\dots,x_{N-1}^{\top})^{\top} , \bm{u}=(u_{0}^{\top},\dots,u_{N-1}^{\top})^{\top} , and \bm{w}=(x_{0}^{\top},w_{0}^{\top},\dots,w_{N-2}^{\top})^{\top} . With this notation in place, ( 1 ) becomes \bm{x}=Z\mathbf{A}\bm{x}+Z\mathbf{B}\bm{u}+\mathbf{E}\bm{w}\,, (2) where Z is the block downshift operator, that is, a block matrix with identity matrices in its first block sub-diagonal and zeros elsewhere, \mathbf{A}\doteq\text{blkdiag}(A_{0},\dots,A_{N-1},0_{d\times d}) , \mathbf{B}\doteq\text{blkdiag}(B_{0},\dots,B_{N-1},0_{d\times m}) , and \mathbf{E}\doteq\text{blkdiag}(I_{d\times d},E_{0},\dots,E_{N-1}) . We denote the cost incurred by applying the input sequence \bm{u} in response