Covariance Steering of Discrete-Time Markov Jump Linear Systems with Multiplicative Noise

Fangji Wang, Siddhartha Ganguly, Panagiotis Tsiotras · 2026

Read Covariance Steering of Discrete-Time Markov Jump Linear Systems with Multiplicative Noise by Fangji Wang, Siddhartha Ganguly, Panagiotis Tsiotras (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-19994.txt.

Introduction

Wang, Ganguly, and Tsiotras solve finite-horizon covariance steering for discrete-time Markov jump linear systems with multiplicative noise. They show feasible controls reduce to mode-dependent linear feedback plus feedforward and random parts, since purely affine feedback does not suffice. A lifted-state formulation unifies mean and covariance into second-moment variables, giving a lossless relaxation and, for the unconstrained case, an SDP form. Chance-constrained versions with ball and half-space limits gain tractable convex surrogates and a reference-update scheme, illustrated on a finance application.

Catalog record

CREATORFangji Wang, Siddhartha Ganguly, Panagiotis Tsiotras
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE92972
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.19994

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Covariance Steering of Discrete-Time Markov Jump Linear Systems with Multiplicative Noise Thanks: F. Wang, S. Ganguly and P. Tsiotras are with \faGroup Daniel Guggenheim School of Aerospace, Georgia Institute of Technology, Atlanta, USA. Thanks: Contact Information: (FW) [email protected], (SG) https://sites.google.com/view/siddhartha-ganguly , [email protected], (PT) https://dcsl.gatech.edu/tsiotras.html , [email protected]. Fangji Wang, Siddhartha Ganguly, Panagiotis Tsiotras Abstract . We study a finite-horizon covariance steering problem for discrete-time Markov jump linear systems (MJLS) with both state- and control-dependent multiplicative noise. The objective is to minimize a quadratic running cost while steering the system from given mode-conditioned initial means and covariances to a prescribed terminal mean and covariance. We first show that, without loss of generality, feasible controls may be represented by mode-dependent linear feedback together with feedforward and independent random components, and we highlight that, in contrast to the case without multiplicative noise, a purely affine state-feedback law does not in general suffice. To this end, we introduce a lifted-state formulation that embeds the mean and covariance information into a unified second-moment description, and we prove that the resulting lifted problem is equivalent to the original covariance steering problem formulation. This leads to a lossless relaxation in moment variables and an SDP reformulation for the unconstrained case. We further study chance-constrained covariance steering with ball and half-space constraints on the state and control, derive tractable sufficient convex surrogates, and establish an iterative reference-update scheme to reduce conservatism. Numerical experiments on a finance application illustrate our results. 1. Introduction Markov jump linear systems (henceforth referred to as MJLS) provide a natural modeling framework for controlled dynamical processes that evolve according to a finite collection of linear modes, which may undergo abrupt, random regime changes governed by a Markov chain; we refer the reader to [ 10 ] for a comprehensive introduction to MJLS and its controlled and noisy variants. Because many engineering and economic systems operate under changing environments, failures, mode switches, or regime-dependent parameters, MJLSs have become a standard tool and dynamical setting in stochastic control and systems theory [ 9 ] . They have been used to model, among other things: \circ aerospace [ 29 ] and robotics [ 42 ] , \circ power systems [ 19 ] and communication networks [ 28 ] , \circ fault-tolerant control architectures [ 39 ] , \circ macroeconomic [ 21 ] and financial systems [ 13 ] , as well as a variety of other engineering processes in which abrupt structural change cannot be neglected, and a control (perhaps under constraints) synthesis is necessary. In many applications, however, random switching is only one source of uncertainty. A second important source of uncertainty is stochastic noise, whose effect scales with the current state or the applied control, which is more appropriately represented by multiplicative noise rather than purely additive noise. The multiplicative noise regime of MJLSs is relevant, for example, when uncertainty intensifies with operating level, exposure, or actuation magnitude, as in regime-dependent financial systems, uncertain actuators, and stochastic systems with parameter fluctuations [ 45 , 24 , 12 ] . Consequently, MJLSs with multiplicative noise have attracted sustained attention in the literature, where they have been studied from the viewpoints of stochastic LQ control [ 45 ] , mean-variance control [ 11 ] , \mathcal{H}_{2} – \mathcal{H}_{\infty} analysis and control [ 14 ] , constrained model predictive control [ 6 ] , partial observation, and more recently reinforcement learning and asynchronous/hidden-mode designs [ 8 ] , [ 45 ] . Driven by the necessity to quantify and regulate uncertainty in controlled processes, recent research has focused increasingly on the distributional evolution of stochastic system trajectories. A foundational subset of this field is covariance control , which originated in the mid-1980s. A body of early works in this direction primarily investigated how state feedback could be employed to assign specific state covariances over infinite time horizons; see [ 17 , 7 , 44 , 15 ] for more details. Lately, there has been a substantial shift toward finite-horizon covariance steering for linear stochastic systems. These approaches typically aim to hit specific terminal covariance targets [ 25 ] , often while operating under chance constraints [ 34 ] , [ 33 ] to keep states and inputs within safe limits. In discrete-time regimes, much of the existing work has proceeded through optimization in an augmented state space, together with a convexification or relaxation of the resulting constraints [ 22 ] . Other directions include optimal transport-driven Wasserstein [ 2 , 35 ] and Gromov-Wasserstein terminal penalties [ 30 , 31 ] , Hilbert-Schmidt penalty [ 41 ] , receding-horizon covariance control, optimization-based steering of the full state distribution, and a substantial finite-horizon continuous-time literature [ 3 , 4 , 5 , 25 , 26 ] . Covariance steering architectures have also been adapted in data-driven and distributionally robust settings as well; see [ 36 , 37 ] . 1.1. Natural questions and motivation In the absence of multiplicative noise, a recent work [ 40 ] restricted the control policy to affine state-feedback laws and solved the resulting nonconvex problem in a conservative manner. However, the sufficiency of this parametrization has not been established, and, to the best of our knowledge, no approach solves the problem to optimality, even without chance constraints. Motivated by these limitations, and by the structural differences introduced by state- and control-dependent stochastic perturbations, in this paper, we consider the more general setting of MJLS with multiplicative noise. Given the preceding premise, several natural questions arise: ( \mathsf{Q} -a) Does it make sense to formulate covariance steering problems for MJLSs with multiplicative noise? ( \mathsf{Q} -b) Are such formulations relevant for practical applications? ( \mathsf{Q} -c) If so, how should covariance steering be posed for systems with regime jumps and state- and control-dependent stochastic perturbations? ( \mathsf{Q} -d) Is the family of affine state-feedback controllers sufficient to characterize feasible and/or optimal solutions in this setting? We answer ( Q -a) and ( Q -b) positively: covariance steering for MJLSs with multiplicative noise is both practically relevant and mathematically tractable. Question ( Q -c) is answered by developing a concrete problem formulation and a solution framework based on a lifted second-moment representation along with an SDP-based reformulation. In contrast, Question ( Q -d) is answered, in general, negatively : unlike covariance steering problems without multiplicative noise, the family of affine state-feedback controllers is not sufficient, in general, to characterize feasible or optimal solutions. This structural distinction is one of the main reasons a more general control parameterization and lifted formulation are required. This brings us to the main contributions of this article. 1.2. Contributions (1) Setting: For a broad class of discrete-time Markov jump linear systems with both state- and control-dependent multiplicative noise, we formulate a finite-horizon covariance steering problem, with mode-conditioned initial means and covariances, prescribed terminal mean and covariance, and a quadratic running cost. This is a novel class of problems not yet considered in the literature. Our formulation also admits a terminal covariance upper-bound variant, which is relevant in applications such as dynamic hedging and risk management. (2) Control parametrization: We show that, for the considered class of covariance steering problems, it is without loss of generality to consider a control law consisting of

Read the complete text