Flow matching for stochastic linear control systems
Yuhang Mei, Mohammad Al-Jarrah, Amirhossein Taghvaei, Yongxin Chen · 2024
Read Flow matching for stochastic linear control systems by Yuhang Mei, Mohammad Al-Jarrah, Amirhossein Taghvaei, Yongxin Chen (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-00617.txt.
Introduction
Yuhang Mei, Yongxin Chen, and co-authors steer chance clouds of bits from one spread to a goal spread through a straight control plant, in a 2024 paper. Uses span robot swarms and heat work with bits, where hands can push just through set push paths. Their way grows from flow match tricks in smart data tools.
The push rule is the mean push of bridge paths that obey plant rules. Clean forms fall out for key cases, and a number scheme is given for hard ones. Worked cases show the rule in play. Chance clouds can thus be herded with care through lean push paths.
Catalog record
| CREATOR | Yuhang Mei, Mohammad Al-Jarrah, Amirhossein Taghvaei, Yongxin Chen |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 28 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-00617
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Flow matching for stochastic linear control systems Yuhang Mei, Mohammad Al-Jarrah, Amirhossein Taghvaei, Yongxin Chen Abstract This paper addresses the problem of steering an initial probability distribution to a target probability distribution through a deterministic or stochastic linear control system. Our proposed approach is inspired by the flow matching methodology, with the difference that we can only affect the flow through the given control channels. The motivation comes from applications such as robotic swarms and stochastic thermodynamics, where agents or particles can only be manipulated through control actions. The feedback control law that achieves the task is characterized as the conditional expectation of the control inputs for the stochastic bridges that respect the given control system dynamics. Explicit forms are derived for special cases, and a numerical procedure is presented to approximate the control law, illustrated with examples. keywords Flow matching, Stochastic control, Mean-field control 1 Introduction Flow matching has recently gained attention as a promising method for generative modeling due to its simplicity and flexibility ( Lipman et al., 2022 ; Liu et al., 2022 ; Albergo and Vanden-Eijnden, 2022 ; Tong et al., 2023 ) . From a control-theoretic perspective, the methodology can be understood as follows. Consider the control system: \frac{\,\mathrm{d}X_{t}}{\,\mathrm{d}t}=u_{t},\quad X_{0}\sim P_{\text{initial}}, (1) where \{X_{t}\in\mathbb{R}^{n};0\leq t\leq 1\} is the state, \{u_{t}\in\mathbb{R}^{n};0\leq t\leq 1\} is the control input, and P_{\text{initial}} is the distribution of the initial state X_{0} . The control objective is to find a control input u_{t} such that the terminal state X_{1} follows a desired target distribution P_{\text{target}} . Flow matching offers a straightforward solution. First, a probability flow \{P_{t};0\leq t\leq 1\} is constructed on the space of probability distributions. This flow is chosen to interpolate between the initial and target distributions, i.e. P_{0}=P_{\text{initial}} and P_{1}=P_{\text{target}} , and is easy to sample from. A standard choice for P_{t} is the probability law of the linear interpolation process X^{z}_{t}=(1-t)x+ty where z=(x,y)\sim\Pi:=P_{\text{initial}}\otimes P_{\text{target}} . Then, the control input u_{t} is identified so that the probability of X_{t} , and P_{t} , both satisfy the same continuity equation. The resulting control input takes the form u_{t}=k(t,X_{t}) where the feedback control law k:[0,1]\times\mathbb{R}^{n}\to\mathbb{R}^{n} has the probabilistic representation k(t,\xi)=\mathbb{E}[\frac{\,\mathrm{d}X^{z}_{t}}{\,\mathrm{d}t}|X^{z}_{t}=\xi],\quad\forall(t,\xi)\in[0,1]\times\mathbb{R}^{n}. Through this procedure, the probability law of X_{t} matches P_{t} , for all t\in[0,1] , achieving the control objective X_{1}\sim P_{1}=P_{\text{target}} . A key computational advantage of flow matching is that the feedback control law k(t,\cdot) can be numerically approximated by solving a least-squares regression problem: \min_{k}\,\mathbb{E}_{z\sim\Pi}[\|k(t,X^{z}_{t})-\frac{\,\mathrm{d}X^{z}_{t}}{\,\mathrm{d}t}\|^{2}]. The aim of this paper is to extend the flow matching methodology to the general control setting where the simple control system ( 1 ) is replaced by a general deterministic or stochastic linear control system of the form ( 2 ) or ( 6 ). The notable difference from traditional flow matching is that here, adjustments to the differential equation are limited to control inputs, a constraint arising from engineering applications such as robotic swarms ( Chen et al., 2020 ; Gao et al., 2022 ; Elamvazhuthi and Berman, 2019 ; Liu et al., 2018 ) or stochastic thermodynamic systems ( Sekimoto, 2010 ; Peliti and Pigolotti, 2021 ; Seifert, 2012 ; Chen et al., 2019 ; Fu et al., 2021 ; Movilla Miangolarra, 2023 ) , where agents or particles can only be manipulated through control actions. The problem of controlling probability distributions has a rich history in control theory, dating back to Roger Brockett’s work on the control of Liouville equations ( Brockett, 2007 ; Brockett, 2012 ) . Interest in this area has expanded due to its connections with mean-field games ( Huang et al., 2006 ; Lasry and Lions, 2007 ; Chen et al., 2018 ) , mean-field control ( Bensoussan et al., 2013 ; Carmona et al., 2018 ; Fornasier and Solombrino, 2014 ) , optimal transportation/Schrödinger bridge problem ( Chen et al., 2016a ; Chen et al., 2016b ; Chen et al., 2021 ; Haasler et al., 2021 ; Zhou, 2021 ; Chen, 2023 ) . Namely, our work is closely related to Chen et al. (2015) which derives the optimal feedback control law that steers a stochastic linear control system from an initial Gaussian distribution to a Gaussian target distribution in an optimal manner. The flow matching methodology presented here generalizes the framework to non-Gaussian distributions, though it no longer guarantees optimality. Our work is also closely related to Liu et al. (2023) where flow matching is used to solve the generalized schrödinger bridge problem in an alternating optimization scheme. The difference in our setup is constraining the dynamics to linear control systems of the form ( 2 ) or ( 6 ) and forgoing optimality. While some notion of optimality could be introduced by designing an optimal coupling between the initial and target distributions (e.g., using the Sinkhorn algorithm for optimal sample pairing), this is not the focus of our work. This paper is organized as follows. Section 2 presents interpolations over deterministic and stochastic linear control system. Section 3 presents the generalization of the flow matching methodology to stochastic linear control systems, followed by the analytical derivation of the control law for special cases of Gaussian and mixture of Gaussian target distribution. Finally, Section 4 presents a numerical procedure which is demonstrated with the aid of several examples. 2 Background on interpolation through linear control systems In this section, we present interpolations that satisfy a given deterministic or stochastic linear control system. 2.1 Deterministic linear control system Consider the linear control system \displaystyle\frac{\,\mathrm{d}X_{t}}{\,\mathrm{d}t}=AX_{t}+Bu_{t}, (2) where X_{t}\in\mathbb{R}^{n} is the state and u_{t}\in\mathbb{R}^{m} is the control input, at time t . We consider the following control problem. Problem 1 . Given a pair of points (x,y)\in\mathbb{R}^{n}\times\mathbb{R}^{n} , find a trajectory \{X_{t};t\in[0,1]\} such that X_{0}=x , X_{1}=y , and ( 2 ) is satisfied for some control input \{u_{t};t\in[0,1]\} . This is a standard problem in control theory, forming the basis for controllability analysis of linear systems, e.g. see ( Basar et al., 2020 , Ch. 5) . In order to solve this problem, it is useful to define the controllability Gramian \displaystyle\Phi_{t}:=\int_{0}^{t}e^{(t-s)A}BB^{\top}e^{(t-s)A^{\top}}\,\mathrm{d}s,\quad\text{for}\quad t\in[0,1], and make the following assumption about the system. Assumption 1 . The pair (A,B) is controllable. That is to say, the matrix [B,AB,A^{2}B,\ldots,A^{n-1}B] is full-rank. Under the controllability Assumption 1 , it is known that the Gramian matrix \Phi_{t} is non-singular for all t>0 ( Basar et al., 2020 , Th. 5.1) . The following proposition states a solution to Problem 1 . The proof is standard and omitted on account of space. Proposition 1 . Problem 1 is solved with the control input \displaystyle u_{t} \displaystyle=B^{\top}e^{(1-t)A^{\top}}\Phi_{1}^{-1}(y-e^{A}x), (3) resulting into the interpolating trajectory \displaystyle X_{t}=e^{tA}x+\Phi_{t}e^{(1-t)A^{\top}}\Phi_{1}^{-1}(y-e^{A}x),\quad\text{for}\quad t\in[0,1]. (4) Moreover, ( 3 ) is the control input with minimum L_{2} -norm \int_{0}^{1}\|u_{t}\|^{2}\,\mathrm{d}t among all the control inputs that solve Problem 1 . Remark 2 . It is useful to express the control input ( 3 ) as a feedback control law u_{t}=k(t,X_{t}) where \displaystyle k(t,\xi)=B^{\top}e^{(1-t)A^{\top}}\Phi_{1-t}^{-1}(y-e^{(1-t)A}\xi),\quad\forall(t,\xi)\in[0,1]\times\mathbb{R}^{n}. (5) This is obtained by using ( 4 ) to solve for x , in terms of X_{t} and y , and substituting the result in ( 3 ). The feedback control law steers the system from any given initial point to y . Surprisingly, the same feedback control