Forward-Backward Stochastic Linear-Quadratic Optimal Controls: Equilibrium Strategies and Non-Symmetric Riccati Equations

Qi Lü Bowen Ma Hanxiao Wang · 2025

Read Forward-Backward Stochastic Linear-Quadratic Optimal Controls: Equilibrium Strategies and Non-Symmetric Riccati Equations by Qi Lü Bowen Ma Hanxiao Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-14288.txt.

Introduction

Qi Lu, Bowen Ma, and Hanxiao Wang study, in a 2025 control theory paper, optimal steering of systems that run both forward and backward in time under randomness. Such control problems are time-inconsistent: the best plan made today is not the plan tomorrow's self would pick, so classic optimal controls are promises, not steady strategies.

The authors take a game view, where each moment's self plays against the others, and seek equilibrium strategies instead. The governing equations form a coupled, non-symmetric system whose solvability is genuinely hard. They crack it with advance estimates built from a clever combination of the unknowns, which turns out to mirror the equilibrium value itself.

Catalog record

CREATORQi Lü Bowen Ma Hanxiao Wang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE93 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-14288

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Forward-Backward Stochastic Linear-Quadratic Optimal Controls: Equilibrium Strategies and Non-Symmetric Riccati Equations Qi Lü Bowen Ma Hanxiao Wang Abstract Linear-quadratic optimal control problem for systems governed by forward-backward stochastic differential equations has been extensively studied over the past three decades. Recent research has revealed that for forward-backward control systems, the corresponding optimal control problem is inherently time-inconsistent. Consequently, the optimal controls derived in existing literature represent pre-committed solutions rather than dynamically consistent strategies. In this paper, we shift focus from pre-committed solutions to addressing the time-inconsistency issue directly, adopting a dynamic game-theoretic approach to derive equilibrium strategies. Owing to the forward-backward structure, the associated equilibrium Riccati equation (ERE) constitutes a coupled system of matrix-valued, non-local ordinary differential equations with a non-symmetric structure. This non-symmetry introduces fundamental challenges in establishing the solvability of the EREs. We overcome the difficulty by establishing a priori estimates for a combination of the solutions to EREs, which, interestingly, is a representation of the equilibrium value function. 1 Introduction Let W(\cdot) be a standard one-dimensional Brownian motion defined on a complete filtered probability space (\Omega,{\cal F},{\mathbb{F}},{\mathbb{P}}) , where {\mathbb{F}}=\{{\cal F}_{t}\}_{t\geq 0} is the augmented natural filtration generated by W(\cdot) . Fix T>0 , and denote by {\mathbb{S}}^{n} the subspace of {\mathbb{R}}^{n\times n} consisting of symmetric matrices, and {\mathbb{S}}_{+}^{n} the subset of {\mathbb{S}}^{n} comprising positive semi-definite matrices. For any initial time t\in[0,T) and state x in L_{{\cal F}_{t}}^{2}(\Omega;{\mathbb{R}}^{n}) (the space of {\cal F}_{t} -measurable, square-integrable random variables), consider the following controlled forward-backward stochastic differential equation (FBSDE) on [t,T] : \begin{cases}dX(s)=\big[A(s)X(s)+B(s)u(s)\big]ds+\big[C(s)X(s)+D(s)u(s)\big]dW(s),\\ dY(s)=-\big[\widehat{A}(s)X(s)+\widehat{B}(s)u(s)+\widehat{C}(s)Y(s)+\widehat{D}(s)Z(s)\big]ds+Z(s)dW(s),\\ X(t)=x,\quad Y(T)=HX(T),\end{cases} (1.1) where A(\cdot),C(\cdot):[0,T]\to{\mathbb{R}}^{n\times n} , B(\cdot),D(\cdot):[0,T]\to{\mathbb{R}}^{n\times k} , \widehat{C}(\cdot),\widehat{D}(\cdot):[0,T]\to{\mathbb{R}}^{m\times m} , \widehat{A}(\cdot):[0,T]\to{\mathbb{R}}^{m\times n} , and \widehat{B}(\cdot):[0,T]\to{\mathbb{R}}^{m\times k} are given bounded deterministic functions, H\in{\mathbb{R}}^{m\times n} , and u(\cdot) is the control process in {\cal U}[t,T] , the space of {\mathbb{R}}^{k} -valued, square-integrable, {\mathbb{F}} -adapted processes on [t,T]\times\Omega . The associated cost functional is given by \displaystyle{\cal J}^{0}(t,x;u(\cdot)) \displaystyle=\frac{1}{2}{\mathbb{E}}_{t}\Big[\int_{t}^{T}\Big(\langle Q(s)X(s),X(s)\rangle+\langle R(s)u(s),u(s)\rangle+\langle M(s)Y(s),Y(s)\rangle \displaystyle\qquad+\langle N(s)Z(s),Z(s)\rangle\Big)ds+\langle G_{1}X(T),X(T)\rangle+\langle G_{2}Y(t),Y(t)\rangle\Big], (1.2) where Q(\cdot):[0,T]\to{\mathbb{S}}^{n} , R(\cdot):[0,T]\to{\mathbb{S}}^{k} , and M(\cdot),N(\cdot):[0,T]\to{\mathbb{S}}^{m} are bounded matrix-valued functions, G_{1}\in{\mathbb{S}}^{n} , and G_{2}\in{\mathbb{S}}^{m} . The optimal control problem for ( 1.1 ) and ( 1.2 ) can be stated as follows: Problem (FBSLQ). For any given initial pair (t,x)\in[0,T)\times L_{{\cal F}_{t}}^{2}(\Omega;{\mathbb{R}}^{n}) , find an optimal control u^{*}(\cdot)\in{\cal U}[t,T] such that {\cal J}^{0}(t,x;u^{*}(\cdot))=\inf_{u(\cdot)\in{\cal U}[t,T]}{\cal J}^{0}(t,x;u(\cdot))=V^{0}(t,x). (1.3) The aforementioned problem is usually referred to as a linear-quadratic optimal control (LQ, for short) problem for forward-backward stochastic differential equations. A control process u^{*}(\cdot)\in{\cal U}[t,T] satisfying ( 1.3 ) is called an optimal control for the given initial pair (t,x) . LQ problem for forward stochastic differential equations (SDEs) was first investigated by Wonham [ 28 ] in the 1960s, and has since remained a cornerstone of stochastic control theory. While our current work focuses on forward-backward systems, we refer readers to several classical texts [ 32 , 1 , 24 ] for comprehensive surveys, tutorials, and extensive references on this foundational topic. The solvability of general nonlinear backward stochastic differential equations (BSDEs) was first established by Pardoux and Peng [ 20 ] , marking a breakthrough that established BSDEs as a fundamental tool in stochastic control theory and mathematical finance. This development naturally motivated the study of optimal control problems for systems governed by BSDEs or FBSDEs. The study of optimal control problems for FBSDEs holds significant theoretical and practical importance, particularly in financial applications involving investment problems with specified future conditions (modeled as random variables) [ 6 , 7 , 17 , 16 ] . These problems also play an important role in stochastic differential game theory, where forward-backward LQ optimal control problems naturally emerge in leader-follower game formulations [ 1 , 29 ] . Due to these fundamental connections, LQ problems for FBSDEs have attracted considerable research attention. Important contributions include: Lim’s application of backward LQ control theory to quadratic hedging and mean-variance portfolio selection [ 16 ] ; Huang, Li, and Wang’s work on near-optimal control [ 11 ] ; Wang, Wu, and Xiong’s study of partial information problems [ 26 ] ; Sun, Wu, and Xiong’s extension to indefinite cost functionals [ 25 ] ; Sun, Wang, and Wen’s investigations of Stackelberg games [ 22 ] ; and Hu, Ji, and Xue’s comprehensive analysis of fully coupled FBSDEs [ 12 ] . Despite these advances, a fundamental challenge remains unresolved: How to establish the solvability of the Riccati equation associated with Problem (FBSLQ)? This persists as an open problem even under the strong assumption of uniformly positive definite weighting matrices in the cost functional. Recent work by Wang, Yong, and Zhou [ 27 ] has revealed that the forward-backward structure of the state equation inherently induces time-inconsistency in the corresponding optimal control problem. This discovery establishes that Problem (FBSLQ) is generically time-inconsistent. For concrete illustrations of this phenomenon, we refer to [ 27 , Example 1.1] and [ 18 , Example 1.2] , which provide explicit counterexamples to demonstrate this time-inconsistency. In practical applications, time inconsistency poses a significant challenge: the optimal control derived at the initial time may lose its optimality as the system evolves, necessitating continuous strategy adjustments by decision-makers. The earliest mathematical consideration of time-inconsistent optimal controls was given by Strotz [ 21 ] , followed by the recent works of Ekeland and Pirvu [ 8 ] , Ekeland and Lazrak [ 9 ] , Björk, Khapko, and Murgoci [ 3 ] , and Yong [ 30 , 31 ] for various kinds of problems, to mention a few. For the time-inconsistent stochastic LQ problems, Hu, Jin, and Zhou [ 13 , 14 ] considered the equilibrium solution in the open-loop sense; Yong [ 31 ] studied the closed-loop equilibrium strategy by introducing the multi-person differential game method; Dou and Lü [ 5 ] extended the result of [ 31 ] to the infinite-dimensional system described by a stochastic evolution equation; Lazrak, Wang, and Yong [ 15 ] studied a special zero-sum game problem motivated by some financial applications; Cai et al. [ 4 ] gave some equivalent characterizations of the existence of a closed-loop equilibrium strategy for ODEs. Further, to account for subjective time preference–another fundamental source of time-inconsistency–we introduce the following generalized cost functional extending ( 1.2 ): \displaystyle{\cal J}(t,x;u(\cdot)) \displaystyle=\frac{1}{2}{\mathbb{E}}_{t}\Big[\int_{t}^{T}\Big(\langle Q(t,s)X(s),X(s)\rangle+\langle R(t,s)u(s),u(s)\rangle+\langle M(t,s)Y(s),Y(s)\rangle \displaystyle\qquad+\langle N(t,s)Z(s),Z(s)\rangle\Big)ds+\langle G_{1}(t)X(T),X(T)\rangle+\langle G_{2}(t)Y(t),Y(t)\rangle\Big]. (1.4) We refer to the control problem with state equation ( 1.1 ) and cost functional ( 1.4 ) as Problem (TI-FBSLQ) . To continue, we introduce some notations that will be used consistently throughout this paper. For any matrices M\in{\mathbb{R}}^{n\times m} , let |M| denote its spectral norm, which equals the square root of the largest eigenvalue of M^{\top}M , and |M|_{\rm Tr} its trace norm, which equals the sum of the square roots of the eigenvalues of M^{\top}M . Furthermore, for time interval 0\leq t_{1}\leq t_{2}\leq T , we introduce the triangular domain \Delta^{*}[t_{1},t_{2}]=\{(t,s)\in[t_{1},t_{2}]^{2}\hbox{ with }t\leq s\}. For an arbitrary Euclidean space {\mathbb{H}} , we introduce the following function spaces: \displaystyle L^{2}(0,T;\,{\mathbb{H}})=\Big\{\varphi:[0,T]\to{\mathbb{H}}\bigm|\varphi(\cdot)~\hbox{is measurable, }\int_{0}^{T}|\varphi(s)|^{2}ds<\infty\Big\}; \displaystyle L^{\infty}(0,T;\,{\mathbb{H}})=\Big\{\varphi:[0,T]\to{\mathbb{H}}\bigm|\varphi(\cdot)~\hbox{is measurable, }\mathop{\rm esssup}_{0\leq s\leq T}|\varphi(s)|<\infty\Big\}; \displaystyle C([0,T];\,{\mathbb{H}})=\Big\{\varphi:[0,T]\to{\mathbb{H}}\bigm|\varphi(\cdot)~\hbox{is continuous, }\sup_{0\leq s\leq T}|\varphi(s)|<\infty\Big\}; \displaystyle C(\Delta^{*}[0,T];\,{\mathbb{H}})=\Big\{\varphi:\Delta^{*}[0,T]\to{\mathbb{H}}\bigm|\varphi(\cdot,\cdot)~\hbox{is continuous, }\sup_{0\leq t\leq s\leq T}|\varphi(t,s)|<\infty\Big\}; \displaystyle C^{\infty}([0,T];\,{\mathbb{H}})=\Big\{\varphi:[0,T]\to{\mathbb{H}}\bigm|\varphi(\cdot)~\hbox{is infinitely differentiable}\Big\}; \displaystyle L_{{\cal F}_{t}}^{2}(\Omega;\,{\mathbb{H}})=\Big\{\varphi:\Omega\to{\mathbb{H}}\bigm|\varphi(\cdot)~\hbox{is ${\cal F}_{t}$-measurable},\quad{\mathbb{E}}\big[|\varphi(\omega)|^{2}\big]<\infty\Big\}; \displaystyle L_{\mathbb{F}}^{2}(\Omega;C([0,T];{\mathbb{H}}))=\Big\{\varphi:[0,T]\times\Omega\to{\mathbb{H}}\bigm|\varphi(\cdot)~\hbox{is ${\mathbb{F}}$-adapted, pathwise continuous, }{\mathbb{E}}\Big[\displaystyle\sup_{0\leq s\leq T}|\varphi(s)|^{2}\Big]<\infty\Big\}; \displaystyle L_{\mathbb{F}}^{2}(0,T;\,{\mathbb{H}})=\Big\{\varphi:[0,T]\times\Omega\to{\mathbb{H}}\bigm|\varphi(\cdot)~\hbox{is ${\mathbb{F}}$-progressively measurable, }{\mathbb{E}}\Big[\int_{0}^{T}|\varphi(s)|^{2}ds\Big]<\infty\Big\}. Next, we introduce the following assumptions:

Read the complete text