Pontryagin Maximum Principle for rough stochastic systems and pathwise stochastic control
Ulrich Horst, Huilin Zhang · 2025
Read Pontryagin Maximum Principle for rough stochastic systems and pathwise stochastic control by Ulrich Horst, Huilin Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-22959.txt.
Introduction
Ulrich Horst and Huilin Zhang published this probability paper in 2025. It develops control theory for systems driven by rough, jagged noise, where the driving signal is too irregular for classical calculus. The Pontryagin maximum principle is the classic tool that characterizes optimal controls through necessary conditions. Extending it to rough stochastic systems, including controls that may anticipate the future, is the paper's goal.
The authors first show that a class of controlled rough equations is well-posed, with solutions that depend continuously on the driving path. That foundation lets them define pathwise control problems precisely. A flow transformation argument then yields a maximum principle that is both necessary and sufficient for optimality. They prove the rough problem and its pathwise twin share the same value. For the benchmark linear-quadratic case with bounded controls, they establish the matching result for the controls themselves.
Catalog record
| CREATOR | Ulrich Horst, Huilin Zhang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 130 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-22959
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Pontryagin Maximum Principle for rough stochastic systems and pathwise stochastic control Thanks: We thank Peter Karl Friz and Khoa Lê for helpful remarks and fruitful discussions. Financial support from the DFG CRC/TRR 388 “Rough Analysis, Stochastic Dynamics and Related Fields”, Projects B04 and B05, is gratefully acknowledged. Zhang is partially supported by the Fundamental Research Funds for the Central Universities, NSF of China and Shandong (Grant Numbers 12031009, ZR2023MA026), Young Research Project of Tai-Shan (No.tsqn202306054). Ulrich Horst, Huilin Zhang Abstract . We analyze a novel class of rough stochastic control problems that allows for a convenient approach to solving pathwise stochastic control problems with both non-anticipative and anticipative controls. We first establish the well-posedness of a class of controlled rough SDEs with affine rough driver and establish the continuity of the solution w.r.t. the driving rough path. This allows us to define pathwise stochastic control problems with anticipative controls. Subsequently, we apply a flow transformation argument to establish a necessary and sufficient maximum principle to identify and characterize optimal strategies for rough and hence pathwise stochastic control problems. We show that the rough and the corresponding pathwise stochastic control problems share the same value function. For the benchmark case of linear-quadratic problems with bounded controls a similar result is shown for optimal controls. Keywords: rough paths, rough control, Pontryagin Maximum Principle AMS subject classification: Primary 60L20, 60H10, 93E20 1. Introduction A standard stochastic control problem comprises a stochastic differential equation (SDE) of the form (1.1) \begin{split}dX_{s}&=b(s,X_{s},u_{s})ds+\sigma(s,X_{s},u_{s})dW_{s},\quad 0\leq t\leq s\leq T\end{split} with an initial condition X_{t}=x , where W is a multi-dimensional Brownian motion and u=(u_{t})_{t\in[0,T]} is a progressively measurable control, and the objective is to minimize an expected cost functional of the form (1.2) J(u;t,x)=\mathbb{E}\left[\int_{t}^{T}h(s,X_{s},u_{s})ds+g(X_{T})\Big|\mathcal{F}^{W}_{t}\right] over a set of admissible controls. Textbook control problems of the above form have been extended in numerous directions, including mean-field and singular control problems, which are by now also well understood. A less well-understood extension is pathwise stochastic control. Pathwise stochastic control models arise naturally when a decision maker can condition her choice on the realization of some exogenous noise process. Examples include stochastic volatility and utility optimization models where investors can condition their decisions on additional information such as the realization of some volatility process [ 3 , 6 ] as well as deep learning networks [ 4 , 17 ] in infinite layer limits, where the future of processes resulting from the initialization of deep neural network weights is fully available. The difference between classical control problems including models with partial observations and pathwise stochastic control problems boils down to measurability assumptions on admissible controls. Depending on the specific application, different measurability conditions may arise that require different mathematical settings, depending on whether controls may or may not - explicitly - depend on the future of a given noise process. 1.1. Pathwise stochastic control problems The interest in pathwise stochastic and anticipative control goes back at least to Davis and Burstein [ 8 ] who considered a stochastic optimal control problem with anticipative controls as a family of deterministic control problems parametrized by the paths of the driving Wiener process and a Lagrange multiplier that is adapted to future increments of the Wiener process. Similar Lagrange multipliers were used to a model of optimal stopping in the follow-up work [ 10 ] . Lions and Souganidis [ 22 , 23 ] introduced a pathwise stochastic control problem, where one controls the solution of the equation ( 1.1 ) for a given realization of some component of the driving Brownian motion. Specifically, they considered a stochastic control problem where the state dynamics follows an SDE of the form (1.3) \begin{split}dX^{{u}}_{s}&=b(s,X^{{u}}_{s},u_{s})ds+\sigma(s,X^{{u}}_{s},u_{s})dW_{s}+\hat{\sigma}(s,X^{{u}}_{s})\circ dB_{s}(\omega),\quad s\in[t,T]\\ X_{t}&=x\end{split} where W and B are independent Brownian motions whose canonical filtrations are denoted \mathcal{F}^{W} and \mathcal{F}^{B} , respectively, B_{\cdot}(\omega) is a given realization/path of the Brownian motion B , and \circ dB denotes the Stratonovich integral. Their objective is to minimize a conditional expected cost functional of the form (1.4) J(u;t,x)=\mathbb{E}\left[\int_{t}^{T}h(s,X^{{u}}_{s},u_{s})ds+g(X^{{u}}_{T})\Big|\mathcal{F}^{W}_{t}\otimes\mathcal{F}^{B}_{T}\right] over a set \mathcal{A} of ({\mathcal{F}}^{W}_{t})_{t\in[0,T]} -progressively measurable (“non-anticipative”) controls {u} . Buckdahn and Ma [ 6 ] proved a dynamic programming principle for this problem that allowed them to prove that the value function (1.5) v(\omega,t,x):=\mbox{essinf}_{{u}\in\mathcal{A}}J(u;t,x) is a stochastic viscosity solution to a non-linear stochastic HJB equation. To overcome the many and often subtle challenges that arise from the fact that the value function is now a random field for which no minimizing sequence may exist, they employed a Doss–Sussmann transformation to reduce their pathwise stochastic control problem to a more standard control problem that they called the wider sense control problem . The wider sense problem features a state dynamics that follows an SDE driven only by W , but whose coefficients depend on the Brownian path B(\omega) . Moreover, the set of admissible controls is given by a set of \tilde{\mathcal{A}} of (\mathcal{F}^{W}_{t}\otimes\mathcal{F}^{B}_{T})_{t\in[0,T]} -progressively measurable processes that depend on the full path of B (“anticipative controls”). Under suitable boundedness and continuity assumptions on the model parameters, it was then shown that the value functions of the pathwise stochastic and the wider sense control problem coincide. A priori, only nonanticipative controls are allowed in [ 6 , 22 , 23 ] . Anticipative controls were primarily a vehicle to solve the wider sense and eventually the pathwise control problem. At the same time, one would expect optimal controls to be anticipative; a specific example where this is indeed the case is given in [ 6 ] . This suggests to work right away with anticipative controls, and to consider instead the value function (1.6) \tilde{v}(\omega,t,x):=\mbox{essinf}_{{v}\in\tilde{\mathcal{A}}}J(v;t,x). This value function corresponds to an anticipative pathwise stochastic control problem where the state dynamics is perturbed by an observable, yet uncontrolled exogenous noise. A typical example would be the representative player’s optimization problem in a mean-field game with deterministic common noise if one is interested in understanding how the mean-field game equilibrium varies with the exogenous perturbation. Working with anticipative controls is closer in spirit to traditional stochastic control, where it is commonly assumed that controls are adapted to the filtration with respect to which conditional expectations are computed. In the pathwise stochastic control setting, this is the filtration (\mathcal{F}^{W}_{t}\otimes\mathcal{F}^{B}_{T})_{t\in[0,T]} . Using anticipative controls has been hindered so far by the fact that the state dynamics ( 1.3 ) is ill-posed as a standard Itô or Stratonovich integral equation when controls are allowed to depend on the full path B(\omega) . In particular, it may not be possible to define the optimal state dynamics of a non-anticipative pathwise stochastic control problem in the framework of traditional stochastic analysis. In this paper, we introduce a mathematical framework based on rough path theory that allows us to introduce a broad class of rough stochastic control problems, in terms of which we can define pathwise stochastic control problems with anticipative controls. We establish necessary and sufficient maximum principles for such problems and show that rough and anticipative control problems are equivalent. 1.2. Rough stochastic control problems To the best of our knowledge, Diehl et al. [ 12 ] were the first to apply rough path theory to optimal control. They considered a controlled dynamics of the form (1.7) \begin{split}dX_{s}&=b(X_{s},u_{s})ds+\Sigma(X_{s})d{\bm{\eta}}_{s},\quad s\in[t,T]\\ X_{t}&=x\end{split} driven by a