Nonlinear Stochastic Optimal Control and Optimal Stopping using the Fokker–Planck Transformation
Akan Selim, Siddhartha Ganguly, Ali Pakniyat, Panagiotis Tsiotras · 2026
Read Nonlinear Stochastic Optimal Control and Optimal Stopping using the Fokker–Planck Transformation by Akan Selim, Siddhartha Ganguly, Ali Pakniyat, Panagiotis Tsiotras (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-12153.txt.
Introduction
Selim and three colleagues build a deterministic picture of nonlinear stochastic control with optimal stopping, based on densities. For diffusion that does not depend on state, they recast the controlled Fokker-Planck equation as a flow equation. A score-corrected velocity field drives the flow, and its paths reproduce the marginal law of the random system. Stein-type identities then tie dynamic programming to the Hamilton-Jacobi-Bellman form. The authors also set out first-order rules for a common terminal time and for state-based stopping.
Catalog record
| CREATOR | Akan Selim, Siddhartha Ganguly, Ali Pakniyat, Panagiotis Tsiotras |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 148587 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.12153
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Nonlinear Stochastic Optimal Control and Optimal Stopping using the Fokker–Planck Transformation Thanks: A. Selim, S. Ganguly and P. Tsiotras are with \faGroup Daniel Guggenheim School of Aerospace, Georgia Institute of Technology, Atlanta, USA. A. Pakniyat is with \faGroup Department of Mechanical Engineering, University of Alabama, Tuscaloosa, USA Thanks: Contact Information: (AS) [email protected], (SG) https://sites.google.com/view/siddhartha-ganguly , [email protected], (AP): https://pakniyat.github.io/ , [email protected], (PT) https://dcsl.gatech.edu/tsiotras.html , [email protected]. Akan Selim, Siddhartha Ganguly, Ali Pakniyat, Panagiotis Tsiotras Abstract . In this paper, we develop a theoretical framework for nonlinear stochastic optimal control problems with optimal stopping by establishing a density-based deterministic representation of the underlying diffusion. For state-independent diffusion, we rewrite the controlled Fokker–Planck equation as a continuity equation driven by a score-corrected velocity field, yielding a deterministic characteristic dynamics that reproduces the marginal law of the stochastic system. Leveraging Stein-type identities, we show that the associated distributional dynamic programming equation admits the same second-order differential operator as the distributional stochastic Hamilton–Jacobi–Bellman formulation. Building on this representation, we formulate an optimal control problem with state-dependent terminal-time assignment and terminal distributional constraints and derive the first-order necessary conditions using variational analysis. We present the conditions both for a common terminal time and for the general case of state-dependent stopping. 2020 Mathematics Subject Classification 93E20, 93E03, 49K20, 49L99, 58E25, 65K10 1. Introduction In vast majority of stochastic optimal control problems, the objective is not merely to guide a single state trajectory, but to shape the entire distribution of possible system states. This perspective is natural in applications such as robotic swarms [ 55 ] , where one seeks to steer a population of agents toward a desired spatial distribution, and in aerospace guidance [ 30 , 65 ] , where uncertainty in sensing, actuation, or the environment makes distribution-level guarantees more meaningful than nominal trajectory tracking alone. Similar questions also arise in finance [ 8 , 9 ] , where one may wish to control the law of a stochastic process while deciding the appropriate time to stop, liquidate, or intervene. Optimal stopping has also been studied in related game-theoretic settings through non-anticipative stopping strategies; see, for instance, [ 10 ] . In such problems, one must determine both how to control the dynamics and when to stop the process . This coupling is fundamental: continuing for too long may increase risk, cost, or exposure to constraints, whereas stopping too early may prevent the system from reaching the desired terminal distribution. As a result, the problem is substantially more challenging than standard fixed-horizon distribution steering, since it combines stochastic dynamics, evolution of the full state law, and an endogenous stopping mechanism. These features make direct trajectory-based analysis difficult and call for a framework that can treat control, stopping, and distribution evolution in a unified manner. Motivated by this, in this paper we develop a density-based approach , based on a Fokker–Planck transformation , for nonlinear stochastic optimal control problems with optimal stopping and terminal distributional constraints. On existing literature: Significant progress has been made for the fixed final time problem, particularly through solutions to the classical Schrödinger Bridge Problem (SBP) [ 31 , 25 , 61 ] via the theory of optimal transportation [ 62 , 14 ] . However, less is known about the distribution steering problem with free final time, which is closely related to the problem of optimal stopping . The literature on optimal stopping is extensive and rich: the Skorokhod Embedding Problem (SEP) [ 56 , 57 ] addresses whether a stopping time can transform a Brownian motion into a random variable with a given target distribution. Skorokhod linked the problem of finding the optimal stopping times to the Shiryaev Inverse Problem (SIP) [ 32 ] , which, conversely, determines stopping boundaries for stochastic processes. In fact, the first hitting time of the stopping boundary is exactly the solution to the SEP; see [ 39 ] for further details. The seminal work [ 52 ] proposed using barriers in the combined state-time space to define stopping times. The ideas established in [ 52 ] connected SEP to variational inequalities and free-boundary problems [ 1 , 26 ] . [ 53 ] extended SEP to Markov processes using potential theory and proved Kiefer’s conjecture [ 33 ] , namely, that Root’s stopping time [ 52 ] embedding minimizes the variance of the stopping time [ 54 ] . [ 7 ] provided an alternative solution to SEP for any recurrent real-valued diffusion process; the authors employed Martingale theory to derive stopping times that maximize the law of the supremum of the stopped process. Recent studies extended their research to the drifting Brownian motion [ 28 , 46 ] . Multivariate generalizations of these results have also been studied, see, for instance [ 23 ] . A technique for constructing stopping times that minimize the distribution of the maximum of a stochastic process, while simultaneously maximizing the distribution of the minimum was established in [ 47 ] . This approach introduced a duality between the Azéma-Yor [ 7 ] and Perkins embeddings, where the former focuses on maximizing the law of the maximum of the process and the latter on minimizing it. Perkins’ duality [ 47 ] opened new avenues for constructing embeddings with different optimality criteria. His methods were later extended to general SEP frameworks in [ 29 ] . Furthermore, [ 49 ] proposed an optimal SEP formulation focused on cost minimization for steering a probability measure from one distribution to another in an optimal manner. More recent advances include multi-dimensional extensions, PDE-based free-boundary methods [ 27 ] , and neural network techniques for approximating stopping times [ 11 , 50 ] . PDE approaches, in particular, have enabled the characterization of free boundaries in stochastic differential equations (SDEs), yielding solutions to complex embedding problems [ 26 ] . On the other hand, research on duality and discretization methods [ 34 , 16 ] has investigated how duality principles with the Stochastic Maximum Principle (SMP) can be applied to optimal stopping problems, particularly those involving barrier-type stopping times like the Root and Rost embeddings [ 52 , 54 ] . A related but distinct line of work has recently extended the Schrödinger bridge framework to settings with killing and mass loss. In particular, [ 19 ] studies killed stochastic processes with prescribed spatio-temporal marginals of the killed particles, derives the associated space-time Schrödinger system, and proposes a Fortet-Sinkhorn-type algorithm for computing the corresponding bridge. On the other hand, [ 15 ] analyzes the interpolation of unbalanced endpoint marginals within an unbalanced Schrödinger bridge framework. Although these works are related in that they also treat the stopping in stochastic flows, their setting relies on a killing-field formulation, so that particles may stop anywhere in the killing region, whereas in our setting stopping is allowed only at a free-boundary that must itself be determined as part of the distribution-constrained optimal control and stopping problem. We also note that [ 42 ] considered filtration-adapted stochastic state steering via stochastic minimum-principle methods, enforcing terminal constraints on the conditional expectation of the state as information evolves in time; extensions to partially observed linear systems [ 41 ] have also been obtained. While these results capture an important notion