A PDE-constrained Optimization Approach to Optimal Trajectory Planning under Uncertainty via Reflected Schrödinger Bridges
Wenxin Liu, Dante Kalise · 2025
Read A PDE-constrained Optimization Approach to Optimal Trajectory Planning under Uncertainty via Reflected Schrödinger Bridges by Wenxin Liu, Dante Kalise (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-14355.txt.
Introduction
Dante Kalise and Wenxin Liu plan paths for systems with noise by solving field equations, not by tracking swarms of sample paths. Their route uses a Schrödinger bridge: the cheapest way to steer a noisy speck from a set start spread to a set end spread, with walls that bounce the speck back. That task is a pair of linked nonlinear equations, one for the density and one for the cost.
A classic change of variables turns the pair into two plain flow-and-spread equations, one run forth in time and one back. Stock finite element tools solve them fast. The weak form makes the bounce rule hold on its own. Tests on hard three-dimensional mazes show quick settling and exact mass kept.
Catalog record
| CREATOR | Wenxin Liu, Dante Kalise |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 25 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-14355
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A PDE-constrained Optimization Approach to Optimal Trajectory Planning under Uncertainty via Reflected Schrödinger Bridges Wenxin Liu, Dante Kalise Abstract A computational PDE-constrained optimization approach is proposed for optimal trajectory planning under uncertainty by means of an associated Schrödinger Bridge Problem (SBP). The proposed SBP formulation is interpreted as the mean-field limit associated to the energy-optimal evolution of a particle governed by a stochastic differential equation (SDE) with nonlinear drift and reflecting boundary conditions, constrained to initial and terminal densities for its state. The resulting mean-field system consists of a nonlinear Fokker-Planck equation coupled with a Hamilton-Jacobi-Bellman equation, subject to two-point boundary conditions in time and Neumann boundary conditions in space. Through the Hopf-Cole transformation, this nonlinear system is recast as a pair of forward-backward advection-diffusion equations, which are amenable to efficient numerical solution via standard finite element discretization. The weak formulation naturally enforces reflecting boundary conditions without requiring explicit particle-boundary collision detection, thus circumventing the computational difficulties inherent to particle-based methods in complex geometries. Numerical experiments on challenging 3D maze configurations demonstrate fast convergence, mass conservation, and validate the optimal controls computed through reflected SDE simulations. I Introduction Optimal pathfinding in constrained and complex environments under uncertainty remains a relevant challenge across robotics [ 10 ] , physics, and computational mathematics [ 3 ] . Beyond algorithmic approaches, several physical-chemical systems have demonstrated that optimal paths can naturally emerge from gradient-driven transport phenomena. For instance, Lagzi et al. [ 12 ] and Lovass et al. [ 13 ] showed that droplets or tracers can autonomously traverse mazes along the steepest descent of chemical or thermal potentials, effectively realizing physical analogues of optimal transport. These studies indicate that minimum energy trajectories can emerge from self-organization within constrained geometries under appropriate gradient fields. Classical optimal transport (OT) [ 16 ] provides a complete mathematical framework to describe the displacement of mass under prescribed costs and constraints. However, extending OT to domains with reflecting boundaries, drift fields, or dynamic obstacles remains analytically and computationally demanding. In robotics, for example, autonomous agents must plan motions in cluttered spaces while avoiding obstacles and possibly following external or preferred drifts, conditions that naturally correspond to constrained OT formulations with reflection. The Schrödinger Bridge problem (SBP) [ 15 , 9 ] offers a stochastic perspective to optimal transport, naturally handling diffusion and uncertainty. However, incorporating general prior drifts and reflecting boundaries, which are essential for obstacle avoidance, significantly complicates the problem. Existing approaches based on Wasserstein proximal recursion (WPR) [ 5 , 7 , 6 ] rely on particle-based SDE simulations with interpolation to approximate PDE solutions, which becomes impractical on complex 3D geometries. Moreover, accurately enforcing reflection conditions for particle trajectories on curved, non-convex boundaries is notoriously difficult. In this paper, we propose a computational PDE-constrained optimization approach to the SBP with nonlinear prior drift and reflecting boundary conditions. The SBP corresponds to an optimal control problem where kinetic energy is minimized subject to a Fokker-Planck PDE with Neumann boundary conditions, together with initial and terminal densities. The first-order optimality conditions arising from the SBP, after a Hopf-Cole transformation, are cast as a system of 2 linear, forward-backward advection-diffusion equations where coupling only arise at initial and terminal time. The idea of simplifying the forward-backward structure of the optimality system via a Hopf-Cole transform has been explored beyond SBP, extending to related problems such as mean field games [ 11 ] . The main contribution of this paper is to provide a proof-of-concept that the use of traditional finite element (FEM) discretization, in conjunction with an iterative method for treating the coupling can effectively address this variant of the SBP in non-trivial geometries. Our method features three desirable properties: fast convergence of the forward-backward iteration, good mass preservation for the density, and a direct implementation of reflecting boundary conditions compared to particle-based approaches. The rest of the paper is organized as follows. In Section II, we recall the PDE formulation, à la Benamou-Brenier , of OT and SBP as optimization problems over continuity/Fokker-Planck type PDEs. Section III focuses on the reflected SBP with prior drift, introducing the optimality system and the Hopf-Cole transform. In Section IV, we present the FEM discretization of the resulting advection-diffusion system. Finally, Section V present two numerical tests in a 3D maze, corresponding to the classical SBP and a variant prior drift. II Background II-A Dynamic Optimal Transport Optimal transport provides a framework to study the problem of efficiently redistributing mass between probability distributions. Given initial and terminal densities \rho_{0} and \rho_{1} on a domain \Omega , the classical Monge-Kantorovich formulation [ 16 ] seeks a transport plan that minimizes the total displacement cost. For a quadratic cost, this is formalized through the 2-Wasserstein distance between two densities: W_{2}^{2}(\rho_{0},\rho_{1})=\min_{\pi\in\Pi(\rho_{0},\rho_{1})}\int_{\Omega\times\Omega}\|x-y\|^{2}\,d\pi(x,y), (1) where \Pi(\rho_{0},\rho_{1}) denotes the set of joint probability measures (transport plans) with marginals \rho_{0} and \rho_{1} . While this static problem provides a complete characterization of OT, the pioneering work of Benamou and Brenier [ 2 ] provides an alternative dynamic reformulation of OT as a time-continuous fluid mechanics problem. The optimal displacement of mass between initial and terminal densities \rho_{0} and \rho_{1} is characterized by a time-dependent density \rho(x,t) and a velocity field u(x,t) that minimize the kinetic energy \min_{(u,\rho)}\frac{1}{2}\int_{0}^{1}\!\!\int_{\Omega}\rho(x,t)\|u(x,t)\|^{2}\,dx\,dt (2) subject to the continuity equation: \partial_{t}\rho+\nabla\cdot(\rho u)=0, (3) with boundary conditions \rho(\cdot,0)=\rho_{0} and \rho(\cdot,1)=\rho_{1} . From this perspective, OT is interpreted as a geodesic problem in the space of probability measures. II-B From Deterministic to Stochastic Transport When the transport process is subject to diffusion, we introduce Brownian noise into the particle dynamics, and the deterministic continuity equation is replaced by the Fokker-Planck PDE \partial_{t}\rho=\varepsilon\Delta\rho-\nabla\cdot(\rho u), (4) where \varepsilon>0 represents the diffusion coefficient. The optimization problem still minimizes the kinetic energy ( 2 ), with the same endpoint densities. This formulation, known as the Schrödinger bridge problem, corresponds to an entropic regularization of the original OT problem [ 9 ] . The Fokker-Planck formulation admits a natural interpretation at the particle level. The density \rho(x,t) represents the probability distribution of a single particle X_{t} whose trajectory is governed by the controlled stochastic differential equation: dX_{t}=u(X_{t},t)\,dt+\sqrt{\varepsilon}\,dW_{t},\quad X_{0}\sim\rho_{0},\quad X_{1}\sim\rho_{1}, (5) where W_{t} denotes standard Brownian motion. The optimization problem seeks the control u that minimizes the expected energy expenditure: \min_{u}\mathbb{E}\left[\int_{0}^{1}\frac{1}{2}\|u(X_{t},t)\|^{2}\,dt\right] (6) while ensuring the particle’s distribution evolves from \rho_{0} to \rho_{1} . This particle perspective reveals the Schrödinger bridge as an energy-optimal steering problem for diffusive dynamics between prescribed endpoint distributions. III Reflected Schrödinger Bridge with Prior III-A Problem Formulation Let \Omega\subset\mathbb{R}^{n} be a smooth, bounded domain with boundary \partial\Omega . We consider the energy-optimal steering of a diffusive particle subject to reflecting boundary conditions and a divergence-free prior drift field that satisfies \nabla\cdot v=0\text{ in }\Omega\text{ and }v\cdot n=0\text{ on }\partial\Omega . The particle trajectory X_{t}\in\Omega evolves according to the reflected SDE: dX_{t}=\big(v(X_{t},t)+u(X_{t},t)\big)\,dt+\sqrt{\varepsilon}\,dW_{t}+n(X_{t})\,d\gamma_{t}, (7) where v(x,t) is a given prior drift field, u(x,t) is the control to be optimized, n(x) is the inward unit normal at the boundary, and \gamma_{t} is the boundary local time enforcing reflection. The particle satisfies X_{t}\in\Omega for all t\in[0,1] , with prescribed initial and terminal distributions X_{0}\sim\rho_{0} , and X_{1}\sim\rho_{1} , and minimizes the expected control effort ( 6 ). III-B Mean-Field Formulation At the