Boundary Sampling to Learn Predictive Safety Filters via Pontryagin’s Maximum Principle
James Dallas, Thomas Lew, John Talbot, Jonathan DeCastro, Somil Bansal, John Subosits · 2026
Read Boundary Sampling to Learn Predictive Safety Filters via Pontryagin’s Maximum Principle by James Dallas, Thomas Lew, John Talbot, Jonathan DeCastro, Somil Bansal, John Subosits (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-13325.txt.
Introduction
Dallas and five colleagues improve safety filters for self-driving systems by sampling paths that barely avoid a crash. They describe those edge paths with Pontryagin's Maximum Principle and use them to guide data collection for learned Hamilton-Jacobi reachability. The learned Control Barrier Value Function then blocks unsafe actions directly. Tests in shared-control race cars show faster learning, fewer failures, and better safe-set recovery, with wall times around 3 milliseconds.
Catalog record
| CREATOR | James Dallas, Thomas Lew, John Talbot, Jonathan DeCastro, Somil Bansal, John Subosits |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37618 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.13325
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Boundary Sampling to Learn Predictive Safety Filters via Pontryagin’s Maximum Principle James Dallas, Thomas Lew, John Talbot, Jonathan DeCastro, Somil Bansal, John Subosits Abstract Safety filters provide a practical approach for enforcing safety constraints in autonomous systems. While learning-based tools scale to high-dimensional systems, their performance depends on informative data that includes states likely to lead to constraint violation, which can be difficult to efficiently sample in complex, high-dimensional systems. In this work, we characterize trajectories that barely avoid safety violations using the Pontryagin Maximum Principle. These boundary trajectories are used to guide data collection for learned Hamilton-Jacobi Reachability, concentrating learning efforts near safety-critical states to improve efficiency. The learned Control Barrier Value Function is then used directly for safety filtering. Simulations and experimental validation on a shared-control automotive racing application demonstrate PMP sampling improves learning efficiency, yielding faster convergence, reduced failure rates, and improved safe set reconstruction, with wall times around 3 ms 3\,\mathrm{ms} . I Introduction As autonomous systems become increasingly widespread, ensuring their safety is critical. Rather than embedding safety constraints within a nominal controller, one can enforce closed-loop constraint satisfaction with a downstream safety filter [ 1 , 2 ] . Control barrier functions (CBFs) are a widely used framework for safety filtering. Typically implemented as constraints in a quadratic program (QP) [ 2 ] , CBF-based safety filters minimally modify the output of a nominal controller while guaranteeing that the system remains within a prescribed safe set. CBFs have demonstrated success in many applications such as adaptive cruise control, lane keeping, and vehicle stability control [ 2 , 3 , 4 ] . Despite these successes, constructing valid CBFs often requires expert design, and standard CBF-based safety filters are inherently myopic, as they enforce safety using only instantaneous information about the system state which can lead to abrupt, suboptimal, intervention and failure over a horizon [ 5 ] . A response to addressing the myopic behavior of CBFs is to incorporate prediction, such as by embedding CBF constraints into model predictive control formulations [ 6 ] , enforcing the safety filtering constraints over a finite horizon [ 1 ] , or lifting the CBF conditions to trajectory space [ 7 ] . Although these methods introduce lookahead predictions into the safety filter, they do so at the cost of increased computational complexity and reliance on nonlinear optimization. These methods also still require finding a valid CBF, which is difficult for complex systems. Hamilton-Jacobi (HJ) reachability provides a complementary, constructive perspective by explicitly encoding trajectory lookahead through the computation of backward reachable tubes [ 8 ] . Control barrier value functions (CBVFs) [ 9 ] further link HJ reachability with CBF-based safety filtering, enabling predictive safety guarantees within a QP framework. Exact HJ methods, however, suffer from the curse of dimensionality, limiting their applicability to high-dimensional systems [ 8 ] . Learning-based approximations of HJ Reachability [ 10 ] (and of other partial differential equations [ 11 , 12 ] ) improves scalability; however, such approaches can struggle to accurately approximate value functions, particularly for high dimensional systems with complex dynamics and constraints [ 13 ] . Learning safety filters for these complex systems can be improved through supervision with MPC or reinforcement learning, but these approaches remain data-inefficient as they do not explicitly target boundary-defining, safety-critical states [ 13 , 14 ] . Fig. 1 : Left : Extremal trajectory that barely stays in the safe set \mathcal{S} and reachable sets from x_{0} . Right : Generation of boundary trajectories to learn a safety filter. As such, scalably and efficiently embedding predictive capabilities in safety filters remains an open challenge. In this work, we address this challenge by generating informative training samples for learned HJ Reachability. We observe that the geometry of the reachable sets is characterized by trajectories that evolve to barely satisfy safety constraints. The Pontryagin Maximum Principle (PMP) [ 15 , 16 , 17 ] provides conditions that characterize such boundary trajectories, which could therefore be used to guide data collection. While the PMP has been previously leveraged to study the structure and estimation of forward reachable sets [ 18 , 19 , 20 ] , its potential to improve the data efficiency of learned HJ reachability and CBVF-based safety filters has not been explored. The main contributions of this work are: • We derive PMP-based optimality conditions that characterize trajectories that barely avoid constraint violation, thereby defining the boundary of the backward reachable tube. • We leverage these PMP boundary trajectories to guide data collection for learned HJ reachability, significantly improving training efficiency and accuracy in complex high-dimensional systems. • We construct a learned control barrier value function (CBVF) encoding future trajectory information and demonstrate its effectiveness as a predictive, minimally invasive safety filter for human-driven vehicles operating at the limits of handling. II Problem Setting and Background We consider systems with control-affine dynamics \displaystyle\dot{x_{t}}=f(x_{t})+g(x_{t})u_{t}, (1) with state x_{t}\in\mathbb{R}^{n} , input {u_{t}\in\mathbb{R}^{m}} , and smooth functions f:\mathbb{R}^{n}\to\mathbb{R}^{n} and g:\mathbb{R}^{n}\to\mathbb{R}^{n\times m} ( f, g are Lipschitz and differentiable with Lipschitz Jacobians). Safety specifications are encoded as state constraints \mathcal{S}=\{x_{t}\in\mathbb{R}^{n}:h(x_{t})\geq 0\} , where h:\mathbb{R}^{n}\to\mathbb{R} is continuously differentiable. The objective is to design control policies that ensure the system remains within \mathcal{S} for all future times: x_{0}\in\mathcal{S}\implies x_{t}\in\mathcal{S},~\forall t\geq 0 . II-A Control Barrier Functions An approach to enforcing safety as a state constraint is through CBFs, which ensure safety by rendering \mathcal{S} forward invariant. Definition 1 (Forward invariance) . The set {\mathcal{S}\subset\mathbb{R}^{n}} is forward invariant if {x_{0}\in\mathcal{S}\Rightarrow x_{t}\in\mathcal{S},\forall t\geq 0} . Rendering the set \mathcal{S} forward invariant amounts to enforcing nonegativity of h(x) . Control barrier functions provide sufficient conditions to guarantee this property. Definition 2 (Control barrier function (CBF) [ 2 ] ) . The continuously differentiable function {h:\mathbb{R}^{n}\rightarrow\mathbb{R}} is a CBF for the system ( 1 ) on \mathcal{S} if there exists a scalar \gamma>0 such that \sup_{u_{t}\in\mathbb{R}^{m}}\big(L_{f}h(x_{t})+L_{g}h(x_{t})u_{t}\big)\geq-\gamma\,h(x_{t}) (2) for all x_{t}\in\mathcal{S} , where \dot{h}(x_{t},u_{t}):=L_{f}h(x_{t})+L_{g}h(x_{t})u_{t} is defined by the Lie derivatives {L_{f}h} and {L_{g}h} . Theorem 1 (CBFs and forward invariance [ 2 ] ) . If h is a CBF for system ( 1 ) on \mathcal{S} for some \gamma>0 , then any locally Lipschitz continuous controller {\xi:\mathbb{R}^{n}\to\mathbb{R}^{m}} such that {u_{t}=\xi(x_{t})} satisfies L_{f}h(x_{t})+L_{g}h(x_{t})u_{t}\geq-\gamma\,h(x_{t})\ \ \forall x\in\mathcal{S} (3) renders the set \mathcal{S} forward invariant, i.e., safe w.r.t. ( 1 ). In practice, the condition ( 3 ) is enforced via a quadratic program (QP) that minimally modifies a nominal control input u_{d} to ensure constraint satisfaction: \mathop{\min}_{u_{t}\in\mathbb{R}^{m}}\|u_{t}-u_{d}\|^{2}\ \text{s.t.}\ L_{f}h(x_{t})+L_{g}h(x_{t})u_{t}\geq-\gamma\,h(x_{t}). This QP yields tractable safety filters and has found a wide range of applications. However, designing valid CBFs for complex systems remains a challenge, and standard CBFs are inherently myopic. II-B Hamilton Jacobi Reachability Hamilton-Jacobi (HJ) reachability gives a constructive approach to safety and allows explicitly reasoning over future trajectories by computing backward reachable tubes (BRT). Given an unsafe set \mathcal{X_{U}} defined by a Lipschitz continuous function l:\mathbb{R}^{n}\to\mathbb{R} as \mathcal{X_{U}}=\{x\in\mathbb{R}^{n}:\ell(x)\leq 0\} , HJ reachability characterizes the set of initial states from which the system can avoid \mathcal{X_{U}} over a finite horizon: \{x\in\mathbb{R}^{n}\mid\exists u:\forall t\in[T,0],\,x_{t}\in\mathcal{X}_{U}^{C}\} . This set is represented implicitly by the value function V(x_{t})=\sup_{u(\cdot)}\inf_{t\in[T,0]}\ell(x_{t}) (4) Similar to CBFs, the zero superlevel set of V(x_{t}) , \{x\in\mathbb{R}^{n}:V(x_{t})\geq 0\} defines the set