Data-Driven Hamiltonian for Direct Construction of Safe Set from Trajectory Data
Jason J. Choi, Christopher A. Strong, Koushil Sreenath, Namhoon Cho, Claire J. Tomlin · 2025
Read Data-Driven Hamiltonian for Direct Construction of Safe Set from Trajectory Data by Jason J. Choi, Christopher A. Strong, Koushil Sreenath, Namhoon Cho, Claire J. Tomlin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-03233.txt.
Introduction
Jason Choi and co-authors build a data-driven Hamiltonian for constructing safe sets from trajectory data, removing the need for a stated dynamics model. Safety analysis normally demands fast Hamiltonian values, which usually requires knowing the system's equations. Their method needs only mild prior knowledge, like smoothness bounds.
It is framed as a best matching problem. Observed paths supply the speeds that can occur, and a worst-case estimate keeps it conservative. The reachable set is therefore also conservative, and safety certificates can be built from logged data alone. Robots with poorly modeled systems are a natural fit. The approach widens formal safety checks to learned systems.
Catalog record
| CREATOR | Jason J. Choi, Christopher A. Strong, Koushil Sreenath, Namhoon Cho, Claire J. Tomlin |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-03233
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Data-Driven Hamiltonian for Direct Construction of Safe Set from Trajectory Data Jason J. Choi, Christopher A. Strong, Koushil Sreenath, Namhoon Cho, Claire J. Tomlin Abstract In continuous-time optimal control, evaluating the Hamiltonian requires solving a constrained optimization problem using the system’s dynamics model. Hamilton-Jacobi reachability analysis for safety verification has demonstrated practical utility only when efficient evaluation of the Hamiltonian over a large state-time grid is possible. In this study, we introduce the concept of a data-driven Hamiltonian (DDH), which circumvents the need for an explicit dynamics model by relying only on mild prior knowledge (e.g., Lipschitz constants), thus enabling the construction of reachable sets directly from trajectory data. Recognizing that the Hamiltonian is the optimal inner product between a given costate and realizable state velocities, the DDH estimates the Hamiltonian using the worst-case realization of the velocity field based on the observed state trajectory data. This formulation ensures a conservative approximation of the true Hamiltonian for uncertain dynamics. The reachable set computed based on the DDH is also ensured to be a conservative approximation of the true reachable set. Next, we propose a data-efficient safe experiment framework for gradual expansion of safe sets using the DDH. This is achieved by iteratively conducting experiments within the computed data-driven safe set and updating the set using newly collected trajectory data. To demonstrate the capabilities of our approach, we showcase its effectiveness in safe flight envelope expansion for a tiltrotor vehicle transitioning from near-hover to forward flight. I Introduction Data-driven safety verification is needed to ensure the safety of various real-world systems that involve uncertain dynamics. Such uncertainty, which may be impossible to model or require extensive modeling efforts, can result from various sources—complex aerodynamics in unconventional aircraft, robot manipulation of non-rigid objects, learning-enabled components in an autonomy stack, interaction with unstructured environments, and many others. Hamilton-Jacobi (HJ) reachability, rooted in model-based optimal control, provides a rigorous and flexible framework for verifying safety by computing the maximal safe set within constraints, as well as an associated safe policy [ 1 ] . However, its practical applicability is limited by the need to evaluate the Hamiltonian, which is the optimal directional derivative of the value function along the dynamics. Evaluating the Hamiltonian involves solving a constrained optimization problem in the control input space. Consequently, both the lack of an accurate dynamics model as well as any computational challenges in the optimization can hinder the implementation of HJ reachability analysis in practice. Existing data-driven approaches address these challenges indirectly by using supervised learning to approximate components needed to evaluate the Hamiltonian. For instance, [ 2 ] employs Gaussian processes to learn the dynamics, while [ 3 ] fits a neural network to approximate the Hamiltonian. However, these methods rely heavily on the quality of the learned model and may introduce inefficiencies due to misalignment between model learning and safety verification. Alternative data-driven methods outside the HJ framework primarily focus on forward reachability [ 4 , 5 , 6 , 7 ] . We propose a new data-driven approach by approximating the Hamiltonian used in HJ reachability directly from data. The constrained optimization involved in computing the original Hamiltonian is replaced with an efficient data-enabled approximation, which computes its best approximation under the worst-case realization of the dynamics inferred from the data. Using this approximate Hamiltonian in HJ reachability allows the safe set to be computed directly from trajectory data without any intermediate supervised learning step. Our main contributions are summarized below: • We propose the data-driven Hamiltonian (DDH), a novel concept enabling direct data-driven reachability analysis for uncertain dynamics under mild assumptions of knowledge of the system’s Lipschitz constants. • We prove that using this DDH in HJ reachability computations guarantees a conservative approximation of the true safe set. • We present a safe set expansion framework built upon the DDH-based reachability method, which can iteratively update a data-driven safe set while running experiments that safely collect more data. • We demonstrate the effectiveness of our approach in safe longitudinal flight envelope expansion for a tiltrotor vehicle transitioning from near-hover to forward flight. Notations. The norm \left\lVert\cdot\right\rVert being used is the l_{2} norm, and |\cdot| denotes an absolute value. An l_{2} hypersphere centered at the origin with radius r will be notated as \text{B}(r)=\{x\mid\left\lVert x\right\rVert\leq r\} . A hyperrectangle centered at the origin with element-wise radii r\!\in\!\mathbb{R}^{n_{x}} will be denoted as \text{Rect}(r)\!=\!\{x\mid|x_{j}|\leq r_{j},\forall j\!=\!1,\cdots,n_{x}\} . The symbol \oplus indicates the Minkowski sum of two sets. The superscript i denotes the index of a data point and the subscript j denotes the j -th element of a vector unless noted otherwise. II Problem Formulation & Background II-A Problem Formulation We consider nonlinear system dynamics \dot{\bm{x}}(s)\!=\!f(\bm{x}(s),\bm{u}(s))\;\;\text{for}\;s\!\in\![-t,0],\quad\bm{x}(-t)=x, (1) with state \bm{x}(s)\in\mathbb{R}^{n_{x}} , control \bm{u}(s)\in U\subset\mathbb{R}^{n_{u}} , and initial state x at time -t , where t\!>\!0 and U is the control input set. The vector field f is assumed to be Lipschitz continuous in the state, which is required for the forward completeness of the trajectory [ 8 ] . We consider various forms of Lipschitz continuity: (i) uniform Lipschitz constant L^{x} , satisfying \left\lVert f(x,u)-f(x^{\prime},u)\right\rVert\leq L^{x}\left\lVert x-x^{\prime}\right\rVert, (2) (ii) input-element-wise constant vector L^{\text{in}} satisfying \left\lVert f(x,u)-f(x^{\prime},u)\right\rVert\leq\sum_{j=1}^{n_{x}}L^{\text{in}}_{j}\lvert x_{j}-x_{j}^{\prime}\rvert\vskip-10.00002pt (3) (iii) output-element-wise constant vector L^{\text{out}} satisfying for i\!=\!1,\!\cdots\!,\!n_{x}, \lvert f_{i}(x,u)-f_{i}(x^{\prime},u)\rvert\leq L^{\text{out}}_{i}\left\lVert x-x^{\prime}\right\rVert\vskip-2.5pt (4) (iv) n_{x}\!\times\!n_{x} sensitivity matrix L^{\text{io}} satisfying for i\!=\!1,\!\cdots\!,\!n_{x}, \lvert f_{i}(x,u)-f_{i}(x^{\prime},u)\rvert\leq\sum_{j=1}^{n_{x}}L_{ij}^{\text{io}}\lvert x_{j}-x^{\prime}_{j}\rvert\vskip-10.00002pt (5) for all x,x^{\prime}\in\mathcal{X},u\in\mathcal{U}. While the dynamics f itself is deemed uncertain and unknown, we assume that (i) a dataset of trajectories from this uncertain system is given as \mathcal{D}=\{(x^{i},u^{i},v^{i})\}_{i=1}^{N}, where v^{i}:=f(x^{i},u^{i}) denotes “state velocity”, and (ii) we know at least one of the Lipschitz constants of f above. The dataset is collected from experiments, where the state, control, and state velocity are sampled at various time steps of the trajectories of ( 1 ). The Lipschitz constants may come from prior knowledge or can be estimated directly from the dataset \mathcal{D} . While access to a valid constant indicates that our method is not completely model-free and requires basic system knowledge, the required modeling effort is significantly less than accurately characterizing the full dynamics f . The safety specification is given as an unsafe region in the state space we want to avoid, denoted as \mathcal{X}_{\mathcal{U}} . We consider two notions of a safe set: 1. Avoid Backward Reachable Tube (BRT): The Avoid BRT is the set of initial states from which the system can avoid reaching the unsafe set \mathcal{X}_{\mathcal{U}} over the time horizon t : \displaystyle Avoid(t;\mathcal{X}_{\mathcal{U}})\!=\!\{ \displaystyle x\!\in\!\mathbb{R}^{n_{x}}\mid\exists\bm{u}(\cdot)\;\text{s.t.}\;\forall s\!\in\![-t,0],\bm{x}(s)\!\notin\!\mathcal{X}_{\mathcal{U}}\}.\vskip-10.00002pt 2. Reach-Avoid BRT: The ReachAvoid BRT is the set of initial states from which the system can reach a target set, specified as \mathcal{X}_{\mathcal{T}} , while avoiding the unsafe set \mathcal{X}_{\mathcal{U}} : \displaystyle ReachAvoid(t;\mathcal{X}_{\mathcal{T}},\mathcal{X}_{\mathcal{U}})\!=\!\left\{x\in\mathbb{R}^{n_{x}}\mid\exists\bm{u}(\cdot)\;\text{s.t.}\right. \displaystyle\qquad\left.\exists s\in[-t,0],\bm{x}(s)\in\mathcal{X}_{\mathcal{T}}\;\&\;\forall\tau\in[-t,s],\bm{x}(\tau)\notin\mathcal{X}_{\mathcal{U}}\right\}.\vskip-5.0pt Here, s corresponds to the time at which the system reaches \mathcal{X}_{\mathcal{T}} , and \tau indexes over the previous times to ensure that the system does not enter the unsafe set before reaching \mathcal{X}_{\mathcal{T}} . Our goal is to answer two questions: (i) Safe set construction from data : how can we estimate these safe sets directly from the trajectory data of the uncertain dynamical system? (ii) Safe experiment design : how can we design a sequence of safe experiments that gathers data safely in