Parallel Differentiable Reachability for Learning and Planning with Certified Neural Dynamics and Controllers
Keyi Shen and Glen Chou · 2026
Read Parallel Differentiable Reachability for Learning and Planning with Certified Neural Dynamics and Controllers by Keyi Shen and Glen Chou (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-25346.txt.
Introduction
Keyi Shen and Glen Chou build a reachability framework that gives bounds for neural dynamics and controllers, staying differentiable and fast. Existing tools over-approximate reachable states, cannot differentiate, and move too slowly for learning and planning. Their JAX framework merges Taylor-model flowpipes with bound propagation, keeping affine links for GPU batches and differentiation. On top of it they add certified training and a sampling-based controller with gradient refinement. Tests on manipulation and quadrotor tasks, including hardware runs up to 72 dimensions, show online planning with bounds intact.
Catalog record
| CREATOR | Keyi Shen and Glen Chou |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 64575 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.25346
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Parallel Differentiable Reachability for Learning and Planning with Certified Neural Dynamics and Controllers Keyi Shen and Glen Chou Abstract Neural network (NN) dynamics models and control policies achieve strong performance in robotics, but providing sound guarantees under uncertainty remains difficult, especially for closed-loop NN systems. Existing reachability tools provide formal over-approximations, yet are often non-differentiable, overly conservative, or too slow for modern learning and online planning pipelines. To address this, we present a parallelizable, differentiable reachability framework in JAX for continuous- and discrete-time systems with analytical and NN-based dynamics and controllers. Our framework combines Taylor-model flowpipe construction with CROWN-style linear bound propagation through a unified representation that preserves affine dependencies while supporting GPU-batched computation and automatic differentiation. Building on this reachability primitive, we develop (i) a certified training method that encourages reachability-friendly dynamics models and controllers, and (ii) a reachability-aware sampling-based MPC scheme with gradient-based refinement. Experiments on non-prehensile manipulation and quadrotor tasks, including hardware and higher-dimensional evaluations (up to 72D), demonstrate practical online planning while maintaining certified reachable-set over-approximations under bounded uncertainty. Fig. 1: Reachability-guided planning . We visualize three successful model predictive control (MPC) rollouts of our reachability-guided planner using certified, reachability-regularized models on (a) T-pushing, (b) T-pushing (Real-world) and (c) quadrotor. At each replanning step (indices shown), we plot the current state, the planned trajectory, and the certified reachable set under bounded disturbance (shaded footprints for T-pushing and 3D boxes for quadrotor). The results show that our planner achieves the task while maintaining tight, step-wise formal reachability guarantees under uncertainty. Overall, our parallel differentiable reachability tool can be efficiently integrated into model-training and planning pipelines in robotics, enabling verified-by-construction learning and planning with learned models. I Introduction Neural network (NN) dynamics models and controllers are increasingly used in robotics [ 33 , 41 , 63 , 47 ] , enabling operation in complex environments where analytical modeling is infeasible. Despite strong empirical performance, providing robustness and safety guarantees for NN-in-the-loop systems remains challenging, as NNs introduce high-dimensional nonlinear components that complicate worst-case analysis under disturbances and uncertainty [ 42 ] . Classical reachability analysis provides formal guarantees through reachable-set over-approximations [ 1 , 9 ] , but often scales poorly and struggles with NN components, leading to conservative bounds. Modern neural network verification (NNV) methods, such as CROWN [ 72 , 64 ] and abstract interpretation [ 50 ] , scale to large networks and provide efficient bound propagation, but are primarily designed for static verification and do not naturally handle continuous-time dynamics. Recent efforts combining reachability analysis and NNV [ 42 ] support NN-controlled systems, but remain largely offline, non-differentiable, and difficult to integrate into modern robot learning and online planning. As a result, reachability analysis is typically restricted to a post-hoc certification mechanism, and these limitations prevent verification from directly informing the training and deployment of certifiable models in robot learning. This can lead to costly cycles of non-certified training, failed certification, and retraining. To address these challenges, we develop an efficient parallel and differentiable reachability framework that integrates certified analysis into robot learning and planning. Examples of reachability-aware planning rollouts are shown in Figure 1 . Our key idea is to unify Taylor-model-based reachability for continuous-time dynamics with CROWN-style NN verification within a single JAX [ 5 ] computation graph. Our reachability tool, DiffReach , combines Taylor-model flowpipe construction for analytical dynamics with CROWN-style linear bound propagation for neural components through a unified representation that preserves affine dependencies without intermediate interval relaxation . To enable efficient GPU execution and automatic differentiation, reachability propagation is reformulated using fixed-shape tensor operations compatible with just-in-time (JIT) compilation and batched computation. The resulting framework supports continuous- and discrete-time systems with analytical and NN-based dynamics and controllers while exposing differentiable reachable-set objectives for downstream optimization. Building on this reachability primitive, we develop DiffReach-Robotics , which consists of 1) a certified training method for learning neural dynamics and controllers and 2) a reachability-aware sampling-based model predictive control (MPC) scheme with gradient-based refinement. Experiments on manipulation and quadrotor tasks, including hardware and higher-dimensional evaluations, demonstrate practical online planning while maintaining certified reachable-set over-approximations under bounded uncertainty. Our contributions are: • A parallel and differentiable reachability framework combining Taylor-model flowpipes and CROWN-style bound propagation within a unified JAX-based representation for continuous- and discrete-time systems with analytical and NN-based dynamics and controllers. • A certified training method that leverages differentiable reachable-set objectives to improve robustness of neural components under uncertainty. • A reachability-aware sampling-based MPC scheme that integrates certified reachable sets into online planning with gradient-based refinement. • Experimental evaluation on manipulation and quadrotor tasks, including hardware and higher-dimensional systems (up to 72D), demonstrating practical integration of certified reachability into robot learning and planning. II Related Work Robust planning and control in robotics. Robotic tasks such as manipulation and agile flight involve complex nonlinear dynamics that make robust control under uncertainty challenging. A common approach separates high-level planning from low-level feedback control [ 51 , 23 , 67 ] . Existing methods compute invariant tubes or safety certificates around nominal trajectories using sums-of-squares [ 51 , 40 ] , Hamilton-Jacobi reachability [ 23 ] , or contraction-based analysis [ 13 , 29 , 14 , 52 , 28 ] . While these approaches provide strong guarantees for nonlinear systems, they are typically designed for fixed analytical controllers and offline analysis. Extensions to NN controllers [ 28 , 13 , 54 ] similarly focus on post-hoc verification rather than integration into controller learning. NN dynamics and controllers. NN dynamics models learned from simulation or real-world data are widely used in robotic manipulation and control [ 47 , 59 ] , including models based on visual observations [ 17 , 15 ] , latent representations [ 21 , 63 ] , and structured state representations [ 41 , 48 ] . Despite strong empirical performance, most planning methods using NN dynamics lack formal safety guarantees, while certified approaches typically rely on slow offline verification [ 28 , 13 ] decoupled from model training and planning. Learned NN controllers [ 30 , 12 ] and heuristic safety filters [ 35 , 68 , 53 ] similarly lack optimization-aware certified objectives. In contrast, our framework directly incorporates differentiable reachable-set objectives into learning and planning. Reachability and NNV. NNV provides formal guarantees on network outputs. Early methods [ 55 , 7 , 38 ] struggled to scale due to limited parallelization and GPU support [ 44 , 71 , 34 ] . Bound-propagation methods [ 16 , 50 , 57 , 19 ] , including CROWN [ 72 ] , improve scalability by propagating certified affine bounds through network layers. Practical tools such as \alpha,\!\beta -CROWN [ 65 , 58 , 70 ] achieve strong performance on large networks [ 6 , 26 ] . NNV has also been applied to robotic control, including Lyapunov and Zubov neural control [ 66 , 45 , 32 ] , neural contraction metrics [ 31 ] , and branch-and-bound planning with neural dynamics [ 46 ] , but these methods primarily certify stability certificates or planning objectives rather than differentiable reachable-set propagation for closed-loop NN systems. Classical reachability tools address dynamical systems directly. CORA [ 1 ] , JuliaReach [ 4