Neural Implicit Solution Formula for Efficiently Solving Hamilton-Jacobi Equations
Yesom Park, Stanley Osher · 2025
Read Neural Implicit Solution Formula for Efficiently Solving Hamilton-Jacobi Equations by Yesom Park, Stanley Osher (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-19351.txt.
Introduction
Yesom Park and Stanley Osher present a 2025 paper on solving Hamilton-Jacobi equations, a class of math problems used in control, motion, and optics. Classic methods can be slow or hard to scale to many dimensions. The authors derive an implicit solution formula from the paths that carry the solution's information. In special cases the formula matches two famous older formulas.
The formula avoids some hard transform steps and skips tracing each path one by one. The team then trains a neural network to learn the formula, which lets the method scale to problems with many variables. A companion method handles harder cases by approximating the paths in straight pieces. Tests show accurate answers even for tricky, nonconvex problems. The method stayed efficient on problems up to forty dimensions.
Catalog record
| CREATOR | Yesom Park, Stanley Osher |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 67 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-19351
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Neural Implicit Solution Formula for Efficiently Solving Hamilton-Jacobi Equations Thanks: Submitted to the editors DATE Yesom Park, Stanley Osher Abstract This paper presents an implicit solution formula for the Hamilton-Jacobi partial differential equation (HJ PDE). The formula is derived using the method of characteristics and is shown to coincide with the Hopf and Lax formulas in the case where either the Hamiltonian or the initial function is convex. It provides a simple and efficient numerical approach for computing the viscosity solution of HJ PDEs, bypassing the need for the Legendre transform of the Hamiltonian or the initial condition, and the explicit computation of individual characteristic trajectories. A deep learning-based methodology is proposed to learn this implicit solution formula, leveraging the mesh-free nature of deep learning to ensure scalability for high-dimensional problems. Building upon this framework, an algorithm is developed that approximates the characteristic curves piecewise linearly for state-dependent Hamiltonians. Extensive experimental results demonstrate that the proposed method delivers highly accurate solutions, even for nonconvex Hamiltonians, and exhibits remarkable scalability, achieving computational efficiency for problems up to 40 dimensions. keywords Hamilton-Jacobi equations, implicit solution formula, deep learning Funding. S. Osher was partially supported by MURI DOD-AFOSR-N00014-20-1-2787, NSF NSF-2208272, and NSF STROBE NSF-1554564. Y. Park was supported by the NRF Grant RS-2024-00343226. † † runningheads: Neural Implicit Solution Formula for HJ PDEs / Y. Park and S. Osher MSC 65M25, 68T07, 35C99 1 Introduction Hamilton-Jacobi partial differential equations (HJ PDEs) are of paramount importance in various fields of mathematics, physics, and engineering, including optimal control [ 27 , 66 , 4 ] , mechanics [ 23 , 21 ] , and the study of dynamic systems [ 41 , 65 ] . As they provide a powerful framework for modeling systems governed by physical laws, HJ PDEs have a wide range of applications in diverse areas such as geometric optics [ 56 , 53 ] , computer vision [ 8 , 32 , 58 ] , robotics [ 48 , 46 , 3 ] , trajectory optimization [ 22 , 61 ] , traffic flow modeling [ 34 , 45 ] , and financial strategies [ 31 , 7 ] . These applications illustrate the versatility and significance of HJ PDEs, emphasizing the necessity for effective methods to solve them in both theoretical and practical contexts. It is well-known that the solutions to HJ PDEs are typically continuous but exhibit discontinuous derivatives, irrespective of the smoothness of the initial conditions or the Hamiltonian. Moreover, such solutions are typically non-unique. In this regard, viscosity solutions [ 14 ] are commonly considered as the appropriate notion of solution, as they reflect the physical characteristics inherent to the problem. Numerical methods for solving HJ PDEs have been extensively developed, with numerous practical applications across various fields. The most prominent methods include essentially non-oscillatory (ENO) and weighted ENO (WENO) type schemes [ 60 , 35 , 6 , 63 ] , semi-Lagrangian methods [ 28 , 15 , 29 ] , and level set approaches [ 59 , 56 , 57 , 54 , 2 ] . However, they encounter significant scalability challenges as the dimensionality of the state space increases. These methods rely on discretization of the state space with a grid and approximating the Hamiltonian in a discrete form. Consequently, the number of grid points required to obtain accurate solutions grows exponentially with the dimensionality of the problem, resulting in prohibitive computational costs. In high-dimensional settings, particularly those involving more than four dimensions, this scaling issue renders the classical methods impractical for many real-world applications, where high-dimensional state spaces are prevalent. Several approaches have been proposed to address the curse of dimensionality in solving HJ PDEs. Methods based on max-plus algebra [ 52 , 1 , 30 ] show promise but are restricted to specific classes of optimal control problems and encounter significant challenges in practical implementation due to their complexity. Another promising approach involves the use of Hopf or Lax formulas to represent solutions to HJ PDEs [ 20 , 12 , 13 , 10 ] . These formulas offer a causality-free approach, where solutions at each spatial and temporal point can be computed by solving an optimization problem, thus enabling parallel computation. This approach eliminates the reliance on grid-based discretization, making it particularly well-suited for high-dimensional problems. However, these methods require computing the Legendre transform of the Hamiltonian or initial function and are generally applicable only under specific assumptions, such as convexity, or when the problem can be framed as a particular type of control problem. In parallel, algorithms based on Pontryagin’s Maximum Principle [ 38 , 39 , 73 ] , which employ the method of characteristics, have been proposed. Despite their potential, the practical effectiveness of these methods is often limited by the need to solve a system of ordinary differential equations (ODEs) at each point. Additionally, some of these methods assume that multiple characteristics do not intersect, a condition that may not hold in general scenarios. Furthermore, alternative techniques, such as tensor decomposition [ 24 ] and polynomial approximation [ 37 , 36 ] , have been studied for specific control problems. Recent advancements in deep learning have given rise to a growing interest in leveraging the extensive representational capabilities of neural networks to solve PDEs [ 67 , 74 , 64 , 51 , 47 , 72 ] . The viscosity solution of HJ PDEs is challenging to obtain directly from the PDE itself, which underscores the development of alternative approaches beyond the established methods like physics-informed neural networks (PINNs) [ 64 ] . In response, data-driven methods have been proposed for solving HJ PDEs [ 55 , 25 , 16 ] ; however, these methods face several challenges, including the need for large amounts of training data, the limitation that their performance cannot exceed the accuracy of the numerical methods used to generate the data, and concerns regarding their ability to generalize to unseen scenarios. Moreover, the integration of reinforcement learning techniques to solve HJ PDEs related to control problems has been studied [ 76 , 49 ] . Another line of research has focused on the development of specialized neural network architectures that express representation formulas to specific HJ PDEs [ 18 , 19 , 17 ] . One of the most closely related prior works introduces a deep learning approach for learning implicit solution formulas along with characteristics for scalar conservation laws associated with one-dimensional HJ PDEs [ 75 ] . However, this method does not ensure the attainment of an entropy solution. This study presents a novel implicit solution formula for HJ PDEs. The proposed implicit formula is derived through the characteristics of the HJ PDE, with the costate identified as the gradient of the solution at the current spatio-temporal point, leading to an implicit representation formula for the solution. We demonstrate that this new formula coincides with the classical Hopf and Lax formulas, which provides the viscosity solution for HJ PDEs in the case where either the Hamiltonian or the initial function is convex (or concave). Notably, the implicit formula is simpler than both the Hopf and Lax formulas, as it does not require the Legendre transform of either the Hamiltonian or the