Hermite-NGP: Gradient-Augmented Hash Encoding for Learning PDEs

Jinjin He, Zhiqi Li, Sinan Wang, Bo Zhu · 2026

Read Hermite-NGP: Gradient-Augmented Hash Encoding for Learning PDEs by Jinjin He, Zhiqi Li, Sinan Wang, Bo Zhu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-24774.txt.

Introduction

Jinjin He and co-authors propose Hermite-NGP, a hash encoding for neural PDE solvers that keeps values and mixed derivatives at grid vertices. Older hash methods rely on automatic differentiation or finite differences, which bring instability or high cost. Direct storage allows fully analytic gradients, Jacobians, and Hessians through Hermite interpolation. A multi-resolution curriculum moves from coarse to fine optimization, like multigrid cycles. Across two- and three-dimensional PDE benchmarks it cuts error up to about twenty times versus prior neural methods.

Catalog record

CREATORJinjin He, Zhiqi Li, Sinan Wang, Bo Zhu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE79413
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.24774

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Hermite-NGP: Gradient-Augmented Hash Encoding for Learning PDEs Jinjin He, Zhiqi Li, Sinan Wang, Bo Zhu Abstract We propose Hermite-NGP , a gradient-augmented multi-resolution hash encoding designed to enable fast and accurate computation of spatial derivatives for neural PDE solvers. Unlike existing NGP-based approaches that rely on automatic differentiation or finite differences and suffer from instability or high cost, Hermite-NGP explicitly stores function values and mixed partial derivatives at hash grid vertices, allowing fully analytic evaluation of gradients, Jacobians, and Hessians via Hermite interpolation. This design preserves the efficiency and spatial adaptivity of NGP while supporting analytic differential operators up to second order. We further introduce a multi-resolution curriculum training strategy analogous to multigrid V-cycles to enable coarse-to-fine optimization. Across a range of 2D and 3D PDE benchmarks, Hermite-NGP achieves up to ∼ 20 × {\sim}20{\times} lower error than prior neural PDE methods, and reduces wall-clock convergence time by 2 2 – 10 × 10\times compared to other solvers, with per-epoch training times as low as 3.5 ​ ms 3.5\,\mathrm{ms} for models with up to 17 17 M parameters. 1 Introduction Efficient neural scene representations that combine classical data structures (grids, tensors, Gaussians) with neural counterparts have emerged as a highly effective family of spatial representations for neural field learning, offering strong locality, spatial adaptivity, and instant training in high-dimensional function approximation. Multi-resolution hash tables, popularized by Instant Neural Graphics Primitives (I-NGP) ( 45 ) , are one such design; related approaches include grid- and tensor-decomposition representations ( 19 ; 18 ; 7 ; 6 ; 31 ; 8 ; 66 ) , anti-aliased NeRF variants ( 2 ) , and Gaussian-based methods such as 3DGS ( 30 ) . These computational merits make NGP-style encodings particularly attractive for representation learning problems that demand both accuracy and efficiency, such as neural radiance field, signed distance field, image reconstruction, and so on ( 11 ; 21 ; 9 ; 38 ; 63 ; 62 ; 45 ) . However, despite their success in representing graphics primitives, NGP-style encodings prove inadequate for learning PDE-governed functions, especially in the context of physics-informed neural networks (PINNs) that rely on accurate differential constraints ( 50 ; 29 ; 48 ; 49 ) . The core challenge lies in I-NGP’s inherent inability to compute spatial derivatives efficiently : standard hash encodings do not support evaluation of first- and second-order derivatives via automatic differentiation, while finite-difference approximations incur prohibitive computational cost and are highly sensitive to the choice of discretization parameters. As a result, naive applications of NGP to neural PDE settings often face challenges in addressing differentiation (see ( 24 ; 38 ; 12 ; 56 ) for examples). This mismatch constitutes a fundamental barrier to leveraging the efficiency of NGP-style representations for solving PDE learning problems. Figure 1 : SDF Gradients and Curvature on Armadillo. Our method (left) recovers smoother gradient and curvature fields than NeuralAngelo ( 38 ) (right), used here as an FD-based hash-encoding baseline under the same SDF+gradient objective. Gradients are visualized as green line segments around the surface, while curvature is shown via mesh coloring. To address this challenge of efficient differentiation, we propose Hermite-NGP , a gradient-augmented multi-resolution hash encoding designed to support analytic derivative evaluation within a neural representation. Our key insight is inspired by the gradient-augmented field representations (e.g., gradient-augmented level set ( 46 ) , affine particle-in-cell ( 25 ) , and flow map methods ( 65 ; 16 ) , where a scalar field discretized on a grid is augmented with an auxiliary, collocated gradient field, enabling continuous and stable derivative reconstruction via Hermite interpolation within each grid cell (see Fig. 3 ). Rather than approximating derivatives using finite-difference stencils or recovering them implicitly through automatic differentiation, these methods treat derivative information as a first-class component of the representation itself. By explicitly parameterizing and evolving the gradient field alongside the primary scalar field, gradient-augmented representations yield well-defined, easy-to-calculate differential operators throughout the domain. Such representations have been widely adopted in computational physics and later computer graphics for various simulation problems involving dynamic interfaces ( 37 ; 34 ; 33 ) , material transport ( 1 ; 36 ) , and vortical structures ( 5 ; 43 ; 65 ) . Hermite-NGP explicitly parameterizes both the hashed feature function and its mixed partial derivatives at each hash grid point. For each spatial resolution, we store Hermite interpolation coefficients corresponding to the function value and its partial derivatives and jointly optimize these quantities during training, resulting in a coupled representation that directly encodes local differential structure. Given these learned coefficients across hash resolutions, Hermite interpolation reconstructs a globally C^{1} -continuous spatial field whose second-order derivatives are analytic within each cell (piecewise across cell boundaries). This representation-level design eliminates truncation error from numerical differencing and avoids instability caused by automatic differentiation through discontinuous hash encodings, enabling analytic evaluation of gradients, Jacobians, Hessians, and Laplacians in a single forward pass while preserving the locality, adaptivity, and scalability of NGP-style encodings (see Figure 1 for an example). We demonstrate the efficacy of our approach across diverse 2D and 3D PDE benchmarks by achieving relative L^{2} errors down to 10^{-5} , offering up to 10\times accuracy gains over state-of-the-art neural PDE solvers and up to 10^{3}\times improvement over baseline NGP methods, while converging within minutes with per-epoch training costs of 2 – 3.5\,\mathrm{ms} on a single GPU. Our main contributions are: • Gradient-Augmented Hash Encoding . We propose a gradient-augmented hash encoding based on Hermite interpolation that stores mixed partial derivatives at grid vertices, enabling C^{1} Hermite interpolation with non-trivial second-order structure. • Analytic Derivative Evaluation . The proposed encoding admits fully analytic computation of first- and second-order spatial derivatives, avoiding finite-difference approximations and auto-differentiation. • Multi-resolution Coarse-to-Fine Training . We develop a coarse-to-fine training strategy that leverages the hierarchical structure of Hermite-NGP, inspired by multigrid methods for PDE optimization. • Neural PDE Solving with Complex Geometry . We demonstrate Hermite-NGP across diverse 2D/3D PDEs, complex geometric domains, and intrinsic differential operators within a unified learning framework. 2 Related Work Physics-Informed Neural Networks. PINNs ( 49 ; 48 ) embed PDE constraints into networks to obtain mesh-free solutions ( 29 ) with applications in fluid mechanics ( 50 ) and libraries like DeepXDE ( 41 ) . Key challenges include spectral bias ( 47 ) , gradient pathologies ( 60 ) , and loss imbalances ( 61 ) , addressed by adaptive weighting ( 42 ) , causal training ( 58 ) , curriculum strategies ( 35 ; 17 ) , complex geometry handling ( 15 ) , and high-dimensional techniques ( 22 ) ; recent benchmarks ( 64 ) evaluate these systematically. Alternative representations include Fourier features ( 53 ) , PIXEL ( 27 ) , SPINN ( 13 ) , and PIG ( 28 ) . Neural operators ( 40 ; 39 ) learn solution mappings but require supervision. Figure 2 : Hermite-NGP Workflow. Multi-resolution grids store Hermite coefficients (f,f_{x},f_{y},f_{xy}) in separate hash tables with sizes T_{1} (values), T_{2} (first derivatives), and T_{3} (mixed derivatives), producing encoding \gamma,\nabla\gamma,\nabla^{2}\gamma . The MLP outputs u,\partial u/\partial\gamma,\partial^{2}u/\partial\gamma^{2} , combined via chain rule to yield \nabla u,\nabla^{2}u for PDE loss. Multi-Resolution Hash Encoding. Instant NGP

Read the complete text