HessianForge: Scalable LiDAR reconstruction with Physics-Informed Neural Representation and Smoothness Energy Constraints

Hrishikesh Viswanath, Md Ashiqur Rahman, Chi Lin, Damon Conover, Aniket Bera · 2025

Read HessianForge: Scalable LiDAR reconstruction with Physics-Informed Neural Representation and Smoothness Energy Constraints by Hrishikesh Viswanath, Md Ashiqur Rahman, Chi Lin, Damon Conover, Aniket Bera (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-08929.txt.

Introduction

Hrishikesh Viswanath and co-workers rebuilt outdoor scenes from laser scans with a smoothness-seeking neural method in a 2025 paper called HessianForge. Robots map their surroundings from LiDAR point clouds, but noise and sparsity leave reconstructed faces bumpy and torn. The authors frame mapping as physics-informed energy tuning: learn a signed distance field whose face pays an energy penalty for sharp ridges. Gauged through second derivatives, so smoothness is imposed as a real preference rather than a post-process.

An octree coding feeds multi-scale networks that refine the field coarse to fine. A test-time step repairs shape-based glitches in the final mesh. Large outdoor scenes come out as clean, artifact-light manifolds suited to navigation and mock run.

Catalog record

CREATORHrishikesh Viswanath, Md Ashiqur Rahman, Chi Lin, Damon Conover, Aniket Bera
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-08929

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

HessianForge: Scalable LiDAR reconstruction with Physics-Informed Neural Representation and Smoothness Energy Constraints Hrishikesh Viswanath, Md Ashiqur Rahman, Chi Lin, Damon Conover, Aniket Bera Abstract Accurate and efficient 3D mapping of large-scale outdoor environments from LiDAR measurements is a fundamental challenge in robotics, particularly towards ensuring smooth and artifact-free surface reconstructions. Although the state-of-the-art methods focus on memory-efficient neural representations for high-fidelity surface generation, they often fail to produce artifact-free manifolds, with artifacts arising due to noisy and sparse inputs. To address this issue, we frame surface mapping as a physics-informed energy optimization problem, enforcing surface smoothness by optimizing an energy functional that penalizes sharp surface ridges. Specifically, we propose a deep learning based approach that learns the signed distance field (SDF) of the surface manifold from raw LiDAR point clouds using a physics-informed loss function that optimizes the L 2 L_{2} -Hessian energy of the surface. Our learning framework includes a hierarchical octree based input feature encoding and a multi-scale neural network to iteratively refine the signed distance field at different scales of resolution. Lastly, we introduce a test-time refinement strategy to correct topological inconsistencies and edge distortions that can arise in the generated mesh. We propose a CUDA -accelerated least-squares optimization that locally adjusts vertex positions to enforce feature-preserving smoothing. We evaluate our approach on large-scale outdoor datasets and demonstrate that our approach outperforms current state-of-the-art methods in terms of improved accuracy and smoothness. Our code is available at https://github.com/HrishikeshVish/HessianForge/ Fig. 1: We present a physics-informed neural implicit representation, optimized on L_{2} -Hessian Energy, for surface mapping from LiDAR point-clouds. The above figures represent a birds-eye view of KITTI sequence 00 . Our approach achieves improved surface smoothness and accuracy compared to state-of-the art approaches (1.c.). I INTRODUCTION Scene mapping involves constructing a geometric representation of the environment, enabling robots to perceive and interact with their surroundings. It forms a key part of Simultaneous Localization and Mapping (SLAM) problems, which are crucial for autonomous navigation, exploration, and environment monitoring [ 1 , 2 , 3 , 4 , 5 ] . These systems rely on various sensors, including LiDAR, cameras, and inertial measurement units (IMUs), to record the observations, which are used to incrementally map the scene. However, due to hardware limitations or limited sensor coverage, the captured point clouds can be sparse and incomplete, particularly in areas where surfaces are only partially observed. This makes it difficult to generate smooth, watertight surface manifolds that accurately represent the scene. Ensuring that the reconstructed surface remains artifact-free and topologically coherent while preserving fine details is a significant challenge in large-scale 3D mapping. Recent advances in 3D reconstruction leverage neural architectures to map the scene from LiDAR measurements using learnable feature representations. In typical SLAM tasks, the measurements are recorded incrementally as the robot navigates the scene. For memory efficient and scalable feature learning, these methods propose sparse hierarchical tree representations to efficiently encode and query spatial information recorded by the sensors [ 6 , 7 ] . These features are then used by a neural framework to learn signed distance fields (SDF) by incorporating losses derived from partial differential equations (PDE) such as Poisson [ 8 , 6 ] or Eikonal equations [ 6 ] . Some approaches also leverage kernel-based learning on hierarchical representations, where the surface is represented as the zero-level set of a neural kernel field (NKF), learned as the weighted sum of basis functions defined over a kernel [ 9 ] . Data-driven approaches, such as NPSR [ 10 ] , further generalize these methods by employing neural operators to implicitly learn kernel representations, directly mapping from data without predefined basis functions. Despite these advances, little work has been done in explicitly enforcing geometric smoothness properties in neural representations, to achieve smooth, watertight, and feature-preserving reconstructions. Smoothness energy functions, such as Laplacian and Hessian energies, are commonly used in graphics and geometry processing for tasks like interpolation, hole-filling, and denoising [ 11 , 12 ] . These energies are defined by the norm of differential operators (i.e. L_{1},L_{2} ), applied to the surface, where the L_{2} -Laplacian energy minimizes high-frequency variations and the L_{2} -Hessian energy promotes higher-order smoothness [ 11 ] . Optimizing such L_{2} -energies has been shown to yield smoother geometries. Building on this, we formulate the problem of 3D mapping as a deep-learning based energy optimization task constrained by the smoothness energy defined over the surface manifold \Omega . Specifically, we propose a novel physics-informed loss function that optimizes the biharmonic partial differential equation (PDE) representation of the L_{2} -Hessian energy. Our proposed neural network framework is inspired by multigrid methods, which are used to solve multiscale PDE problems by propagating information across different resolutions of the domain. These methods facilitate efficient computation by enabling interactions between coarse and fine scales. Motivated by this approach, we introduce a multiscale multilayer perceptron (MLP) architecture for aggregating information across scales. To represent the input, we leverage the octree structure [ 6 ] , which inherently partitions 3D space hierarchically, thus providing a natural multigrid discretization of the surface domain \Omega . Each level (l) of the octree corresponds to a specific resolution. Unlike multi-pole graph kernel networks, which rely on radius-based connectivity and incur high computational costs in dense graphs, our framework only uses MLPs to aggregate information by utilizing octree node corners as a fixed 8-neighborhood graph, ensuring a per-point computational complexity of O(l) , where l is the number of octree levels. While L_{2} -Hessian energy improves global smoothness, we propose additional fine-grained refinement of local surface details through test-time refinement. Our strategy involves improving the mesh quality by optimizing the mean curvature while preserving vertex connectivity, subject to Laplacian constraints defined on the vertices. The Laplacian operator, defined as the discretized finite difference between a vertex and its neighbors, is used to enforce local smoothness. To enforce these smoothness constraints, we employ a least-squares optimization approach. This approach mitigates the need for model fine-tuning over specific regions, which may otherwise lead to global irregularities due to overfitting. Our key contributions can be summarized as follows: 1. 3D mapping as a physics-based energy optimization problem : We propose a physics-informed approach for modeling large-scale outdoor environments constrained by the biharmonic equation representing the L_{2} -Hessian energy of the surface manifold. 2. Multi-scale neural representation : Inspired by multigrid PDE methods, we propose a multi-scale MLP architecture that leverages hierarchical octree representations to refine features across resolutions. 3. Test-time refinement : We devise a least-squares optimization strategy for enforcing piece-wise smoothness and improving the triangle quality of the generated mesh. II BACKGROUND In this section, we provide an overview of the meshing techniques used in SLAM methods. LiDAR odometry and meshing: Conventional LiDAR-based SLAM meshing relies on various techniques for reconstructing surfaces from point-cloud data. These involve correspondence point optimization [ 13 , 14 ] , incremental triangulation [ 15 ] , Gaussian Process based meshing [ 16 , 17 ] , surfel based meshing [ 18 ] , coverage maps [ 19 ] , pose estimation based approaches [ 20 ] and volumetric methods [ 21 ] . Deep learning based approaches: With the advent of deep learning, implicit neural representations have

Read the complete text