NoiseSDF2NoiseSDF: Learning Clean Neural Fields from Noisy Supervision

Tengkai Wang, Weihao Li, Ruikai Cui, Shi Qiu, Nick Barnes · 2025

Read NoiseSDF2NoiseSDF: Learning Clean Neural Fields from Noisy Supervision by Tengkai Wang, Weihao Li, Ruikai Cui, Shi Qiu, Nick Barnes (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-13595.txt.

Introduction

Tengkai Wang, Weihao Li, Ruikai Cui, Shi Qiu, and Nick Barnes present NoiseSDF2NoiseSDF in two thousand twenty-five. The method learns clean neural fields from noisy point clouds. Cheap scanners leave heavy noise in their cloud data. That noise warps the surfaces rebuilt from the points.

The idea extends the Noise2Noise trick from images to 3D fields. Training cuts the gap between two noisy signed distance forms. The net thus denoises surfaces in an implicit way as it learns. Benchmarks span ShapeNet, ABC, Famous, and real scans. Surface quality from noisy inputs rose a lot in tests.

Catalog record

CREATORTengkai Wang, Weihao Li, Ruikai Cui, Shi Qiu, Nick Barnes
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-13595

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

NoiseSDF2NoiseSDF: Learning Clean Neural Fields from Noisy Supervision Tengkai Wang, Weihao Li, Ruikai Cui, Shi Qiu, Nick Barnes Abstract Reconstructing accurate implicit surface representations from point clouds remains a challenging task, particularly when data is captured using low-quality scanning devices. These point clouds often contain substantial noise, leading to inaccurate surface reconstructions. Inspired by the Noise2Noise paradigm for 2D images, we introduce NoiseSDF2NoiseSDF, a novel method designed to extend this concept to 3D neural fields. Our approach enables learning clean neural SDFs directly from noisy point clouds through noisy supervision by minimizing the MSE loss between noisy SDF representations, allowing the network to implicitly denoise and refine surface estimations. We evaluate the effectiveness of NoiseSDF2NoiseSDF on benchmarks, including the ShapeNet, ABC, Famous, and Real datasets. Experimental results demonstrate that our framework significantly improves surface reconstruction quality from noisy inputs. 1 Introduction Learning from imperfect targets [ 49 , 19 , 25 , 5 , 51 ] is a fundamental challenge in machine learning, particularly when obtaining clean training labels is impractical or unfeasible. In image processing, the pioneering work of Noise2Noise [ 25 ] demonstrated that image restoration could effectively be achieved by observing multiple corrupted instances of the same scene. Specifically, this method leverages the principle that pixel values at identical coordinates in different noisy images ideally represent the same underlying true signal. Consequently, the model learns to restore clean images by simply minimizing a straightforward MSE loss between noisy observations. See Figure 1 (a). Extending Noise2Noise principles to 3D point clouds [ 20 , 31 ] , however, poses significant challenges due to their inherently unstructured nature. Unlike images organized on regular grids, point clouds exhibit deviations across all spatial coordinates without the benefit of a stable reference framework. This fundamental difference renders a direct extension of unsupervised image denoisers impractical. Standard loss functions such as Mean Squared Error (MSE) prove ineffective, necessitating specialized loss functions like Earth Mover’s Distance (EMD) to capture geometric correspondences and spatial distributions inherent in point cloud data, see Figure 1 (b). Figure 1: Comparison of coordinate correspondences: (a) Pixel coordinates represent correspondences between two noisy images of the same scene. In contrast, (b) point coordinates do not exhibit correspondences between two noisy point clouds of the same shape. (c) SDF coordinates establish correspondences between two noisy neural fields representing the same shape. Recent advances in surface reconstruction have introduced neural fields, such as neural Signed Distance Function (neural SDF) [ 35 , 32 , 13 , 52 ] , which are capable of predicting continuous SDF values for any given 3D coordinate. Our key observation is that neural SDF, which encodes the SDF mapping 3D coordinates to scalar distance values for 3D shape, exhibits a conceptual parallel to the mapping between pixel coordinates and pixel intensities in 2D images, as shown in Figure 1 (c). Building on this analogy, we hypothesize that neural SDFs can be denoised by directly using noisy SDF observations with the same MSE loss strategy inspired by the Noise2Noise principle in image restoration. In this work, we explore the use of noisy-target supervision in neural SDFs for surface reconstruction from noisy 3D point clouds. We propose NoiseSDF2NoiseSDF, an adaptation of the Noise2Noise framework applied to neural fields. The workflow of our NoiseSDF2NoiseSDF is illustrated in Figure 2 . The network first takes independently corrupted point clouds as input to predict the underlying clean SDF values. Instead of using clean SDFs as ground truth, we employ another noisy neural SDF, which is generated by off-the-shelf point-to-SDF methods, as the supervision target. We then minimize the discrepancy between the predicted SDF output and the noisy SDF target using MSE loss. The network learns to suppress noise and improve consistency across SDF values, leading to clean neural representations. To evaluate the effectiveness of NoiseSDF2NoiseSDF, we conduct comprehensive experiments across benchmark datasets, including ShapeNet [ 8 ] , ABC [ 23 ] , Famous [ 15 ] , and Real [ 15 ] . Our experimental results demonstrate that neural SDFs can indeed be denoised effectively by employing mean squared error loss directly between their noisy representations. This finding confirms our central hypothesis: neural SDFs can learn to produce cleaner outputs simply by observing and minimizing discrepancies among noisy neural fields, effectively extending the Noise2Noise paradigm into the domain of 3D neural surface reconstruction. Our approach eliminates the need for clean training data, making it practical and scalable for real-world scenarios where acquiring perfect data is difficult or infeasible. 2 Related Work Noise2Noise. The Noise2Noise (N2N) framework [ 25 ] has significantly influenced recent image denoising. By leveraging pairs of noisy observations of the same scene, the N2N framework learns to predict one noisy realization from another via pixel-wise correspondence. Subsequent methods like Noise2Void [ 24 ] , Noise2Self [ 3 ] employ blind-spot masking techniques, training models directly on individual noisy images without pairs. Noise2Same [ 44 ] derives self-supervised loss bounds to eliminate the blind-spot restriction altogether. Self2Self [ 39 ] and Neighbor2Neighbor [ 21 ] exploit internal image redundancy, employing dropout or pixel resampling to train directly on single noisy observations without explicit noise modeling. Noisier2Noise [ 34 ] extends N2N to explicitly introduce additional synthetic noise, learning to map noisier images back to their original noisy versions. Extending the Noise2Noise framework to 3D [ 20 , 43 , 31 , 41 ] is challenging due to the unordered nature of point clouds. Methods like TotalDenoising [ 20 ] and Noise2Noise Mapping [ 31 ] address this by leveraging local geometric correspondences instead of exact point matches, replacing MSE with Earth Mover’s Distance (EMD) loss to better align noisy point clouds with the underlying surface. In our work, we exploit the structural similarities between neural fields and images, proposing a Noise2Noise denoising framework for 3D SDFs with MSE loss. Implicit Surface Reconstruction. Learning implicit surfaces from point clouds has seen significant advances. Overfitting-based methods optimize a neural implicit function for a single point cloud, often with ground-truth SDFs, normals or geometric constraints and physical priors. For example, SAL [ 1 ] , SALD [ 2 ] , and Sign-SAL [ 50 ] use point proximity and self-similarity cues. Gradient regularization techniques like IGR [ 18 ] , DiGS [ 4 ] , and Neural-Pull [ 30 ] improve stability and detail. Extensions such as SAP [ 37 ] , LPI [ 9 ] , and Implicit Filtering-Net [ 26 ] enhance reconstruction under sparse sampling and complex geometry. While accurate, these methods are typically sensitive to noise. Robust variants (e.g., SAP [ 37 ] , PGR [ 27 ] , Neural-IMLS [ 42 ] , Noise2Noise Mapping [ 31 ] and LocalN2NM [ 10 ] ) address this via smoothing, denoising priors, or self-supervision. In contrast to overfitting approaches, data-driven methods learn shape priors from large datasets. Global-latent methods, such as OCCNet [ 32 ] , IM-NET [ 11 ] , and DeepSDF [ 35 ] , encode entire shapes into fixed-length latent codes, capturing overall semantics but often over-smoothing details. Local prior methods improve expressiveness by operating at finer scales. Grid-based approaches divide space into cells and learn small implicit functions per cell (ConvOccNet [ 36 ] ,

Read the complete text