SurfR: Surface Reconstruction with Multi-scale Attention
Siddhant Ranade * University of Utah and Gonccalo Dias Pais Instituto Superior Técnico and Ross Tyler Whitaker University of Utah and Jacinto C. Nascimento Instituto Superior Técnico and Pedro Miraldo Mitsubishi Electric Research Laboratories and Srikumar Ramalingam Google Research · 2025
Read SurfR: Surface Reconstruction with Multi-scale Attention by Siddhant Ranade * University of Utah and Gonccalo Dias Pais Instituto Superior Técnico and Ross Tyler Whitaker University of Utah and Jacinto C. Nascimento Instituto Superior Técnico and Pedro Miraldo Mitsubishi Electric Research Laboratories and Srikumar Ramalingam Google Research (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-08635.txt.
Introduction
Siddhant Ranade and co-authors rebuild 3D surfaces from point clouds with a multi-scale attention scheme, in a 2025 paper. Learning methods split into camps: small per-object models with fine detail but slow retraining, and big general models that handle new shapes but blur detail and crawl. SurfR aims at the missing corner, fast and faithful.
Its implicit representation answers inside-or-outside questions for query points, but lazily: early features ignore the query point entirely, saving work. A parallel grid holds features at several scales, coping with noise and varied sampling density, and attention across scales sharpens the reconstruction. The authors report the best speed-accuracy trade-off among baselines, at only a slight quality cost against the slowest champions.
Catalog record
| CREATOR | Siddhant Ranade * University of Utah and Gonccalo Dias Pais Instituto Superior Técnico and Ross Tyler Whitaker University of Utah and Jacinto C. Nascimento Instituto Superior Técnico and Pedro Miraldo Mitsubishi Electric Research Laboratories and Srikumar Ramalingam Google Research |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-08635
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SurfR: Surface Reconstruction with Multi-scale Attention Siddhant Ranade * University of Utah and Gonccalo Dias Pais Instituto Superior Técnico and Ross Tyler Whitaker University of Utah and Jacinto C. Nascimento Instituto Superior Técnico and Pedro Miraldo Mitsubishi Electric Research Laboratories and Srikumar Ramalingam Google Research Abstract We propose a fast and accurate surface reconstruction algorithm for unorganized point clouds using an implicit representation. Recent learning methods are either single-object representations with small neural models that allow for high surface details but require per-object training or generalized representations that require larger models and generalize to newer shapes but lack details, and inference is slow. We propose a new implicit representation for general 3D shapes that is faster than all the baselines at their optimum resolution, with only a marginal loss in performance compared to the state-of-the-art. We achieve the best accuracy-speed trade-off using three key contributions. Many implicit methods extract features from the point cloud to classify whether a query point is inside or outside the object. First, to speed up the reconstruction, we show that this feature extraction does not need to use the query point at an early stage (lazy query). Second, we use a parallel multi-scale grid representation to develop robust features for different noise levels and input resolutions. Finally, we show that attention across scales can provide improved reconstruction results. 1 Introduction Figure 1 : SurfR result and error/time trade-off : At the top, we show a sparse input point cloud and its reconstruction using the proposed method SurfR . At the bottom, we show our method and the baselines error vs. time trade-off comparison, with different resolutions (number below). Surface reconstruction from noisy point clouds (e.g., from structure-from-motion pipelines or 3D sensors) has been one of the essential tasks in the computer vision and graphics community Carr et al. 2001 ; Kolluri et al. 2004 ; Labatut et al. 2009 ; Kazhdan and Hoppe 2013 , with numerous applications in autonomous vehicles, medical imaging, and AR/VR technologies. The challenges arise from noisy/incomplete data, the choice of representation, complex geometry, and computational bottlenecks. While 3D point-based representations are lightweight, they lack surface information, and voxels, on the other hand, leave a huge memory footprint. We propose SurfR , a data-driven and efficient implicit surface reconstruction method that produces high-fidelity models, striking the right balance between speed and accuracy (see Fig. 1 ). Note that applications that require real-time processing or have low compute budgets will benefit immensely from this speedup, including those in robotics, augmented/virtual reality, and embedded systems, for example, in interactive mesh editing, such as Yu et al. 2004 ; Sorkine et al. 2004 , where re-meshing is frequently re-run, or interactive SLAM Nashed and Biswas 2018 ; Sidaoui et al. 2019 , where the user accompanied by a robot interacts with the environment to get accurate object representations for scene understanding Nicholson et al. 2018 ; Hall et al. 2020 . SurfR proposes a framework that is towards real-time without compromising surface details and without over-smoothing. A robust surface reconstruction method should be capable of handling noisy/partial point clouds sampled from a variety of shapes. Neural implicit functions show promising results on various 3D tasks, including surface reconstruction. Many of these methods can be divided as per-object or general shape reconstruction. More object-specific methods Takikawa et al. 2021 ; Gaur et al. 2024 , inspired by Mildenhall et al. 2020 and Peng et al. 2020 , take advantage of the object’s shape priors to encode the objects explicitly. However, these methods are not generalizable to unseen shapes. On the other hand, general shape reconstruction methods Park et al. 2019 ; Peng et al. 2020 ; Chibane et al. 2020 ; Takikawa et al. 2021 ; Williams et al. 2022 ; Huang et al. 2023 rely on general encoders to reconstruct the 3D implicit surface. These methods are more generalizable but suffer from a loss in reconstruction quality. The general idea is to use a neural network to predict a distance value given a query point based on a feature representation. One can achieve this by first extracting a global feature (e.g., using a PointNet Qi et al. 2017a ) and then regressing the distance function for the query point Park et al. 2019 . However, using a single global feature for the entire point cloud fails to capture the local geometry, and recent methods extract multiple features from local patches Chibane et al. 2020 ; Erler et al. 2020 ; Boulch and Marlet 2022 . The proposed algorithm also uses multiple resolution features to better model the local and global information to achieve high-fidelity implicit representation. Our contributions are: • Lazy query processing in feature extraction to achieve significant computational efficiency. • Parallel multi-scale feature extraction to achieve robustness to noise and different input resolutions. • Attention using a transformer encoder layer Vaswani et al. 2017 to fuse features across scales, significantly improving reconstruction results. • Best accuracy-speed trade-off. SurfR is competitive with state-of-the-art reconstruction fidelity and is faster than baselines at their optimal resolution. 2 Related Work Surface reconstruction spans several decades of research in geometry processing, addressing a challenging and long-standing problem. We can study these methods across different dimensions: generalizable (single model for multiple objects), feature extraction (single point feature or multi-scale features), method architecture (query feature regression or learned kernels), etc. Generability: Learning-based approaches for surface reconstruction take advantage of rich data priors to better handle noise, incomplete data, and inconsistent normals, which can be separated into object-specific and generalizable methods. Object-specific methods Dai and Niessner 2019 ; Liao et al. 2018 ; Wang et al. 2018 ; Mildenhall et al. 2020 ; Park et al. 2019 ; Mescheder et al. 2019 ; Saito et al. 2019 ; Meshry et al. 2019 ; Sitzmann et al. 2019 ; Chabra et al. 2020 ; Tancik et al. 2020 ; Groueix et al. 2018 ; Sitzmann et al. 2020 ; Dai et al. 2020 ; Jiang et al. 2020 ; Takikawa et al. 2021 ; Peng et al. 2020 ; Martel et al. 2021 ; Gaur et al. 2024 focus on a single object/scene to create an implicit surface representation from the input point cloud that is decoded when necessary. These methods can lead to high-quality reconstructions, though they are limited in generalizing newer shapes and geometry. In contrast, generalizable methods such as Park et al. 2019 ; Erler et al. 2020 ; Peng et al. 2020 ; Chibane et al. 2020 ; Chibane and Pons-Moll 2020 ; Boulch and Marlet 2022 ; Wang et al. 2023 ; Williams et al. 2021 ; Williams et al. 2022 ; Huang et al. 2023 can generalize to a wide range of shapes, with a penalty in the reconstruction quality. These typically differ in how the query representation is built. The proposed method follows the latter. Feature Extraction: In general, all learning methods have a similar structure. A feature representation is built from the input point cloud and then decoded to get its implicit surface. In the object-centric methods, this feature representation is associated with an explicit per-object geometric structure Peng et al. 2020 ; Takikawa et al. 2021 ; Gaur et al. 2024 known