Automated 3D-GS Registration and Fusion via Skeleton Alignment and Gaussian-Adaptive Features

Shiyang Liu, Dianyi Yang, Yu Gao, Bohan Ren, Yi Yang*, Mengyin Fu · 2025

Read Automated 3D-GS Registration and Fusion via Skeleton Alignment and Gaussian-Adaptive Features by Shiyang Liu, Dianyi Yang, Yu Gao, Bohan Ren, Yi Yang*, Mengyin Fu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-20480.txt.

Introduction

Shiyang Liu and five co-authors present a way to merge 3D scene maps without human help. Their 2025 paper works with 3D Gaussian Splatting, a method that builds scenes from many soft blobs for fast rendering. Most work builds one map at a time. Joining several sub-maps into one scene usually needs manual steps and blunt filtering.

The team first pulls out the skeleton shape of each scene to line the sub-maps up. A special filter reads the blobs' traits to make the match robust. For merging, a multi-factor plan replaces hard cut-offs that used to drop scene detail. On test scenes, alignment error fell by about forty-two percent on hard cases. Render quality after merging rose sharply, keeping fine structure intact.

Catalog record

CREATORShiyang Liu, Dianyi Yang, Yu Gao, Bohan Ren, Yi Yang*, Mengyin Fu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-20480

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Automated 3D-GS Registration and Fusion via Skeleton Alignment and Gaussian-Adaptive Features Shiyang Liu, Dianyi Yang, Yu Gao, Bohan Ren, Yi Yang*, Mengyin Fu Abstract In recent years, 3D Gaussian Splatting (3D-GS)-based scene representation demonstrates significant potential in real-time rendering and training efficiency. However, most existing methods primarily focus on single-map reconstruction, while the registration and fusion of multiple 3D-GS sub-maps remain underexplored. Existing methods typically rely on manual intervention to select a reference sub-map as a template and use point cloud matching for registration. Moreover, hard-threshold filtering of 3D-GS primitives often degrades rendering quality after fusion. In this paper, we present a novel approach for automated 3D-GS sub-map alignment and fusion, eliminating the need for manual intervention while enhancing registration accuracy and fusion quality. First, we extract geometric skeletons across multiple scenes and leverage ellipsoid-aware convolution to capture 3D-GS attributes, facilitating robust scene registration. Second, we introduce a multi-factor Gaussian fusion strategy to mitigate the scene element loss caused by rigid thresholding. Experiments on the ScanNet-GSReg and our Coord datasets demonstrate the effectiveness of the proposed method in registration and fusion. For registration, it achieves a 41.9% reduction in RRE on complex scenes, ensuring more precise pose estimation. For fusion, it improves PSNR by 10.11 dB, highlighting superior structural preservation. These results confirm its ability to enhance scene alignment and reconstruction fidelity, ensuring more consistent and accurate 3D scene representation for robotic perception and autonomous navigation. I INTRODUCTION Multi-view collaborative mapping holds significant application value in unmanned systems [ 1 ] . With the advancement of 3D reconstruction, map representations in such systems have evolved substantially. Beyond conventional voxels, meshes, and point clouds, emerging paradigms like neural radiance fields (NeRF) [ 2 , 3 , 4 ] and 3D Gaussian Splatting (3D-GS) [ 5 , 6 , 7 ] have redefined environmental modeling. Among these, 3D-GS emerges as a promising solution for high-fidelity mapping by explicitly modeling radiative properties while addressing critical requirements in unmanned systems – striking a balance between real-time rendering and visual fidelity [ 8 , 9 ] . Compared to traditional discrete representations, 3D-GS achieves superior rendering quality while maintaining adaptability for multi-sensor fusion [ 10 ] , making it well-suited for applications demanding both precision and operational efficiency in complex environments. However, most existing 3D-GS-based mapping approaches focus on global or incremental reconstruction within a single map [ 11 , 12 ] , with limited attention to the registration and fusion of multiple sub-maps. As illustrated in Fig. 1 , when an unmanned system constructs two 3D-GS sub-maps from intersecting ground and aerial viewpoints, aligning and integrating them into a coherent and photorealistic 3D representation remains a challenging task. Unlike point cloud, 3D-GS registration requires jointly estimating spatial transformations while accounting for Gaussian-specific attributes such as anisotropic covariance, opacity, and spherical harmonics, which influence both geometric alignment and radiance consistency. Additionally, fusion involves optimizing Gaussian selection and blending strategies to avoid structural distortions and radiometric inconsistencies, ensuring seamless integration while preserving both global structure and fine-grained details for high-fidelity rendering. Fig. 1 : Illustration of our task. A vehicle (Diablo) and a drone (Tello) independently capture data and reconstruct separate 3D-GS sub-map. The drone view offers broad structural coverage, while the vehicle view captures fine details. A fusion strategy integrates both, producing a unified 3D-GS model with global completeness and high fidelity. A feasible solution has been to manually select the sub-map with relatively better geometric features as the foundational skeleton, standardize the coordinate system, and enforce registration by matching the other sub-map to it [ 13 , 14 , 15 ] . Subsequently, a spatial threshold is applied to determine which 3D-GS primitives should be retained from each sub-map, achieving scene fusion. Nevertheless, these approach faces the following challenges: 1) Manually assisted geometric registration : Manually determining which sub-map has better geometric structure can be brittle, especially when both exhibit similar rendering quality. Moreover, most methods now used registration methods mainly employ point cloud-based transformation approaches [ 16 , 17 , 18 , 19 , 20 , 21 , 22 , 23 , 24 ] , neglecting 3D-GS attributes including opacity, anisotropic covariance, and spherical harmonics, thereby limiting their capacity to utilize 3D-GS properties. 2) Hardcore threshold truncation fusion : After registration, applying hard distance threshold filtering to 3D-GS primitives may degrade rendering quality, potentially leading to issues such as hollow objects, missing parts, or incomplete scene representation [ 13 , 25 ] . To address the above issues, we propose an automated structure-aware framework that eliminates manual intervention and enhances scene registration and fusion. First, we introduce a geometry skeleton extraction and registration strategy, ensuring global structural consistency through automated merging and refinement. Second, to overcome limitations in feature extraction due to the anisotropic nature of 3D Gaussians, a Gaussian-adaptive convolution method is developed, leveraging Mahalanobis distance-based neighborhood selection and ellipsoid-aware kernels to enhance local feature representation [ 26 ] . Finally, to preserve structural integrity and detail accuracy, we introduce a score-based Gaussian primitive selection strategy that balances structural consistency, local detail fidelity, and spatial coherence. In conclusion, our research contributions are as follows: 1) A skeleton-based initialization and Gaussian-adaptive feature extraction framework, integrating anisotropic neighborhood selection and ellipsoid-aware convolution to enhance feature distinctiveness, enabling efficient preprocessing and robust registration of sub-maps. 2) An optimized Gaussian fusion strategy, incorporating multi-factor scoring to refine Gaussian selection, ensuring structural preservation and seamless integration. 3) Extensive evaluations on ScanNet-GSReg dataset demonstrate competitive registration accuracy and reconstruction fidelity, validating the effectiveness of the proposed fusion strategy in preserving fine-grained details. II RELATED WORK II-A 3D Scene Representation and Registration Methods Traditional 3D scene representations, including point clouds, voxel grids, and meshes, are widely used in robotics but struggle with sparse data, computational complexity, and noise propagation [ 27 , 28 ] . Classical registration methods, such as ICP [ 29 , 30 , 31 ] and RANSAC [ 32 , 33 ] , rely on rigid transformations and geometric consistency, making them less effective in handling large viewpoint variations and structural discrepancies between independently reconstructed scenes. Learning-based approaches enhance robustness via deep feature matching [ 34 , 35 ] and semantic-aware networks [ 36 ] but remain constrained by viewpoint sensitivity. Recent advancements in NeRF have introduced novel registration paradigms, shifting from purely geometric to radiance-based representations. NeRF2NeRF [ 37 ] employs keypoint supervision for multi-modal alignment at the cost of scalability, while DReg-NeRF automates geometric disentanglement but struggles with large-scale adaptability [ 38 ] . NeRFuser [ 39 ] enhances multi-view consistency but inherits volumetric rendering overhead. Despite NeRF’s advances, its implicit nature obscures explicit geometric relationships, limiting robotic applications. 3D-GS mitigates this by combining geometric manipulability with differentiable photometric optimization, achieving faster registration and high-fidelity rendering crucial for robotic perception. II-B 3D-GS-Based Reconstruction and Registration Integrating aerial and ground-level data for 3D reconstruction presents challenges in resolution, scale consistency, and occlusions. Traditional methods, including multi-view stereo (MVS) [ 40 ] , photogrammetry [ 41 ] , and mesh-based techniques [ 16 ] , often suffer from misalignment due to significant viewpoint variations. 3D-GS-based approaches address these limitations by leveraging Gaussian representations for more flexible and robust fusion. UC-GS [ 42 ] enhances scene fidelity

Read the complete text