GS-Matching: Reconsidering Feature Matching task in Point Cloud Registration
Yaojie Zhang, Tianlun Huang, Weijun Wang, Wei Feng · 2024
Read GS-Matching: Reconsidering Feature Matching task in Point Cloud Registration by Yaojie Zhang, Tianlun Huang, Weijun Wang, Wei Feng (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-04855.txt.
Introduction
Yaojie Zhang and co-authors rethink in 2024 how features are matched when aligning three dimensional point clouds. The classic nearest neighbor rule creates many to one matches and many points with no true partner. Newer methods turn matching into an assignment problem for clean one to one pairs, but the authors argue that shift is not reliable for general alignment work.
Their policy borrows from a classic stable matching method. It runs fast and finds more distinct correct matches when the two clouds overlap only a little. A probability based analysis adds new insight into the matching task itself. Tests on several data sets show better recall for the full alignment than rival policies.
Catalog record
| CREATOR | Yaojie Zhang, Tianlun Huang, Weijun Wang, Wei Feng |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-04855
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
GS-Matching: Reconsidering Feature Matching task in Point Cloud Registration Yaojie Zhang, Tianlun Huang, Weijun Wang, Wei Feng Abstract Traditional point cloud registration (PCR) methods for feature matching often employ the nearest neighbor policy. This leads to many-to-one matches and numerous potential inliers without any corresponding point. Recently, some approaches have framed the feature matching task as an assignment problem to achieve optimal one-to-one matches. We argue that the transition to the Assignment problem is not reliable for general correspondence-based PCR. In this paper, we propose a heuristics stable matching policy called GS-matching, inspired by the Gale-Shapley algorithm. Compared to the other matching policies, our method can perform efficiently and find more non-repetitive inliers under low overlapping conditions. Furthermore, we employ the probability theory to analyze the feature matching task, providing new insights into this research problem. Extensive experiments validate the effectiveness of our matching policy, achieving better registration recall on multiple datasets. 1 Introduction Point cloud registration (PCR) stands as a vital and foundational challenge within 3D computer vision, with broad implications for Simultaneous Localization and Mapping (SLAM) [ 39 ] , 3D object detection [ 19 ] , and robotics applications [ 24 ] . When dealing with two 3D scans capturing the same object or scene, PCR aims to determine a precise six-degree-of-freedom (6-DoF) pose transformation to align input point clouds accurately. The conventional correspondence-based PCR involves two key steps: feature correspondence establishment and rigid transformation estimation. Specifically, feature correspondence establishment initially with extracting a feature descriptor for each keypoint, followed by establishing correspondences in feature space. Given feature descriptors, putative feature correspondences by default are generated by finding the nearest neighbor in the feature space. Under this matching policy, each source keypoint is matched with the target keypoint possessing the highest feature similarity score. However, this policy neglects the one-to-one matching principle and leads to the many-to-one matching problem [ 48 ] . Although 3D point cloud registration task has received widespread attention in past decades, the policy to generate putative feature correspondences from feature descriptors has not been investigated widely. Previous works, such as [ 11 , 45 , 40 , 2 , 9 , 46 ] only focus on the impact of different descriptor types and outlier rejection algorithms. The matching policy to generate correspondences is not considered. Some deep-learned approaches [ 37 , 31 , 44 , 48 ] treat the feature matching as an Assignment Problem to achieve optimal one-to-one matches. However, this transition is not reliable for partial overlap PCR. We will also explain the reason and show the experiment result in the following Sec. 3.2 and Sec. 4.4 . In this paper, our primary focus is on examining the impact of the matching policy on registration performance. We consider a good generate policy should ensure real-time performance itself, generate as many inliers as possible, and be compatible with current mainstream correspondence-based PCR frameworks. Guided by these principles, we propose a heuristically stable matching policy called GS-Matching which is inspired by the Gale-Shapley algorithm. Additionally, we analyze the feature matching task using the probability theory and provide a novel perspective. In summary, our main contributions are as follows: 1. A heuristically stable matching policy called GS-Matching is proposed. The proposed GS-Matching can find more reliable inliers compared to other matching policies thereby improving the registration performance. 2. Proposal of a method, informed by probability theory, to reduce point cloud size without compromising registration performance. 3. Validation of GS-Matching’s suitability for general correspondence-based PCR through extensive experiments, showcasing its performance enhancement across diverse datasets. 2 Related Work Correspondence-based PCR involves two major research topics: 3D feature matching and outlier rejection. 2.1 3D Feature Matching 3D feature matching aims to establish initial correspondences based on feature descriptors. Feature descriptors typically take the form of vectors or histograms, describing the surrounding information of keypoints. Hand-crafted descriptors have been comprehensively reviewed in [ 20 ] . Spatial distribution histogram based descriptors [ 23 , 16 , 38 , 21 ] represented the local surface according to the spatial distributions (e.g., coordinates) information. Geometric attribute histogram based descriptors [ 7 , 35 , 34 , 36 ] utilized the geometric attributes (e.g., normals, curvatures) of points. Recently, deep learning techniques have been introduced to learn 3D local descriptors. The pioneering 3DMatch [ 45 ] employed a Siamese Network for extracting local descriptors. Some recent networks [ 1 , 42 , 11 , 43 , 3 , 22 ] aimed to extract more descriptive and robust descriptors by designing new network architecture or combining geometric information. These studies emphasized the extraction of highly distinctive features, where a single feature can be accurately matched with a high probability against numerous unrelated features. However, the policy to generate correspondences lacks study and by default is finding the nearest neighbor in feature space. Despite significant advancements in deep learning-based 3D feature matching technology, these methods are still prone to generate correspondences with extremely high outlier rates, posing a major challenge for correspondence-based PCR. As mentioned in Sec. 1 , the nearest neighbor policy results in massive repeat matching points which could be one of the reasons for the low inlier ratio issue. 2.2 Outlier rejection The outlier rejection method aims to remove outliers from initial correspondences to accurately estimate the geometric model for input point clouds. The widely used RANSAC [ 15 ] employed a generation-and-verification pipeline for robust outlier removal. However, a common issue of the RANSAC and its variants [ 4 , 33 , 5 , 12 ] is the challenge posed by low inlier ratios, making it difficult to find a reasonable model efficiently. To improve the RANSAC performance, GORE [ 6 ] reduced the size of correspondences by rejecting most true outliers. Due to the time complexity of the RANSAC method, various RANSAC-free methods have been explored. One of the representative works is [ 27 ] , which proposed the spatial compatibility technique. The spatial compatibility measure-based method utilizes correspondence-wise constraints to generate an adjacency matrix and transfer the outlier rejection problem to a maximum clique problem in graph theory. Clipper [ 28 ] and Teaser [ 40 ] introduced a graph-theoretic framework to achieve robust data association. SC2 [ 9 ] presented a second-order spatial compatibility measure allowing for more distinctive clustering compared to the original measure. MAC [ 46 ] relaxed the maximum clique constraint to a maximal clique constraint which can mine more local information in a graph. Global optimal approaches can also achieve outlier robustness registration. Go-ICP [ 41 ] used a branch-and-bound (BnB) scheme for globally optimal registration. FGR [ 49 ] employed the Geman-McClure cost function and estimated the model through graduated non-convexity optimization. Outlier rejection methods typically operate under the assumption that inliers dominate certain evaluation metrics, such as mean average error (MAE), mean square error (MSE), and inlier count. However, when the inliers rate is extremely low, as in cases of low overlap between point clouds, these methods struggle to distinguish inliers from noise, leading to registration failures. Consequently, the accuracy of point cloud registration is significantly influenced by the quality of the initial correspondences. Having better policies to generate correspondences with more inliers can enhance the outcomes of