RINO: Rotation-Invariant Non-Rigid Correspondences

Maolin Gao Shao Jie Hu-Chen Congyue Deng, Riccardo Marin Leonidas Guibas Daniel Cremers · 2026

Read RINO: Rotation-Invariant Non-Rigid Correspondences by Maolin Gao Shao Jie Hu-Chen Congyue Deng, Riccardo Marin Leonidas Guibas Daniel Cremers (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-27773.txt.

Introduction

Gao and co-authors match 3D shapes without regard to rotation. RINO learns dense correspondences in an unsupervised way. RINONet pulls features straight from raw geometry. Vector-based invariant learning handles the rotation side. Orientation-aware functional maps handle the rest. No pre-alignment or handcrafted descriptors are needed. Tests span bent, partial, noisy, and non-manifold shapes. Scores set new highs on hard matching tasks.

Catalog record

CREATORMaolin Gao Shao Jie Hu-Chen Congyue Deng, Riccardo Marin Leonidas Guibas Daniel Cremers
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE65177
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2603.27773

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

RINO: Rotation-Invariant Non-Rigid Correspondences Maolin Gao Shao Jie Hu-Chen Congyue Deng, Riccardo Marin Leonidas Guibas Daniel Cremers Abstract Dense 3D shape correspondence remains a central challenge in computer vision and graphics as many deep learning approaches still rely on intermediate geometric features or handcrafted descriptors, limiting their effectiveness under non-isometric deformations, partial data, and non-manifold inputs. To overcome these issues, we introduce RINO, an unsupervised, rotation-invariant dense correspondence framework that effectively unifies rigid and non-rigid shape matching. The core of our method is the novel RINONet, a feature extractor that integrates vector-based SO(3)-invariant learning with orientation-aware complex functional maps to extract robust features directly from raw geometry. This allows for a fully end-to-end, data-driven approach that bypasses the need for shape pre-alignment or handcrafted features. Extensive experiments show unprecedented performance of RINO across challenging non-rigid matching tasks, including arbitrary poses, non-isometry, partiality, non-manifoldness, and noise. Figure 1 : We propose RINO , an unsupervised framework unifying rigid and non-rigid shape matching. Our end-to-end point feature extractor, the RINONet , is invariant to extrinsic rotations and robust to intrinsic symmetries, without relying on handcrafted descriptors (shape orientations indicated by RGB frames). It handles challenging non-rigid matching cases with arbitrary poses, non-isometry, partiality, non-manifoldness, and noise. From left to right we show pairs of humanoid, quadruped, airplane, partial and non-manifold shapes. 1 Introduction Establishing correspondence between 3D shapes is a foundational and challenging problem in computer vision and graphics. While deep learning has enhanced classical shape matching by replacing handcrafted descriptors with learned features, most approaches still depend on intermediate geometric representations rather than operating directly on raw shape data 34 ; 12 ; 30 ; 4 ; 37 ; 21 . This reliance on human-designed features, which are often specialized (e.g., for isometric shapes), fundamentally limits robustness and generalization across diverse, challenging conditions like non-isometric deformations, partiality, and non-manifold structures. Hence, a compelling alternative is to start learning directly from the raw data — namely, using the vertex coordinates as input. Such an approach appears appealing for several reasons: it does not require preprocessing, it does not rely on theoretical assumptions, and it has been the most successful approach in other domains (e.g., CNNs generally take RGB pixel values as input directly, LLMs start from words or sub-words tokens). In accordance with Sutton’s bitter lesson 58 , we believe that the path toward robust shape correspondence lies in scalable end-to-end learning, with little or no human-encoded sophistication. However, directly processing raw 3D geometry introduces the challenge of shape–pose entanglement , which has traditionally led to splitting the problem into two separate subproblems: rigid matching, estimating global rotations and translations; and non-rigid matching, assuming pose alignment to infer dense correspondences. This separation, however, is inherently ill-posed, as global transformations and local deformations are tightly coupled. The distinction becomes especially ambiguous when canonical poses are hard to define, for example, between a running and a sitting human, or in cases of partial shape matching. To eliminate the need for rigid pose alignment, fully intrinsic shape matching methods 21 ; 12 leverage handcrafted intrinsic features (e.g., wks 6 ) and intrinsic architectures (e.g., DiffusionNet 54 ). Yet, reliance solely on intrinsic information fundamentally limits their scope: it cannot theoretically distinguish shape symmetries, and it yields severely degraded and incompatible features for non-smooth or irregular shapes 35 ; 67 ; 68 ; 27 ; 26 . In this work, we propose a paradigm that goes beyond the need of manual pose alignment and does not suffer from any of the previous limitations. Our insight stems from three properties which we believe coexist in the ideal shape descriptor: first, it should be robust to noise and artifacts; second, it incorporates the geometric prior provided by the underlying surface; finally, it characterizes shape vertices regardless of the extrinsic orientation of the shape. To our knowledge, no available methods respect all these points. To this end, our idea is to develop a rotation-invariant architecture, which factors out the global shape orientation from the articulations’ non-rigid deformation. In particular, we revise the components of the popular DiffusionNet 54 to be SO(3)-equivariant end-to-end, using a vector neuron representation. Such modifications are well-motivated by theoretical derivations that we report in the appendix. Our network can learn SO(3)-invariant, geometric features directly from raw 3D geometry. The feature gradients are further integrated with the orientation-aware Complex Functional Maps (CFMaps) 20 ; 21 to map tangent bundles between shapes. The entire system is then trained using a novel unsupervised loss that unifies Functional Maps (FMaps), CFMaps, and pointwise maps, creating a unified framework that leverages their complementary strengths for achieving high-quality, robust features and correspondences (Fig. 1 - 3 ). To summarize, our key contributions are: • We introduce the first unsupervised rotation-invariant dense correspondence method, RINO , that unifies rigid and non-rigid matching. • Our novel feature extractor, RINONet , achieves direct, end-to-end, and robust feature extraction from raw geometry, and discovers complex, scalable features without the need for handcrafted descriptors or shape pre-alignment. • We integrate SO(3)-invariant learning with orientation-aware complex FMaps on tangent vector fields, yielding a coherent network architecture and unsupervised loss. • Extensive experiments demonstrate superior performance across challenging non-rigid matching scenarios, including arbitrary poses, non-isometric deformations, partiality, non-manifold structures, and noise perturbations. 2 Related Works Non-rigid shape matching aims to find correspondences between points on two shapes. We focus on the most relevant works below and refer to 61 ; 51 for an extensive review. Learning Non-Rigid Correspondences. The Deep Functional Maps framework 43 ; 34 enabled deep learning in non-rigid matching. It uses a learnable feature extractor to refine initial descriptors (e.g., shot 52 ) before computing a functional map. This framework has since been extended to zero-shot 2 ; 3 , weakly supervised 53 and unsupervised settings 30 ; 10 , incorporating more advanced objectives 22 ; 57 ; 33 . While some explored learning bases 39 ; 32 ; 28 , the theoretical strength of the Laplace-Beltrami Operator (LBO) bases remains preferred. As a feature extractor, initial works used ResNet with shot or PointNet++/KPConv with xyz 53 ; 22 , but lately DiffusionNet 54 has emerged as the standard for learning robust descriptors 5 ; 10 ; 21 ; 57 ; 4 among other networks 65 ; 36 . Notably, the focus of these works has been mainly on designing losses. We instead propose a novel feature extractor that learns SO(3)-invariant features directly from raw 3D geometry. Figure 2 : Our learned SO(3)-invariant features. We visualize the Euclidean distance to the blue surface point in the learned feature space (darker red means higher similarity). Semantic correspondences have a similar feature similarity pattern (left & mid.). The learned feature is invariant to rotations (mid. & right). Shape orientations are depicted by RGB frames. Shape Descriptors in 3D Matching. Historically, 3D shape analysis relied on handcrafted descriptors like hks 56 , wks 6 , and shot 52 to establish canonical feature spaces, which modern deep learning models now use as refined inputs. However, shot is highly sensitive to discretization and mesh connectivity 5 , while wks is limited by an isometric assumption (Sec. 6 ) that fails under significant non-rigid deformation and cannot theoretically disambiguate intrinsic symmetry.

Read the complete text