Hierarchical Direction Perception via Atomic Dot-Product Operators for Rotation-Invariant Point Clouds Learning

Chenyu Hu, Xiaotong Li, Hao Zhu, Biao Hou · 2025

Read Hierarchical Direction Perception via Atomic Dot-Product Operators for Rotation-Invariant Point Clouds Learning by Chenyu Hu, Xiaotong Li, Hao Zhu, Biao Hou (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-08240.txt.

Introduction

Chenyu Hu, Xiaotong Li, Hao Zhu, and Biao Hou propose DiPVNet, a network that learns from three dimensional point clouds no matter how they are rotated. Point clouds drive many vision tasks, but arbitrary rotation changes a cloud orientation and disrupts its directional features. Earlier methods model rotation effects only implicitly and miss the multi scale directional structure of real clouds.

An atomic dot product operator encodes directional selectivity together with rotation invariance. Locally, a learnable operator lets each centre point interact with neighbours to capture uneven structure. Globally, harmonic analysis links dot products with sampled directions to a direction aware spherical Fourier transform, building a rotation steady representation for deep learning.

Catalog record

CREATORChenyu Hu, Xiaotong Li, Hao Zhu, Biao Hou
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-08240

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Hierarchical Direction Perception via Atomic Dot-Product Operators for Rotation-Invariant Point Clouds Learning Chenyu Hu, Xiaotong Li, Hao Zhu, Biao Hou Abstract Point cloud processing has become a cornerstone technology in many 3D vision tasks. However, arbitrary rotations introduce variations in point cloud orientations, posing a long-standing challenge for effective representation learning. The core of this issue is the disruption of the point cloud’s intrinsic directional characteristics caused by rotational perturbations. Recent methods attempt to implicitly model rotational equivariance and invariance, preserving directional information and propagating it into deep semantic spaces. Yet, they often fall short of fully exploiting the multiscale directional nature of point clouds to enhance feature representations. To address this, we propose the Direction-Perceptive Vector Network (DiPVNet). At its core is an atomic dot-product operator that simultaneously encodes directional selectivity and rotation invariance—endowing the network with both rotational symmetry modeling and adaptive directional perception. At the local level, we introduce a Learnable Local Dot-Product (L2DP) Operator, which enables interactions between a center point and its neighbors to adaptively capture the non-uniform local structures of point clouds. At the global level, we leverage generalized harmonic analysis to prove that the dot-product between point clouds and spherical sampling vectors is equivalent to a direction-aware spherical Fourier transform (DASFT). This leads to the construction of a global directional response spectrum for modeling holistic directional structures. We rigorously prove the rotation invariance of both operators. Extensive experiments on challenging scenarios involving noise and large-angle rotations demonstrate that DiPVNet achieves state-of-the-art performance on point cloud classification and segmentation tasks. Our code is available at https://github.com/wxszreal0/DiPVNet . Figure 1: We extract direction-sensitive local features via the L2DP operator; concurrently, a global directional response spectrum is constructed through the DASFT module, capturing the directional characteristics of the overall structure. 1 Introduction The widespread adoption of 3D sensing technologies has made point cloud processing a critical component in numerous 3D vision applications ( Guo et al. 2020 ; Feng et al. 2023 ; Jia et al. 2025 ; Feng et al. 2024 ) , including autonomous driving scene understanding and embodied AI interaction. However, conventional point cloud representation learning methods face a fundamental challenge in real-world deployments ( Dym and Maron 2020 ) : arbitrary rotations in 3D space can alter the spatial distribution of point clouds. As a result, traditional networks ( Qi et al. 2017a ; Qi et al. 2017b ; Xiang et al. 2021 ) may map different orientations of the same object to inconsistent feature representations, ultimately degrading the performance of downstream tasks under rotational disturbances. At the root of this issue lies the directional nature of point cloud features across multiple scales. On the local scale, discriminative cues are embedded in features such as edge orientation and surface normals; on the global scale, high-level geometric priors arise from principal axis directions, inter-part angles, and overall structural symmetries. These intrinsic directional characteristics are disrupted under arbitrary rotations, implying that robust point cloud representations must explicitly model and leverage such multiscale directional information to achieve rotation resilience. To tackle this challenge, earlier methods focused on explicit modeling by independently extracting features along predefined directions—such as dividing local neighborhoods into directional sectors ( Jiang et al. 2018 ) or introducing orientation density functions (ODF) ( Sahin, Mertan, and Unal 2022 ) —thus encoding directional information in a manually structured manner. While this mitigated orientation-related inconsistencies to some extent, more recent implicit modeling paradigms incorporate the rotational symmetry of 3D space directly into the network design. These methods produce outputs that are either equivariant (rotate synchronously with the input) ( Thomas et al. 2018 ; Schütt, Unke, and Gastegger 2021 ; Poulenard and Guibas 2021 ) or invariant (remain unchanged) ( Zhang et al. 2019 ; Chou et al. 2021 ; Gu et al. 2021 ) under input rotations, thereby allowing directional information to be implicitly propagated to deeper semantic layers. Although both paradigms have demonstrated promising results under rotational perturbations, they remain unsatisfactory in critical ways. Explicit approaches often rely on fixed directional partitions or handcrafted statistical schemes, lacking the adaptability to learn from non-uniform local point distributions, which limits the robustness and discriminability of their directional representations. Implicit approaches, while successfully preserving directional information through rotation-equivariant or invariant formulations, often fail to exploit this information efficiently at the feature representation level. For instance, in VNN ( Deng et al. 2021 ) , the non-linear layers are guided by a single learned global direction vector, which is used to gate vector neurons through inner products. This reliance on a single global direction fails to capture the complex hierarchical directional structure inherent in real-world point clouds. To enable networks to preserve rotational symmetry while adaptively perceiving multiscale directional features, we propose DiPVNet, a framework constructed upon atomic dot-product operators. Our key insight lies in revealing the intrinsic property of the dot-product operation: it acts as a directional filter that simultaneously exhibits directional selectivity and rotation invariance. Based on this, DiPVNet avoids the need to explicitly model predefined directional features. Instead, as visualized in Figure 1, the directional selectivity of dot-product operators enables adaptive perception of local directions, while the hierarchical aggregation of global directional responses builds discriminative multiscale representations. The rotation invariance of the operator ensures robustness to arbitrary rotational transformations. Specifically, our contributions are as follows: • We identify and exploit the dual property of the dot-product operation—directional selectivity and rotation invariance—to design atomic dot-product operators that empower the network to perceive directional structures adaptively while maintaining rotational symmetry. • We propose a Learnable Local Dot-Product (L2DP) operator, which performs differentiable dot-products between a center point and its neighbors, enabling adaptive learning of local directional features and improving the network’s ability to handle non-uniform local structures. • We propose the Direction-Aware Spherical Fourier Transform (DASFT). It uses dot-products to project point clouds onto spherical vectors, yielding a global directional response spectrum. This captures global directional features while reducing geometry misinterpretation risks from over-reliance on local features. Extensive experiments under various challenging scenarios—including noise, large-angle rotations, and occlusions—demonstrate that DiPVNet outperforms existing rotation-robust methods across multiple benchmarks. Our method accurately identifies both discriminative global directional structures and critical local regions, significantly improving the robustness and accuracy of point cloud classification, segmentation, and other downstream 3D tasks. 2 Related Work To address the challenge of rotational perturbations in 3D point cloud analysis, existing research has explored various strategies to enhance rotational robustness. These approaches can be broadly categorized into two main directions: explicit directional encoding and implicit modeling of rotational symmetry. 2.1 Explicit directional encoding Explicit directional encoding focuses on designing specific mechanisms to directly capture directional information in point clouds. For example, common strategies ( Xia et al. 2021 ; Wang et al. 2023 ) such as spatial orientation partitioning divide local space into fixed directional quadrants to extract orientation-aware features. ODFNet ( Sahin, Mertan, and Unal 2022 ) models directionality by partitioning the spherical neighborhood into predefined directional cones and statistically analyzing the point distributions. Although these methods alleviate representation inconsistency caused by orientation variations through explicit directional modeling, their fixed spatial partitioning schemes are limited in adapting to the non-uniform distribution of point clouds. 2.2 Implicit modeling of rotational symmetry Implicit modeling of

Read the complete text