Towards Symmetry-sensitive Pose Estimation: A Rotation Representation for Symmetric Object Classes
Andreas Kriegler, Csaba Beleznai, Margrit Gelautz · 2026
Read Towards Symmetry-sensitive Pose Estimation: A Rotation Representation for Symmetric Object Classes by Andreas Kriegler, Csaba Beleznai, Margrit Gelautz (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-18208.txt.
Introduction
Kriegler, Beleznai, and Gelautz tackle pose estimation for symmetric objects, whose orientation ambiguities confuse deep networks. Current fixes rely on custom losses, network designs, or shape-blind metrics. The authors instead rework the rotation representation itself, tweaking trigonometric identities by each object's degrees of symmetry. Their SARR code gives canonical poses on two standard data sets, letting a plain convolutional network beat the state of the art under a shape-aware distance.
Catalog record
| CREATOR | Andreas Kriegler, Csaba Beleznai, Margrit Gelautz |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 92213 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.18208
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Towards Symmetry-sensitive Pose Estimation: A Rotation Representation for Symmetric Object Classes Andreas Kriegler, Csaba Beleznai, Margrit Gelautz Abstract Symmetric objects are common in daily life and industry, yet their inherent orientation ambiguities that impede the training of deep learning networks for pose estimation are rarely discussed in the literature. To cope with these ambiguities, existing solutions typically require the design of specific loss functions and network architectures or resort to symmetry-invariant evaluation metrics. In contrast, we focus on the numeric representation of the rotation itself, modifying trigonometric identities with the degrees of symmetry derived from the objects’ shapes. We use our representation, SARR, to obtain canonic (symmetry-resolved) poses for the symmetric objects in two popular 6D pose estimation datasets, T-LESS and ITODD, where SARR is unique and continuous w.r.t. the visual appearance. This allows us to use a standard CNN for 3D orientation estimation whose performance is evaluated with the symmetry-sensitive cosine distance AR C . Our networks outperform the state of the art using AR C and achieve satisfactory performance when using conventional symmetry-invariant measures. Our method does not require any 3D models but only depth, or, as part of an additional experiment, texture-less RGB/grayscale images as input. We also show that networks trained on SARR outperform the same networks trained on rotation matrices, Euler angles, quaternions, standard trigonometrics or the recently popular 6d representation – even in inference scenarios where no prior knowledge of the objects’ symmetry properties is available. Code and a visualization toolkit are available at https://github.com/akriegler/SARR . keywords symmetry, rotation representation, pose estimation, evaluation metrics This version of the article has been accepted for publication, after peer review but is not the Version of Record and does not reflect post-acceptance improvements or corrections. The Version of Record is available at: http://dx.doi.org/10.1007/s11263-026-02770-x . Springer Nature SharedIt link is: https://rdcu.be/fb3QU . 1 Introduction Figure 1 : Comparing rotation representations on a symmetric shape. Using a rotation of 5^{\circ} as reference (I), rotating the rectangle by another 180^{\circ} creates ambiguities due to visual equality but numeric differences (II). A space restriction can resolve this, numerically treating the object as if it were rotated by 5^{\circ} (dashed arrow) (III). Yet this does not ensure continuity for visually similar poses close to the restriction boundary ( \mathit{175^{\circ}\leftrightarrow 5^{\circ}} ) (IV). Contrarily, our formulation is both unique across the rotation space and continuous across the symmetry boundary transition. ✓ marks a correct/similar representation, ✗ is incorrect. “6d” denotes the 6d representation proposed by 65 . 6D pose estimation is a prerequisite to enable robot grasping and manipulation tasks such as bin picking, as well as virtual and augmented reality applications. With the adoption of deep learning approaches and the usage of large training datasets, significant progress has been made for object pose estimation ( 10 ; 19 ; 28 ; 44 ; 38 ; 45 ; 46 ) , yet the challenges related to rotationally symmetric objects, specifically the ambiguities that arise, are rarely discussed thoroughly. It is sometimes possible to resolve these ambiguities by using symmetry-breaking visual features from the RGB domain such as non-symmetric color patterns like distinctive design elements on manufactured goods. At the same time, an important motivation of our work is that texture-less objects are common in industrial or robotics applications ( 14 ; 21 ; 29 ) . Furthermore, depth cameras or 3D LiDAR pointclouds are common modalities in robotics ( 48 ) . Thus, we focus on the challenging task of object pose estimation where geometric symmetries are intrinsic properties due to an object’s shape ( 44 ; 5 ) and assume no symmetry-breaking RGB texture to help resolve the ambiguities. These ambiguities are prohibitive when optimizing a network to estimate the orientation ( 17 ) , since the bijective relation between the visual representation \mathcal{V}(\bm{p}) , e.g. an image of an object in pose \bm{p} , and the corresponding numeric rotation representation \mathcal{N}(\bm{p}) , e.g. a rotation matrix, no longer holds: multiple orientations represent the same visual input and the resulting multi-modal distribution cannot be learned unambiguously. To better understand the problems raised by symmetric objects, let us consider the rectangles in columns I and II of Fig. 1 . For other rotation representations – we consider Euler angles, rotation matrices, the 6d representation ( 65 ) , quaternions and trigonometric identities – two numerically different representations apply to visually identical poses \bm{p}_{\textup{I}},\bm{p}_{\textup{II}} : \begin{split}\mathcal{V}(\bm{p}_{\textup{I}})=\mathcal{V}(\bm{p}_{\textup{II}})\text{ but }\mathcal{N}(\bm{p}_{\textup{I}})\neq\mathcal{N}(\bm{p}_{\textup{II}}).\end{split} (1) While the rectangles are visually indistinguishable, “physically” they are oriented differently (marked by the yellow arrow) and thus have different numeric representations. There is therefore no function \mathcal{F}\text{: }\mathcal{V}(\bm{p})\mapsto\mathcal{N}(\bm{p}) for all possible \bm{p}\in\text{SO(3)} . As 46 state, an attempt to learn such a function with a Machine Learning (ML) algorithm such as a Convolutional Neural Network (CNN) would fail for many loss functions, as the network converges naively to the mean of possible poses (if at all). This is true not only for rotation matrices but also other rotation representations ( 27 ) . Current pose estimation methods typically attempt to solve this problem in two ways: Firstly, the network architectures and/or loss functions are modified to resolve ambiguities. This was originally proposed by 46 , who split the rotation space into multiple bins, train a regression network for each bin as well as a classifier to pick the regressor to invoke. A disadvantage of this discretization approach is that it requires multiple networks and thus extends training times. Secondly, evaluation often relies on metrics that are symmetry-invariant; i.e. metrics that give a full score as long as the network predicts 1 out of the n correct poses. Examples include the VSD, MSSD and MSPD metrics ( 24 ) , which have become standard for pose estimation through the BOP benchmark ( 23 ) . This means there is less incentive for methods to consider the ambiguities that stem from object symmetries - something we consider problematic, in line with 4 ’s reluctance to rely on ambiguity-invariant error functions. A third approach deals with the representation \mathcal{N} itself by restricting the rotation space to only the canonic object poses ( 47 ) , see column III of Fig. 1 . The angle is clamped to the canonic space, numerically setting the orientation as marked by the dashed arrow. This restores uniqueness, i.e.: \begin{split}\mathcal{V}(\bm{p}_{\textup{I}})=\mathcal{V}(\bm{p}_{\textup{III}})\Leftrightarrow\mathcal{N}(\bm{p}_{\textup{I}})=\mathcal{N}(\bm{p}_{\textup{III}}),\end{split} (2) however the mathematical properties and consequences were not analysed in detail in that work. Most obviously, any representation built on angles from this canonic space is discontinuous across the boundary of the space, e.g. 180^{\circ}\pm\epsilon\leftrightarrow 0^{\circ}\pm\epsilon for the shown rectangle. We take inspiration from their approach as we explore these object symmetries more formally and propose the S ymmetry- A ware- R otation- R epresentation (SARR), which implements a space restriction while remaining continuous across the boundary (column IV in Fig. 1 ). We evaluate SARR using the symmetry classes of the texture-less objects in the T-LESS ( 21 ) and ITODD ( 14 ) datasets. These have, as part of the BOP benchmark suite, become highly popular choices for evaluating object pose estimation methods. Our contributions are therefore: 1. We formally describe the ambiguities due to object symmetries, targeting the symmetries and rotations of T-LESS and ITODD objects 2. We