Uncertainty-Aware Knowledge Distillation for Compact and Efficient 6DoF Pose Estimation
Nassim Ali Ousalah, Anis Kacem, Enjie Ghorbel, Emmanuel Koumandakis, Djamila Aouada · 2025
Read Uncertainty-Aware Knowledge Distillation for Compact and Efficient 6DoF Pose Estimation by Nassim Ali Ousalah, Anis Kacem, Enjie Ghorbel, Emmanuel Koumandakis, Djamila Aouada (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-13053.txt.
Introduction
Nassim Ali Ousalah and co-authors shrink pose estimation models while keeping them accurate, in this 2025 paper. Estimating an object's full position and orientation is called 6DoF pose estimation, and it serves robots, augmented reality, and spacecraft navigation. Big teacher models predict keypoints on the object, but each keypoint carries its own uncertainty. Their distillation method uses that uncertainty to steer what the small student learns.
Keypoints the teacher is sure of pull the student harder than shaky ones. The same weighting guides feature transfer at key spots. On a standard benchmark, the light student beat leading methods at its size. A spacecraft data set confirmed the approach holds up under varied conditions, the authors report.
Catalog record
| CREATOR | Nassim Ali Ousalah, Anis Kacem, Enjie Ghorbel, Emmanuel Koumandakis, Djamila Aouada |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 38 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-13053
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Uncertainty-Aware Knowledge Distillation for Compact and Efficient 6DoF Pose Estimation Nassim Ali Ousalah, Anis Kacem, Enjie Ghorbel, Emmanuel Koumandakis, Djamila Aouada Abstract Compact and efficient 6DoF object pose estimation is crucial in applications such as robotics, augmented reality, and space autonomous navigation systems, where lightweight models are critical for real-time accurate performance. This paper introduces a novel uncertainty-aware end-to-end Knowledge Distillation (KD) framework focused on keypoint-based 6DoF pose estimation. Keypoints predicted by a large teacher model exhibit varying levels of uncertainty that can be exploited within the distillation process to enhance the accuracy of the student model while ensuring its compactness. To this end, we propose a distillation strategy that aligns the student and teacher predictions by adjusting the knowledge transfer based on the uncertainty associated with each teacher keypoint prediction. Additionally, the proposed KD leverages this uncertainty-aware alignment of keypoints to transfer the knowledge at key locations of their respective feature maps. Experiments on the widely-used LINEMOD benchmark demonstrate the effectiveness of our method, achieving superior 6DoF object pose estimation with lightweight models compared to state-of-the-art approaches. Further validation on the SPEED+ dataset for spacecraft pose estimation highlights the robustness of our approach under diverse 6DoF pose estimation scenarios. I Introduction Six Degrees of Freedom (6DoF) object pose estimation is a fundamental area in computer vision, with wide-ranging application fields such as Augmented Reality (AR), robotic manipulation, satellite docking, and space debris tracking [ 1 , 2 , 3 , 4 , 5 ] . Its core objective involves estimating both the position and orientation of an object in 3D space relative to the camera coordinate system. The task of 6DoF pose estimation is typically addressed using a two-stage pipeline: (1) establishing correspondences between the 3D model of the object and input images [ 4 , 5 , 6 ] , and (2) computing the object’s pose from these correspondences using a Perspective-n-Point (PnP) algorithm [ 7 , 8 , 9 , 10 ] . While traditional methods address the first step by relying on carefully hand-designed features [ 11 ] , recent successful approaches have mostly shifted towards deep learning regressors that predict key primitives such as keypoints [ 6 , 4 ] or local predictions [ 12 , 13 ] , provided as input to the PnP solver. Fig. 1 : Uncertainty in Teacher Predictions . (a) Predictions from multiple teacher models show varied keypoint locations, represented by individual teacher predictions. (b) Keypoint predictions with high uncertainty values are visualized through clustered uncertainty markers. Despite achieving great accuracy, 6DoF pose estimation methods are practically challenged by real-world constraints. A key limitation lies in their reliance on large deep neural architectures with tens of millions of parameters [ 14 , 15 , 16 ] . To address this, Guo et al . [ 17 ] introduced a Knowledge Distillation (KD) strategy for efficient 6DoF pose estimation. KD aims at transferring knowledge from a deep teacher model to a more compact student model. While such an approach has been widely explored in the field of computer vision [ 18 , 19 , 20 ] , the work of [ 17 ] is the first to consider it in the specific field of 6DoF pose estimation. They observed that compact student networks often struggle to predict accurate keypoints as compared to larger teacher networks. They address this by distilling knowledge from the teacher to the student at the prediction-level of the keypoints through an Optimal Transport (OT) approach [ 21 ] . Additionally, the prediction-level KD was naively combined with an off-the-shelf feature-level KD method [ 22 ] in an attempt to further enhance the accuracy of the student model. While KD stands as an appealing approach for achieving efficient 6DoF pose estimation [ 23 , 17 ] , we identify key limitations at two levels in existing methods: (1) prediction-level - most works assume that the teacher network predicts all keypoints with equal confidence . However, as shown in Figure 1 -b, the keypoint predictions from the teacher often exhibit varying levels of uncertainty . Current methods [ 17 , 23 ] treat all predicted keypoints equally, ignoring this uncertainty. As a result, irrelevant knowledge may be transferred from the teacher, causing the introduction of a bias in the student model towards less reliable teacher predictions. (2) feature-level - KD is addressed at the feature-level independently from the prediction-level , which can lead to inconsistencies when aligning the features and predictions between the teacher and student networks. In this paper, we propose a novel KD method at both the prediction-level and the feature-level for efficient keypoint prediction in 6DoF object pose estimation, addressing the identified limitations. Our prediction-level KD approach, referred to as Uncertainty-Aware Knowledge Distillation (UAKD), leverages the uncertainties of keypoints predicted by the teacher model to guide the alignment between the teacher and student prediction distributions. The influence of keypoints with higher uncertainty in the teacher model is reduced in the KD process. This is achieved through an uncertainty-aware OT approach, where uncertainty values are integrated into the alignment strategy using an unbalanced Sinkhorn algorithm [ 24 ] . As shown in Figure 1 -a, we rely on a teacher ensembling method [ 25 , 26 ] to estimate the keypoint uncertainties, as 6DoF pose estimation techniques do not necessarily provide explicitly this information. In addition, we extend our KD framework to operate at the feature-level . The proposed KD mechanism is termed Prediction-related Feature Knowledge Distillation (PFKD). In particular, the predicted keypoints are traced back to their corresponding receptive fields in the feature maps of both the teacher and student models. By applying the OT solution from the prediction-level to the feature maps, we establish correspondences between relevant regions in the teacher and student feature maps. This enables distillation at key locations in the feature space. By leveraging the prediction-level OT solution in the feature-level KD, we develop a comprehensive end-to-end uncertainty-aware KD approach that leverages keypoints along with their related feature representations from the teacher model. Experiments conducted on two publicly available datasets, namely LINEMOD [ 27 ] for regular object pose estimation and SPEED+ [ 28 ] for satellite pose estimation using two different backbones [ 12 , 14 ] , demonstrate that our method outperforms existing KD approaches for efficient 6DoF pose estimation [ 23 , 17 ] . Our main contributions can be summarized as follows. • An Uncertainty-Aware prediction-level KD (UAKD) for efficient keypoint prediction in 6DoF pose estimation. • A feature-level KD approach (PFKD) that is consistent with the prediction-level KD by leveraging the prediction-level OT solution to establish correspondences between feature map regions and keypoint predictions in both the teacher and student models. • Extensive experiments on two well-known datasets with two state-of-the-art pose estimation models [ 12 , 14 ] . II Related Work In this section, we start by presenting the state-of-the-art on efficient 6DoF pose estimation, then review related works on the field of KD. Efficient 6DoF Pose Estimation. With the growing demand for real-time applications, research on pose estimation has increasingly emphasized the need for accurate yet computationally efficient solutions [ 29 , 30 , 31 , 23 , 17 ] . Efforts have been