ArrowPose: Segmentation, Detection, and 5 DoF Pose Estimation Network for Colorless Point Clouds
1 st Frederik Hagelskjær · 2025
Read ArrowPose: Segmentation, Detection, and 5 DoF Pose Estimation Network for Colorless Point Clouds by 1 st Frederik Hagelskjær (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-08699.txt.
Introduction
Factory robots that pick parts from bins need to know each part's position and tilt, fast. Frederik Hagelskjaer presents a network for that job in this 2025 paper. The input is a point cloud, a swarm of measured points in space, with no color at all. Color-free sensing is cheaper and works in poor light, but it gives the network less to go on.
The network first labels which points belong to which object, then finds each object. Pose comes from two predicted points: the object's center and its top. Training used only synthetic data, yet the network topped a standard benchmark and beat all rival color-free methods. It runs a full pass in a quarter of a second. That speed opens uses in live sorting and assembly lines.
Catalog record
| CREATOR | 1 st Frederik Hagelskjær |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-08699
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ArrowPose: Segmentation, Detection, and 5 DoF Pose Estimation Network for Colorless Point Clouds Thanks: This project was funded in part by Innovation Fund Denmark through the projects MADE ReAct and FERA, and in part by the SDU I4.0-Lab. 1 st Frederik Hagelskjær Abstract This paper presents a fast detection and 5 DoF (Degrees of Freedom) pose estimation network for colorless point clouds. The pose estimation is calculated from center and top points of the object, predicted by the neural network. The network is trained on synthetic data, and tested on a benchmark dataset, where it demonstrates state-of-the-art performance and outperforms all colorless methods. The network is able to run inference in only 250 milliseconds making it usable in many scenarios. Project page with code at arrowpose.github.io I Introduction Pose estimation enables much greater flexibility in robotics. Objects can be placed freely in the environment and poses updated online. This is in contrast to using fixtures with manually inserted objects. Pose estimation allows the use of robots in situations where pre-configuration is either too expensive or impossible, enabling automation in a much larger realm of tasks. While historically a complicated task, pose estimation has been aided greatly by the introduction of deep learning [ 1 , 2 , 3 ] . Object detectors are an integral part of modern pose estimation pipelines, as most pose estimation algorithms only work with cropped images of the relevant object [ 3 ] . However, object detectors for pose estimation generally use RGB information to process the scene [ 3 ] . In current benchmarks of pose estimation algorithms [ 1 , 2 , 3 ] there are currently no depth-only object detectors. As a result, all depth-only methods are variants of the classic method Point-Pair-Feature (PPF) [ 4 ] . Other depth-only pose estimation methods rely on RGB detectors in the pipeline [ 5 , 6 ] . However, for some use cases, color information is not available, either because of the sensors or the environment. Objects detectors for pose estimation using only depth is thus an important topic. While, detection algorithms for colorless point clouds have been explored extensively for processing scenes for autonomous cars and robots [ 7 , 8 , 9 ] . These methods generally use lidar data and are not optimized for object detection for pose estimation. In this paper, we present a simple instance detector using only colorless point clouds as input. The network computes semantic segmentations and predicts the object centers. Instance segmentations are then computed by clustering the center predictions. The method is extended to 5 DoF pose estimation by also predicting the orientation vector of the symmetry axis. This pose estimation method only works for objects with cylindrical symmetry. However, many industrial objects fit this description; idlers, bearings, screws, etc. [ 10 ] , and such a method is thus relevant. Our method could be extended for 6 DoF pose estimation by predicting a orthogonal vector to the orientation vector. However, for many objects, this orientation cannot be estimated from the sensor data. Instead, attempting to estimate this aleatoric uncertainty, it has been removed from the model. The benefit of the 5 DoF pose estimation is demonstrated by the large increase in performance for the rotational symmetric object from the IC-BIN [ 11 ] benchmark dataset. Our method also demonstrates state-of-the-art performance for the full dataset. (a) Point cloud. (b) Center and top predictions. (c) Center and orientation vector. (d) Pose Estimation. Fig. 1: The inference pipeline of our developed method. (a) Objects in the bin. (b) The neural network predicts the center and top points belonging to the object, shown in green and red. (c) By clustering the predictions the objects 5 DoF poses are found as a center and an orientation vector. (d) Visualization of the pose estimate using the object model. Colors only for visualization. A method similar to our work is presented in [ 12 ] . The input point cloud is processed by the PointPillars network [ 7 ] , a network for processing large point clouds from lidar data. However the detections are not used for pose estimation, and instead the detections are used to compute grasp poses. A method also performing object detection and pose estimation in point clouds is presented in [ 13 ] . The input to the network is a 16,384 point large point cloud which is preprocessed by a PointNet++ [ 14 ] backbone. Our work, on the other hand, processes a larger point cloud of 65,536 points, and uses a different backbone. While both methods computes the semantic segmentations, the instance segmentation are computed differently. In our work, the instance segmentation is performed by clustering object centers, compared with a calculated feature distance in the paper. The paper calculates the object poses by two MLPs (Multi Layer Perceptron) that predicts the translation and rotation, whereas our method computes the center and orientation vector. The method is compared with the PPF [ 4 ] method on a synthetic dataset introduced in the paper. The method shows an average performance better than PPF [ 4 ] , but scores lower for three of the four objects. In comparison our method is tested on a benchmark dataset with real data. The main contributions presented in this paper are: • A novel network for processing large point clouds with pre-processing on the CPU. • A robust method for computing 5 DoF pose estimation from center and top points. • State-of-the-art results on the IC-BIN [ 11 ] benchmark dataset using depth only methods. II Method This section provides a full description of our method. It starts with a description of the inference pipeline and then elaborates the training process. II-A Inference pipeline Fig. 2: Network Architecture: The network input is a point cloud and pre-computed neighbor indices. For each layer neighbor differences are computed and processed, while the point cloud is downscaled. Finally, the features for the last two layers are concatenated, \oplus , and processed by an MLP. Using this, the segmentation prediction is computed for each n class. The MLP output is concatenated with the earlier concatenated features and two MLPs predict the center- and top-offsets. II-A 1 Network structure The focus of the developed network is a small network for fast processing of large point clouds. The network is based on the structure of DGCNN [ 15 ] , but uses the spatial pyramid of PointNet++ [ 14 ] . Similar to DGCNN [ 15 ] we use the EdgeConv, which computes the feature difference with neighboring points. These differences are then concatenated with the points own feature and processed by a convolutional network, and finally by using a local max poll the information is reduced to a one dimensional feature. In the first layer of DGCNN the neighbors are found in the spatial domain, but in subsequent layers the neighbors are found in the feature domain to increase the receptive field information for each point. However, for very large point clouds this computation is unfeasible as it is performed with an adjacency matrix, which is n\times n , where n is the number of points in the point cloud [ 16 ] .