EZ-SP: Fast and Lightweight Superpoint-Based 3D Segmentation
Louis Geist, Loic Landrieu, Damien Robert · 2025
Read EZ-SP: Fast and Lightweight Superpoint-Based 3D Segmentation by Louis Geist, Loic Landrieu, Damien Robert (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-00385.txt.
Introduction
Splitting a three-dimensional point cloud into superpoints makes semantic segmentation far cheaper. Louis Geist, Loic Landrieu, and Damien Robert present EZ-SP in 2025, a fast and lightweight superpoint-based segmentation method. Earlier pipelines were bottlenecked by a slow partition step running on the CPU.
The authors propose a learnable, fully GPU partitioning algorithm that produces geometrically and semantically coherent superpoints much faster than prior methods. Speed matters because point clouds from lidar and scanning keep growing. Faster partitioning brings detailed three-dimensional understanding closer to real-time uses like robotics and mapping. A speedup of more than tenfold turns an overnight preprocessing step into an interactive one. Superpoints group nearby points that likely share a label.
Catalog record
| CREATOR | Louis Geist, Loic Landrieu, Damien Robert |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-00385
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
EZ-SP: Fast and Lightweight Superpoint-Based 3D Segmentation Louis Geist, Loic Landrieu, Damien Robert Abstract Superpoint-based pipelines provide an efficient alternative to point- or voxel-based 3D semantic segmentation, but are often bottlenecked by their CPU-bound partition step. We propose a learnable, fully GPU partitioning algorithm that generates geometrically and semantically coherent superpoints 13 × \times faster than prior methods. Our module is compact (under 60k parameters), trains in under 20 minutes with a differentiable surrogate loss, and requires no handcrafted features. Combined with a lightweight superpoint classifier, the full pipeline fits in < 2 <\!2 MB of VRAM, scales to multi-million-point scenes, and supports real-time inference. With 72 × \times faster inference and 120 × \times fewer parameters, EZ-SP matches the accuracy of point-based SOTA models across three domains: indoor scans (S3DIS), autonomous driving (KITTI-360), and aerial LiDAR (DALES). Code and pretrained models are accessible at github.com/drprojects/superpoint_transformer . I Introduction Accurate 3D semantic segmentation is critical for robotic perception, enabling tasks such as autonomous driving [ 1 ] , navigation [ 2 , 3 ] , and mapping [ 4 ] . However, balancing accuracy with computational efficiency remains a major challenge. Real-world point clouds often contain millions of points and must be processed under strict latency constraints—for instance, rotating automotive LiDAR typically acquires 1.3M points per second. Yet, state-of-the-art (SOTA) models routinely exceed ten million parameters, rely on costly test-time augmentation to reach their performance, and can only process small scenes at a time. This gap limits deployment in real-time robotic systems, as well as in AR/VR [ 5 ] and large-scale smart city applications [ 6 ] . A common strategy to reduce complexity is to group points into superpoints [ 7 , 8 ] : spatially contiguous, geometrically homogeneous regions. Reasoning on superpoints rather than individual points dramatically reduces memory and computation, while maintaining SOTA or near-SOTA accuracy [ 9 , 10 ] . However, the partition stage remains a critical bottleneck: often CPU-bound, slow to tune (each parameter sweep may take hours), and requires complex optimization over handcrafted geometric and radiometric features. This overhead in runtime and engineering effort has hampered the broader adoption of superpoint-based methods. 10^{3} 10^{4} 10^{5} 10^{6} 60 70 75 EZ-SP (ours) SPT SPG PTv3 KPConv MinkowskiNet PointNeXt S B XL Stratified Trans. SPNet 5 \times 10^{7} 5 \times 10^{6} 5 \times 10^{5} model size # param. 72 \times 5.3 \times Throughput in pts/s mIoU 6-Fold Fig. 1 : Inference Speed v.s. Performance v.s. Model Size. Comparison of end-to-end pipelines (preprocessing to inference) on S3DIS. EZ-SP achieves near-SOTA accuracy with only 400 k parameters, while being orders of magnitude faster than point-based networks, and the only method to match the acquisition rate of automotive LiDAR ( ). To overcome these limitations, we introduce EZ-SP (easy-superpoints): a lightweight, learnable, fully GPU pipeline to partition and segment raw point clouds into superpoints on the fly . A 60 k-parameter backbone produces low-dimensional embeddings optimized to detect semantic transitions directly from raw point clouds and without handcrafted features. We then use a massively parallel clustering algorithm to produce semantically homogeneous, geometrically simple superpoints—124 \times faster than the widely used Parallel Cut Pursuit [ 11 , 12 ] . These superpoints are then processed by a 330 k-parameter superpoint segmentation network, yielding dense labels at a fraction of the cost of point- or voxel-based approaches. As shown in fig. 1 , our method matches or surpasses SOTA accuracy while delivering over 72 \times faster end-to-end inference than PointTransformer-v3 [ 13 ] . Key advantages and contributions. Our approach is: • Fast : partitioning a raw point cloud is over 13 \times faster than the fastest graph-based approaches; end-to-end inference is over 72 \times faster than recent SOTA models. • Lightweight : the entire model fits in <\!2 MB VRAM and trains from scratch in 3 h on a single A6000. • Versatile : The same configuration generalizes across indoor (S3DIS), mobile (KITTI-360), and aerial mapping (DALES) with minimal hyperparameter tuning. Our model runs in real time on small scans ( > 1.3M pt / s) and scales to city-scale point clouds in a single pass. • Scalable : GPU-only segmentation of tens of millions of points in a single pass on a single consumer-grade GPU. II Related Work This section presents an overview of the field of 3D deep learning with a focus on superpoint-based approaches. point 3D position point adjacency Point encoder 60 k param. Contrastive loss low-dim point embedding predicted inter-edge Clustering superpoint Superpoint classifier 330 k param. Semantic loss prediction: chair table Fig. 2 : EZ-SP . A 60 k-parameter backbone embeds every point of the input scene into a low-dimensional space where adjacent points from different semantic classes (inter-edges) are pushed apart. A GPU-accelerated algorithm then clusters neighbouring points with similar embeddings, producing semantically homogeneous superpoints. Finally, a lightweight ( 330 k-parameter) superpoint-level network assigns a label to each superpoint, which is broadcast back to its points for dense segmentation. 3D Semantic Segmentation. Deep networks operating directly on raw points or voxels [ 14 , 15 , 16 ] and, more recently, transformers [ 17 , 13 ] achieve state-of-the-art accuracy but at high computational cost. Models often contain tens of millions of parameters, and both training and inference are resource-intensive, limiting their applicability to real-world large-scale point clouds. Superpoint-Based Semantic Segmentation. Partitioning a scene into superpoints —spatially contiguous, geometrically homogeneous point clusters—drastically reduces computational load by shifting semantic reasoning from points to regions. The Superpoint Graph (SPG) [ 7 ] pioneered this approach, achieving competitive results with far fewer resources. The Superpoint Transformer (SPT) [ 10 ] advanced the idea with hierarchical partitions and sparse self-attention, reaching SOTA accuracy with only \sim 200k parameters. Extensions include instance [ 18 , 19 ] , panoptic [ 20 ] , weakly supervised [ 21 ] , and self-supervised [ 22 , 23 , 24 ] segmentation. However, all rely on CPU-based, handcrafted partitions, which limit scalability and accuracy. Classical Superpoint Partitioning. Early 3D over-segmentation methods often used supervoxels, e.g. , VCCS [ 8 ] via voxel-based k -means. Such methods require predefining the number of clusters and are sensitive to initialization, preventing flexibility to scene size and local complexity. Saliency-guided [ 25 ] and density-adaptive [ 26 ] variants improved boundaries, while graph-based optimization [ 27 , 28 , 18 , 29 , 30 ] further improved adaptability. Nevertheless, these methods remain CPU-bound and largely depend on handcrafted features and hyperparameters. Sparsification methods [ 31 , 32 , 33 ] lower the number of points but do not produce valid partitions for segmentation. Image-based methods [ 34 ] typically project SLIC [ 35 ] or SAM [ 36 ] superpixel partitions onto 3D points, but require co-registered 2D images, and rely on 2D textures rather than 3D geometry. Learning Superpoint Partitions. Learning partitions is challenging due to the non-differentiability of standard clustering. GPU-friendly k -means [ 37 , 9 , 22 , 38 ] and region-offset [ 39 ] approaches enable differentiability but inherit k -means’ limitations and often require heavy encoders. GraphCut [ 40 ] introduces a graph-based heuristic on learned embeddings for instance segmentation, while SAM-Graph [ 41 ] transfers priors from