Finding Outliers in a Haystack: Anomaly Detection for Large Pointcloud Scenes

Ryan Faulkner, Luke Haub, Simon Ratcliffe, Tat-Jun Chin · 2025

Read Finding Outliers in a Haystack: Anomaly Detection for Large Pointcloud Scenes by Ryan Faulkner, Luke Haub, Simon Ratcliffe, Tat-Jun Chin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-17634.txt.

Introduction

Ryan Faulkner and co-authors tackle odd-object finding in laser scans of outdoor scenes in a 2025 paper. Laser scanners map wide areas in fine detail for robots, cars, and land checks. Objects never seen in training will show up, and a system must flag them rather than force them into known classes.

Their method rebuilds each scene and marks spots that rebuild poorly as suspect. It borrows tricks from factory defect finding and uses a fast sequence model built for long ranges of data. The method lifted scores for their own segmentation scheme and for rival ones. Their model also matched top voxel-based methods on large, hard scan sets.

Catalog record

CREATORRyan Faulkner, Luke Haub, Simon Ratcliffe, Tat-Jun Chin
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-17634

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Finding Outliers in a Haystack: Anomaly Detection for Large Pointcloud Scenes Ryan Faulkner, Luke Haub, Simon Ratcliffe, Tat-Jun Chin Abstract LiDAR scanning in outdoor scenes acquires accurate distance measurements over wide areas, producing large-scale point clouds. Application examples for this data include robotics, automotive vehicles, and land surveillance. During such applications, outlier objects from outside the training data will inevitably appear. Our research contributes a novel approach to open-set segmentation, leveraging the learnings of object defect-detection research. We also draw on the Mamba architecture’s strong performance in utilising long-range dependencies and scalability to large data. Combining both, we create a reconstruction based approach for the task of outdoor scene open-set segmentation. We show that our approach improves performance not only when applied to our our own open-set segmentation method, but also when applied to existing methods. Furthermore we contribute a Mamba based architecture which is competitive with existing voxel-convolution based methods on challenging, large-scale pointclouds. 1 Introduction Understanding large pointcloud scenes is an important goal for a variety of applications, from self-driving vehicles or drones, to general land surveillance. Accurate three-dimensional data can be obtained from Light Detection and Ranging (LiDAR) scanners, offering geometric information and precision which a two dimensional camera cannot. However between the structure of the data, and the potential scale, with millions of points and objects over a hundred meters apart, processing these LiDAR scans can be difficult. Furthermore, when the context of a practical application is as uncontrolled and diverse as an outdoor scene, there will inevitably be anomalous objects which were not in the training data. Identifying these unknown anomalies when they appear is essential to the reliable application of theoretical architectures and methods to real-world applications. Existing “Anomaly Detection” research can be grouped into two distinct categories. Either detecting defects and flaws when examining a single object at a time [ 10 , 17 ] , or identifying unknown objects which were not present in the training data, in a scene context [ 8 , 6 , 3 ] . We develop a novel approach to open-set segmentation, developed by approaching the problem of anomalous object detection from both of these perspectives. Instead of defining the problem as either "Identifying outliers within a consistent object" or "Identifying unknown objects not present in training" we combine the two, and define the problem as "Identifying unknown outliers in a scene". Our paper puts forward that by training a reconstruction step using only known classes in a scene, we have developed an architecture which achieves superior performance at detecting unknown objects (anomalies). In this paper we provide: • One mamba-based architecture for reconstructing a scene’s “default context” trained only on known objects. • A second architecture for the task of anomaly detection. Our mamba backbone contrasts to existing voxel convolution based methods. • Analysis and ablation testing provides the first exploration of how Mamba, which boasts high efficiency and ability to utilise long-range dependencies in data, applies to the field of anomaly detection for large-scale point cloud data. • We propose a novel method for creating synthetic anomalies to support training. 2 Related Work 2.1 Open-Set Segmentation for Point Cloud Scenes There are some methods which fall outside of machine learning/AI which identify anomalous objects. These include representing the data as a graph, within which “outliers” can be identified [ 7 ] . Alternatively, using predefined matrices and equations (instead of learned ones) to extract object features from the data with which to identify clear outliers (robust principle component analysis) [ 2 ] . This paper focuses on and compares against other machine-learning methods, including the expansion of the task from simply anomaly detection, to also applying semantic segmentation to the point cloud scene. This task of open-set segmentation for point clouds has been explored previously [ 3 , 6 ] , using voxel-based architectures such as Cylinder3D [ 21 ] . One of the key challenges for this area is training a network when almost by definition, the training data should not have any examples of anomalous objects. Cen et al [ 3 ] approach this by using known instance labels in the training data to create synthetic anomalies during training, and demonstrate improved results on unknown (real) anomalies during testing. As these existing methods however do not include anything like our reconstruction step, in our experiments we test our method against existing ones both with and without our reconstruction step added for a more thorough analysis. We also propose an alternative way to augment object instances which we demonstrate creates better synthetic anomalies for training. 2.2 Mamba for Point Cloud Scene Understanding Figure 1 : A visual diagram of the Selective State Space Model which forms the core of a Mamba block, from the Mamba paper [ 9 ] . Originating as a method for sequencing of dna, time, or large language models, Mamba [ 9 , 5 ] builds on the combined bases of Recurrent Neural Networks and State Space Models. It is able to store a “hidden state” of information (referred to as h in 1 ) while sequentially processing the data. The details of how much the hidden should both be updated, and be utilised, during the processing of each datapoint x_{t} , determined by applying learned weights to x_{t} , shown as blue lines in 1 . This process allows a network to selectively store only only useful information long-term while processing a sequence, while still being computationally efficient (with all computationally expensive steps capable of being performed in parallel on a GPU). Together this gives Mamba a powerful ability to model long-range dependencies, as well as efficient scalability to large datasets. For applications where data can be very large in scale such as outdoor-scene pointclouds, this makes it a very suitable architecture to use as a backbone. Most computer-vision applications such as Vision Mamba [ 20 ] first flatten the data into a sequence, then apply each block in both directions (forwards and backwards) to allow the network to learn and apply long-range dependencies in both directions. Applied to vision tasks ranging from those with causal data like video sequences [ 11 , 18 ] to less causal ones like denoising or densification of static point clouds [ 19 , 4 ] , the architecture’s effectiveness as a backbone, especially on large datasets such as LiDAR point clouds, has already been firmly established outside the context of anomaly detection. Closed-set segmentation has also already shown success, either supplementing Mamba with “K Nearest Neighbour” [ 14 , 12 ] or Octree convolutions [ 13 ] to extract close-range dependencies. In the context of single-object, RGB image defect-detection, Mamba has been used previously [ 10 , 17 ] . Two notable contrasts from this in our method are that we do not rely on pre-trained RGB networks such as ResNet (making our method more applicable to non-standard data types). We also investigate the challenging open-set, large-scale scene segmentation task instead of single-object defect detection. 2.3 Reconstruction for Anomaly Detection Reconstruction as a preprocessing step is common for defect detection [ 10 ] where a robust, pretrained, ResNet or similar can be used. Outside of this scope however, the use of reconstruction

Read the complete text