Random Similarity Isolation Forests
Sebastian Chwilczyński, Dariusz Brzezinski · 2025
Read Random Similarity Isolation Forests by Sebastian Chwilczyński, Dariusz Brzezinski (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-19122.txt.
Introduction
Sebastian Chwilczynski and Dariusz Brzezinski build an outlier hunter for mixed data in a 2025 paper. Firms now gather not just numbers but series, images, and graphs, and most hunters handle one kind at a time.
Forcing all kinds into one shape, or fusing many single kind hunters, can dull the hunt. Their method blends isolation, the trick of spotting what splits off fast, with likeness based projection that accepts any kind. On forty seven test sets it beat five lead rivals. The study argues mixed data, used whole, sharpens the hunt for the odd one out.
Catalog record
| CREATOR | Sebastian Chwilczyński, Dariusz Brzezinski |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-19122
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Random Similarity Isolation Forests Sebastian Chwilczyński, Dariusz Brzezinski Abstract With predictive models becoming prevalent, companies are expanding the types of data they gather. As a result, the collected datasets consist not only of simple numerical features but also more complex objects such as time series, images, or graphs. Such multi-modal data have the potential to improve performance in predictive tasks like outlier detection, where the goal is to identify objects deviating from the main data distribution. However, current outlier detection algorithms are dedicated to individual types of data. Consequently, working with mixed types of data requires either fusing multiple data-specific models or transforming all of the representations into a single format, both of which can hinder predictive performance. In this paper, we propose a multi-modal outlier detection algorithm called Random Similarity Isolation Forest. Our method combines the notions of isolation and similarity-based projection to handle datasets with mixtures of features of arbitrary data types. Experiments performed on 47 benchmark datasets demonstrate that Random Similarity Isolation Forest outperforms five state-of-the-art competitors. Our study shows that the use of multiple modalities can indeed improve the detection of anomalies and highlights the need for new outlier detection benchmarks tailored for multi-modal algorithms. 1 Introduction Outlier detection, sometimes also referred to as anomaly detection, aims to identify unusual instances that deviate from the core data distribution [ 1 ] . Practical applications of outlier detection include preventing cyber attacks [ 19 ] , detecting fraud [ 6 ] , and predictive maintenance [ 7 ] . Over the years, specialized detection methods have been created for scalar [ 1 ] , time series [ 11 ] , and graph data [ 15 ] . However, the existing methods are usually tailored to specific types of data, whereas there is an increasing number of applications where the available data come in multiple modalities. Consider, for example, industrial equipment that has access to information from physical sensors, camera images, GPS, and communication with neighboring devices. Currently, to detect anomalies in the functioning of such equipment, one has three basic options. The first option is to focus on a single modality, risking the omission of some anomalies due to the lack of context information. The second option is to fuse the responses of multiple modality-specific detectors, which has the downside of missing anomalies that are a result of a combination of relatively normal individual sensor readings. Finally, the third option is to transform all the different modalities into a single (usually numeric) data representation. This last option is often non-trivial and has the drawback of creating very high-dimensional representations, which can hurt detection performance. In this paper, we propose Random Similarity Isolation Forest (RSIF), an algorithm capable of detecting outliers in mixed-type datasets without having to omit any features, fuse multiple detectors, or transform the original data. Our method is a generalization of Isolation Forests [ 14 ] that uses similarity projections [ 17 ] to achieve data type flexibility. We summarize our contributions as follows: New outlier detection method for multi-modal data To our knowledge, RSIF is the first outlier detection method capable of handling mixed-type data inherently without converting it to a different representation. Flexibility in tackling various problems We show that our method works well regardless of whether the tackled problem comprises simple numerical data, complex objects, or mixed-type multi-modal descriptions. We validate our method on 47 datasets against five competitor models. Evaluation of multiple similarity metrics For different data modalities, we test a variety of similarity functions. Our study highlights the importance of selecting appropriate data projections for unsupervised anomaly detectors. 2 Related work Today, there is a plethora of outlier detection algorithms available in the literature [ 1 ] . Among classic unsupervised outlier detection methods are proximity-based algorithms [ 5 ] , which are based on local neighborhood information around each data point. The most popular algorithm from this group, called Local Outlier Factor (LOF) [ 5 ] , calculates the distances to nearest neighbors to estimate local densities and deems data points with a substantially lower local density as outliers. Another popular group of algorithms consists of statistical models [ 8 , 13 ] that first determine the probability distribution of the data and then detect outliers as points outside of the fitted distribution. Popular methods from this group include Histogram-Based Outlier Score (HBOS) [ 8 ] , which uses multiple univariate feature histograms to score outlying objects, and the recently proposed Empirical Cumulative Distribution-based Outlier Detection algorithm (ECOD) [ 13 ] , which derives a cumulative distribution function to locate rare events in the tails of a distribution. Finally, Isolation Forest [ 14 ] is an example of an ensemble outlier detection method [ 12 ] that detects anomalies by measuring the number of tree splits required to isolate a data point from others. However, these popular outlier detection algorithms are tailored for scalar data and cannot handle mixed-type datasets out of the box. Datasets consisting of data points from different domains are sometimes referred to as multi-modal . This term is used, for example, in biology when referring to multiomics patient data, in robotics when referring to data coming from different sensors, and recently in text-image-audio applications of large language models (LLMs). There have been proposals of outlier detection methods for multi-modal data, however, they either assume that the different domains all have the same representation [ 21 ] or fuse multiple data-specific models into one predictor [ 10 ] . The proposed RSIF algorithm constructs a single model capable of handling datasets with mixtures of features of arbitrary data types. The method presented in this paper builds upon recent advancements in classification algorithms for complex data. Sathe and Aggarwal [ 18 ] have proposed a method that is capable of handling complex objects in situations where regular features are absent, but similarities between examples are attainable. The algorithm, called Similarity Forest, uses a distance-based projection to order objects and create decision tree splits. More recently, Piernik et al. have proposed the Random Similarity Forest algorithm [ 17 ] , a combination of Similarity Forest and Random Forest [ 4 ] capable of handling scalar, complex, and mixed datasets. However, the aforementioned algorithms are supervised learners and require labeled data to perform similarity-based projections. In this paper, we combine ideas from projection-based algorithms with the notion of isolation known from Isolation Forests [ 14 ] . Our approach proposes a new way of selecting reference objects for projections to create an unsupervised outlier detection algorithm suitable for multi-modal problems. 3 Random Similarity Isolation Forest In the following sections, we introduce the used notation, explain the proposed Random Similarity Isolation Forest (RSIF) algorithm, and discuss how reference objects affect similarity projections. A schematic overview of the Random Similarity Isolation Forest algorithm is presented in Figure 1 . Figure 1: Example of training a Random Similarity Isolation Forest. ( A ) The input dataset with six features ( F_{1} – F_{6} ) of different types (categorical, numeric, histogram, set, sequence, graph). The dark background rows symbolize the subsample going into an example tree. ( B ) Using reference pairs, distance-based projections are used to map data points. In the projection