Exploiting Inter-Sample Information for Long-tailed Out-of-Distribution Detection
Nimeshika Udayangani, Hadi M. Dolatabadi, Sarah Erfani, Christopher Leckie · 2025
Read Exploiting Inter-Sample Information for Long-tailed Out-of-Distribution Detection by Nimeshika Udayangani, Hadi M. Dolatabadi, Sarah Erfani, Christopher Leckie (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-16015.txt.
Introduction
Nimeshika Udayangani, Hadi M. Dolatabadi, Sarah Erfani, and Christopher Leckie improve detection of out-of-distribution inputs when training classes are long-tailed. A classifier must flag inputs unlike anything it trained on, for safe deployment, but rare tail classes are often misread and false alarms climb. Their idea is to exploit relationships between samples rather than treating each input alone.
Features from a pretrained model seed a graph over samples, after correcting differences between pretraining and training activations by Gaussianization, reshaping activations toward a standard normal form. Graph convolutional networks then refine that graph into a feature space suited to long-tailed detection. On three long-tailed benchmarks, the method outperformed leading approaches by a large margin and lifted tail-class accuracy.
Catalog record
| CREATOR | Nimeshika Udayangani, Hadi M. Dolatabadi, Sarah Erfani, Christopher Leckie |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 61 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-16015
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Exploiting Inter-Sample Information for Long-tailed Out-of-Distribution Detection Nimeshika Udayangani, Hadi M. Dolatabadi, Sarah Erfani, Christopher Leckie Abstract Detecting out-of-distribution (OOD) data is essential for safe deployment of deep neural networks (DNNs). This problem becomes particularly challenging in the presence of long-tailed in-distribution (ID) datasets, often leading to high false positive rates (FPR) and low tail-class ID classification accuracy. In this paper, we demonstrate that exploiting inter-sample relationships using a graph-based representation can significantly improve OOD detection in long-tailed recognition of vision datasets. To this end, we use the feature space of a pre-trained model to initialize our graph structure. We account for the differences between the activation layer distribution of the pre-training vs. training data, and actively introduce Gaussianization to alleviate any deviations from a standard normal distribution in the activation layers of the pre-trained model. We then refine this initial graph representation using graph convolutional networks (GCNs) to arrive at a feature space suitable for long-tailed OOD detection. This leads us to address the inferior performance observed in ID tail-classes within existing OOD detection methods. Experiments over three benchmarks CIFAR10-LT, CIFAR100-LT, and ImageNet-LT demonstrate that our method outperforms the state-of-the-art approaches by a large margin in terms of FPR and tail-class ID classification accuracy. 1 Introduction (a) Scratch trained OE. (b) Pre-trained. (c) Pre-trained after Gaussianization. (d) After GCN. Figure 1 : Feature space representations of CIFAR10-LT as ID test set and CIFAR-100 as OOD test set using t-SNE. (a) Feature distribution of ResNet18 trained from scratch using OE [ 15 ] , (b) ResNet18 pre-trained on Downsampled ImageNet, (c) same model in (b) after applying Gaussianization, and (d) model in (c) after message passing using GCN. Tail ID classes ( e.g . , Horse, Ship, Truck) heavily overlap with OOD samples (represented as red dots) in (a). Separability enhanced from left to right, wherein (d) there are clear gaps between the decision boundaries. Deep neural networks (DNNs) exhibit remarkable performance provided that the data encountered during testing closely aligns with the data used for training. However, when DNN models encounter samples that are different from their training distribution (a.k.a., out-of-distribution (OOD) samples), they often assign overly confident predictions even when a distribution mismatch exists [ 31 ] . As a consequence, ensuring safe deployment of these models in critical domains, such as healthcare [ 45 ] and autonomous driving [ 9 ] , necessitates methods that can reliably detect OOD samples. There have been numerous methods proposed to detect OOD samples showing promising results [ 12 , 15 , 24 , 25 , 7 , 36 ] . However, most of these methods are commonly assessed using balanced class in-distributions (IDs), which does not reflect real-world scenarios where the training data often exhibits a long-tailed (LT) distribution. In a long-tailed distribution, a few dominant classes have a large number of samples (head-classes), while the remaining classes (tail-classes) have relatively fewer samples. As a result, models find it difficult to distinguish tail-class ID samples from OOD samples when compared to head-class ID samples. This leads to a high false positive rate (FPR) for OOD detection and low tail-class ID classification accuracy in current methods, thereby making OOD detection extremely challenging [ 39 ] . It was not until very recently that Wang et al . [ 39 ] formally introduced the problem of OOD detection in long-tailed recognition (LTR) for the first time. Following this trend, a few other methods [ 3 , 42 , 27 ] evaluated their models on long-tailed training sets. However, a common approach with these OOD detection methods — as well as previous methods using balanced IDs — is that they treat each sample individually during training, overlooking the interconnected relationships within the data. We instead propose to exploit the inter-sample relationships within both ID and OOD data to address the more challenging problem of OOD detection in long-tailed settings. With the help of this additional relationship information, we aim to enhance the distinguishability of tail samples. To this end, we transform image datasets into graph-based representations, allowing us to utilize the full structure underlying the data. In particular, we first use the feature space of a pre-trained model to initialize a graph structure using k nearest neighbor ( k -NN) graphs. Even though there have been traces of pre-training being utilized to improve OOD detection [ 13 , 7 , 14 ] , none of these studies specifically explore the presence of long-tailed IDs. DNNs are unable to learn discriminative representations of tail-classes due to the scarcity of their training samples. Pre-training can alleviate this problem by exploiting prior knowledge from additional datasets, which can help to characterize the tail-classes. Due to the large-scale nature of these datasets, they often contain a variety of different samples, thus helping to achieve a more balanced performance when transferred to the long-tailed data. These ensure meaningful initial feature embeddings for our intended downstream task. As shown for the CIFAR10-LT dataset in Fig. 1 , feature space representations from a pre-trained model ( Fig. 1(b) ) facilitate a better separability among OOD and ID samples compared to a model trained from scratch ( Fig. 1(a) ) using Outlier Exposure (OE) [ 15 ] . To further improve the quality of our initial representations, we account for the distributional differences between the activation layer of the pre-training vs. training data. A recent study [ 19 ] highlights the significance of ensuring that the activation layer representations of data adhere to a standard normal distribution. To address this issue, we actively introduce Gaussianization to alleviate any deviations from a standard normal distribution in the activation layers of the pre-trained model during feature extraction ( Fig. 1(c) ). In this step, we update the batch norm [ 17 ] statistics of the pre-trained model to align it with our long-tailed distribution. Finally, we refine this initial graph representation using message passing in the form of graph convolutional networks (GCNs) to arrive at a feature space suitable for long-tailed OOD detection ( Fig. 1(d) ). To the best of our knowledge, we are the first to exploit inter-sample information to address the problem of long-tailed OOD detection in the vision domain. In summary, our contributions are as follows: • We improve the tail-class representations utilizing inter-sample relationships by proposing a graph-based solution for OOD detection in long-tailed recognition. • We demonstrate that applying Gaussianization to the activation layers of the pre-trained model, using an auxiliary dataset to represent OOD data, can further improve the overall performance • Our method outperforms the SOTA by a large margin; (12.55%, 8.51%) FPR and (10.64%, 12.95%) tail-class ID classification accuracy on CIFAR10-LT and CIFAR100-LT, respectively. We also demonstrate our method can improve the performance on large-scale OOD detection tasks using ImageNet-LT. 2 Related work This section provides a brief overview of SOTA methods alongside baseline approaches, laying the groundwork for our research around OOD detection in LTR. We also delve into the significance of pre-training for OOD detection and explore the application of graph-based techniques for handling arbitrary data within our study. 2.1 OOD detection Hendrycks and Gimpel [ 12 ] first suggested a baseline approach for identifying OOD samples using the maximum softmax probability