AOE: Exhaustive Out-of-Distribution Detection via Recalibrating Outlier Labels
Fengqiang Wan, Qing-Yuan Jiang, Yang Yang · 2026
Read AOE: Exhaustive Out-of-Distribution Detection via Recalibrating Outlier Labels by Fengqiang Wan, Qing-Yuan Jiang, Yang Yang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-28021.txt.
Introduction
Wan and colleagues spot out-of-distribution inputs better by softening outlier labels with care, not all the same way. Their AOE method scales model scores with a learned temperature, keeping ties between outliers and known kinds while taming overconfident calls. On varied tests the method beat plain outlier exposure by a clear margin.
Catalog record
| CREATOR | Fengqiang Wan, Qing-Yuan Jiang, Yang Yang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 70361 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.28021
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
AOE: Exhaustive Out-of-Distribution Detection via Recalibrating Outlier Labels Fengqiang Wan, Qing-Yuan Jiang, Yang Yang Abstract Out-of-distribution (OOD) detection is essential for deploying machine learning models in open-world and safety-critical scenarios, where test inputs may deviate from the training distribution and overconfident predictions on unknown samples can lead to unreliable decisions. Outlier Exposure (OE) has emerged as a promising OOD detection paradigm by introducing auxiliary outliers during training to enlarge the margin between in-distribution (ID) and OOD samples. Existing OE-based methods typically enlarge this margin by employing uniform labels to maximize the entropy of OOD samples over ID categories. However, we theoretically show that uniform labels inevitably disregard the relations between OOD samples and ID categories, termed the over-softening effect, leading to a suboptimal margin bound. Our theoretical analysis further reveals that explicitly exploiting such relations can instead yield improved OOD detection performance. Motivated by this insight, we propose A daptive Confidence OE (AOE), a simple yet effective method that leverages temperature scaling to recalibrate outlier labels. Specifically, AOE generates adaptive soft targets from temperature-scaled model predictions for OOD samples, where the learnable temperature smooths the prediction distribution without fully erasing class-wise relational information. By supervising OOD samples with these adaptive soft targets, AOE preserves the semantic proximity between OOD samples and ID categories while encouraging the softened targets to approach a high-entropy distribution, thereby suppressing overconfident OOD predictions and enlarging the separation margin. Extensive experiments across diverse benchmarks demonstrate the effectiveness of AOE. Compared with OE, AOE consistently lowers FPR95 by 2.40% and 2.51% on CIFAR-10, 0.64% and 9.11% on CIFAR-100, and 2.02% and 2.10% on ImageNet-200 under near-OOD and far-OOD settings, respectively. keywords Out-of-distribution, outlier exposure, temperature scaling † † fcssetup: received = month dd, yyyy, accepted = month dd, yyyy, \corremail [email protected] 1 Introduction Machine learning models are typically predicated on the assumption that test distribution coincides with that of the training distribution. However, this assumption often fails in real-world settings, where models are exposed to out-of-distribution (OOD) samples and suffer significant performance degradation, particularly in safety-critical applications [ 1 , 2 , 3 ] . To address this challenge, OOD detection [ 4 , 1 , 5 , 6 , 7 ] has emerged as an effective solution. It aims to accurately recognize in-distribution (ID) samples while identifying OOD samples [ 8 , 9 ] . (a). t -SNE of baseline (left) and ours (right). (b). OOD detection performance (FPR95). Figure 1: (a) t -SNE visualization comparing the baseline (uniform labels) and our method (preserving relations) for the OOD category and ID categories. Compared with the baseline, our method exhibits a larger separation margin between ID and OOD samples. (b) The over-softening effect is consistently observed on CIFAR-10, CIFAR-100, and ImageNet, where our method leads to improved OOD detection performance. Pioneering works like MSP [ 1 ] and Energy [ 6 ] are designed to develop score functions that can effectively distinguish OOD samples from ID data. Nevertheless, the fixed parameters of these models impose a significant constraint on their adaptability and overall performance. To tackle this issue, a variety of training-time regularization methods [ 10 , 11 , 12 , 13 ] such as LogitNorm [ 12 ] have been introduced. Training-time regularization methods aim to modify learning strategies so as to enhance the discriminative capacity of learned representations for improved OOD detection. Meanwhile, with the aid of additional auxiliary data, outlier exposure (OE)-based methods [ 14 , 7 , 15 ] , e.g. OE [ 14 ] and DOE [ 7 ] , facilitates the learning of more robust and generalizable decision boundaries. Among existing OOD detection methods, OE-based methods stand out as the most effective approach and consistently achieves superior performance as it leverages surrogate OOD samples during training to help the model distinguish between ID and OOD distribution. Despite the effectiveness of OE-based methods, they inevitably disregard the relations of OOD samples with respect to different ID categories, which degrades OOD detection performance. We use a toy experiment to illustrate this issue. As shown in \cref fig:intro(a), where ID categories comprise cat , dog , and truck , while the OOD category is the school bus . To enlarge the margin between ID and OOD samples, OE-based methods assign uniform labels to OOD samples [ 14 , 16 ] , which inevitably gives rise to an over-softening effect , resulting in nearly uniform distances between the model predictions of OOD samples and those of different ID samples. In particular, OOD samples maintain a smaller distance to semantically irrelevant category (e.g., Cat ) than to the most relevant one (e.g., Truck ), as shown in \cref fig:intro(a) (left). Meanwhile, as shown in \cref thm:delta_margin_upper, disregarding such relations leads to a suboptimal separation bound, thereby degrading OOD detection performance. Intuitively, OOD samples often contain semantic information with certain ID categories [ 17 , 18 , 19 ] . A desirable model behavior is therefore to maintain relatively lower distance to the most semantically similar ID category compared with others [ 12 ] . \cref thm:T_mitigate further shows that preserving relations mitigates the over softening effect, as shown in \cref fig:intro(a) (right) and improves OOD detection, which is also observed empirically in \cref fig:intro(b). Building on this insight, we propose A daptive Confidence OE (AOE), a simple yet effective method that adaptively refines outlier labels via temperature scaling. Specifically, AOE employs a learnable temperature to smooth the model predictions for OOD samples and uses the resulting soft targets to supervise OOD training, thereby preserving the relations between OOD samples and ID categories; meanwhile, optimizing the temperature drives these smoothed targets toward a high-entropy distribution. To ensure robust convergence, AOE supports both joint optimization of model parameters and temperatures, as well as an alternating optimization strategy that decouples their respective update dynamics. Extensive experiments across diverse benchmarks demonstrate that AOE consistently outperforms existing state-of-the-art methods and can be seamlessly integrated with them. The contributions of this work are summarized as follows: • We provide a theoretical analysis showing that the commonly used uniform labeling strategy in OE induces an over-softening effect , which overlooks the intrinsic relationships between OOD samples and ID categories, leading to a suboptimal separation margin. We further demonstrate that introducing a temperature parameter T can effectively alleviate this issue. • Motivated by this analysis, we propose AOE, a simple yet effective method that recalibrates outlier labels via temperature scaling. By leveraging temperature-scaled model predictions as soft targets, AOE preserves semantic relationships with ID classes while promoting high-entropy distributions, thereby improving margin separation. • We conduct extensive experiments on multiple OOD detection benchmarks, demonstrating that AOE consistently outperforms state-of-the-art methods and achieves robust gains across diverse datasets and model architectures. 2 Related Work 2.1 OOD Detection OOD detection plays a vital role in open-world machine learning by accurately classifying ID samples while identifying OOD samples [ 1 , 6 ] . Early post-hoc OOD detection methods [ 20 , 21 ] primarily focus on designing discriminative scoring functions to separate OOD samples at inference time. In contrast, training-time regularization methods [ 12 , 22 , 23 , 24 , 25 ] aims to improve OOD detection by designing training strategies that encourage the learning