LoD: Loss-difference OOD Detection by Intentionally Label-Noisifying Unlabeled Wild Data
Chuanxing Geng, Qifei Li, Xinrui Wang, Dong Liang, Songcan Chen, Pong C. Yuen · 2025
Read LoD: Loss-difference OOD Detection by Intentionally Label-Noisifying Unlabeled Wild Data by Chuanxing Geng, Qifei Li, Xinrui Wang, Dong Liang, Songcan Chen, Pong C. Yuen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-12952.txt.
Introduction
Chuanxing Geng and co-authors proposed LoD in 2025, a way to spot out-of-distribution data using unlabeled data gathered in the wild. Such wild data mixes normal and foreign samples, and using it safely is a growing concern. Past methods tend to let normal labeled data dominate training, so foreign samples get absorbed as if normal.
Their trick is to add deliberately wrong labels to the wild data. That makes the foreign samples pull learning in their own direction and separates their loss values from normal ones. A classic clustering step can then split the two groups without a hand-set threshold. The authors prove the idea is sound and show it beats rivals in wide experiments.
Catalog record
| CREATOR | Chuanxing Geng, Qifei Li, Xinrui Wang, Dong Liang, Songcan Chen, Pong C. Yuen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-12952
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
LoD: Loss-difference OOD Detection by Intentionally Label-Noisifying Unlabeled Wild Data Chuanxing Geng, Qifei Li, Xinrui Wang, Dong Liang, Songcan Chen, Pong C. Yuen Abstract Using unlabeled wild data containing both in-distribution (ID) and out-of-distribution (OOD) data to improve the safety and reliability of models has recently received increasing attention. Existing methods either design customized losses for labeled ID and unlabeled wild data then perform joint optimization, or first filter out OOD data from the latter then learn an OOD detector. While achieving varying degrees of success, two potential issues remain: (i) Labeled ID data typically dominates the learning of models, inevitably making models tend to fit OOD data as IDs; (ii) The selection of thresholds for identifying OOD data in unlabeled wild data usually faces dilemma due to the unavailability of pure OOD samples. To address these issues, we propose a novel loss-difference OOD detection framework (LoD) by intentionally label-noisifying unlabeled wild data. Such operations not only enable labeled ID data and OOD data in unlabeled wild data to jointly dominate the models’ learning but also ensure the distinguishability of the losses between ID and OOD samples in unlabeled wild data, allowing the classic clustering technique (e.g., K-means) to filter these OOD samples without requiring thresholds any longer. We also provide theoretical foundation for LoD’s viability, and extensive experiments verify its superiority. 1 Introduction The safety and reliability of traditional machine learning models often face challenges when deployed in real-world environments due to unexpected occurrence of out-of-distribution (OOD) data Nguyen et al. 2015 . To meet this challenge, the OOD detection problem has been studied Hendrycks and Gimpel 2016 ; Yang et al. 2024 , which requires the models not only predict the true class of in-distribution (ID) data but also effectively reject the OOD data. To date, numerous OOD detection methods have been developed Liu et al. 2020b ; Abati et al. 2019 ; Wang et al. 2022 ; Hendrycks et al. 2018 ; Katz-Samuels et al. 2022 , and among them, the methods leveraging unlabeled wild data containing ID and OOD samples to improve the performance of OOD detection has recently received increasing attention Katz-Samuels et al. 2022 . This mainly attributed to the fact that such data can be freely collected during the deployment of any machine learning model in its operational environment, while also allowing for the capture of the true test-time OOD distribution. Despite the promise, harnessing the power of unlabeled wild data is non-trivial due to the heterogeneous mixture of ID and OOD samples. Existing methods either adopt a joint optimization strategy Katz-Samuels et al. 2022 or a two-step strategy (i.e., filtering and learning) Du et al. 2024 . The former aims to design customized losses for labeled ID and unlabeled wild data to jointly optimize the models in a semi-supervised learning manner. The latter first filters out OOD samples from the unlabeled wild data using customized OOD score (usually based on labeled ID data), then uses them along with labeled ID data to learn an OOD detector. While achieving varying degrees of success, two potential issues of these methods remain: ✓ The model-bias issue. Labeled ID data typically dominates the model learning in both two strategies, especially for the two-step strategy, thus inevitably making the model tend to fit OOD data as IDs. ✓ Threshold selection dilemma. The selection of thresholds for determining OOD samples in unlabeled wild data usually faces challenges due to the unavailability of pure OOD samples. To address these issues, this work proposes a novel loss-difference OOD detection framework (abbreviated as LoD) by intentionally label-noisifying unlabeled wild data. LoD adopts the filtering and learning strategy and its key lies in the loss-difference filtering module with intentional label-noises . In this module, the whole unlabeled wild data is intentionally labeled as a single K+1 -th class (assuming that ID data contain K classes), and then trained together with the labeled ID data through the fully-supervised manner of K+1 classification. We would like to emphasize that such operations ingeniously transform the OOD filtering problem in unlabeled wild data into a label-noise learning problem, allowing us to solve the aforementioned issues by leveraging the inherent properties in label-noise learning. In this way, the OOD samples in unlabeled wild data is intentionally transformed into label-clean samples, while the ID counterparts become label-noise ones. The former naturally and seamlessly enables OOD samples in unlabeled wild data to jointly dominate the model learning with the labeled ID data, effectively addressing the model-bias issue. Meanwhile, the latter provides the key clues for differentiating ID and OOD samples in unlabeled wild data due to the significant differences in the loss curves between ID ( label-noise ) and OOD ( label-clean ) samples during training. Figure 1: The cross-entropy loss changes of ID ( label-noise ) and OOD ( label-clean ) samples in unlabeled wild data when they are intentionally labeled as K+1 -th class. These two types of samples typically exhibit different loss curves due to the differences in how learning progresses for each. As shown in Figure 1 , as the OOD samples in the unlabeled wild data are correctly labeled ( label-clean ), the model fits them well as learning progresses, leading to a gradual decrease and convergence of the loss curve. In contrast, the corresponding ID part, due to being incorrectly labeled ( label-noise ) and conflicting with the originally labeled ID data, exhibits not only higher loss values but also larger fluctuations during training. Such significant and natural differences allow us to employ classic clustering models, like K-means, to filter these OOD samples without requiring thresholds any longer. In particular, we also provide theoretical foundation to support the viability of such a module. Overall, our contributions can be highlighted as follows: • Two potential issues (i.e., the model-bias issue and threshold selection dilemma) in this OOD research line are identified, providing some new insights for the subsequent modeling of OOD detection. • The OOD filtering problem in unlabeled wild data is elegantly reformulated as a label-noise learning problem, leading to a novel LoD OOD detection framework, which not only effectively addresses the model-bias issue but also circumvents the threshold selection dilemma. • Theoretical foundation is provided to support the viability of LoD. Meanwhile, extensive experiments are also conducted to demonstrate its superiority. 2 Related Works 2.1 Out-of-Distribution Detection To improve the safety and reliability of models in detecting OOD data, various OOD methods have been developed Zhu et al. 2023 ; Zheng et al. 2023 ; Wang et al. 2023b ; Yang et al. 2024 ; Li et al. 2024b ; Behpour et al. 2024 ; Fang et al. 2024 ; Sharifi et al. 2025 , including adopting the classification confidence or entropy, modeling the ID density, leveraging auxiliary OOD data, and more. Among these, methods using auxiliary OOD data have demonstrated encouraging OOD detection performance over the counterpart without auxiliary data Lee et al. 2017 ; Bevandić et al. 2018 ; Malinin and Gales 2018 ; Liu et al. 2020b ; Chen et al. 2021 ; Wei et al. 2022 ; Du et al. 2022 ; Wang et al. 2023a ; Sharifi et al. 2025 . Despite the promise, there are two