ASAT: Adaptive Scoring and Thresholding with Human Feedback for Robust Out-of-Distribution Detection
Daisuke Yamada [email protected], Harit Vishwakarma [email protected], Ramya Korlakai Vinayak [email protected] · 2025
Read ASAT: Adaptive Scoring and Thresholding with Human Feedback for Robust Out-of-Distribution Detection by Daisuke Yamada [email protected], Harit Vishwakarma [email protected], Ramya Korlakai Vinayak [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-02299.txt.
Introduction
Daisuke Yamada, Harit Vishwakarma, and Ramya Korlakai Vinayak propose, in a 2025 paper, a safer way to set the tripwires that catch out-of-place inputs to machine learning systems. Deployed models meet data unlike their training, sometimes dangerously. Detectors score strangeness and compare it to a threshold.
Thresholds are usually set from normal data alone, leaving false alarms uncontrolled. Fixed scores also age badly as strange inputs evolve. Their framework, ASAT, adapts both score and threshold with human feedback in the loop. The aim is catching the truly foreign without drowning operators in false positives. Safety-critical uses, from driving to diagnosis, need exactly that balance.
Catalog record
| CREATOR | Daisuke Yamada [email protected], Harit Vishwakarma [email protected], Ramya Korlakai Vinayak [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 84 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-02299
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ASAT: Adaptive Scoring and Thresholding with Human Feedback for Robust Out-of-Distribution Detection Daisuke Yamada [email protected], Harit Vishwakarma [email protected], Ramya Korlakai Vinayak [email protected] Abstract Machine Learning (ML) models are trained on in-distribution (ID) data but often encounter out-of-distribution (OOD) inputs during deployment—posing serious risks in safety-critical domains. Recent works have focused on designing scoring functions to quantify OOD uncertainty, with score thresholds typically set based solely on ID data to achieve a target true positive rate (TPR), since OOD data is limited before deployment. However, these TPR-based thresholds leave false positive rates (FPR) uncontrolled, often resulting in high FPRs where OOD points are misclassified as ID. Moreover, fixed scoring functions and thresholds lack the adaptivity needed to handle newly observed, evolving OOD inputs, leading to sub-optimal performance. To address these challenges, we propose ASAT , a human-in-the-loop framework that safely updates both scoring functions and thresholds on the fly based on real-world OOD inputs. ASAT maximizes TPR while controlling FPR at all times under stationary conditions, even as the system adapts over time. Under nonstationary conditions, the method adapts to distribution shifts with only transient FPR violations during the adaptation period. We provide theoretical guarantees for FPR control under stationary conditions and present extensive empirical evaluations on OpenOOD benchmarks to demonstrate that our approach outperforms existing methods by achieving higher TPRs while maintaining FPR control. Reviewed on OpenReview: https://openreview.net/forum?id=4Kd0VMsL76 1 Introduction Machine learning (ML) models are typically trained under the closed-world assumption—test-time data comes from the same distribution as the training data (in-distribution, denoted by ID). However, during deployment, models often encounter out-of-distribution (OOD) inputs, such as data points that do not belong to any training class in classification. In safety-critical domains like medical diagnosis, it is crucial that the system refrains from generating predictions for OOD inputs. Instead, these inputs must be flagged so that expert human intervention is sought. To achieve this, an OOD detector is integrated into systems to monitor real-time samples and flag those that appear OOD, ensuring that unreliable predictions are not produced. To this end, many OOD detection methods have been developed to distinguish OOD inputs from ID inputs ( Yang et al., 2022 ) . While ID data is available during model training, diverse OOD examples remain unseen until deployment. This limited access to OOD data naturally leads to an ID-based detection approach: (1) a scoring function is designed or selected to quantify how likely an input is to be OOD (or ID) using only ID data , and (2) a threshold is set on these scores— again based solely on ID data —to achieve a desired true positive rate (TPR) (e.g., 95% of ID inputs are correctly identified as ID). While this approach has shown promising results, it suffers from the following issues: 1) High False Positive Rate (FPR). OOD detection systems are prone to high FPRs, where OOD inputs are misclassified as ID ( Nguyen et al., 2015 ; Amodei et al., 2016 ) . In high-risk applications, false positives are often more critical than false negatives. For example, detecting non-existent cancer may simply trigger further analysis, whereas missing an actual case can be fatal. Thus, systems in such domains must have strict FPR control (e.g., below 5%). However, the common approach sets score thresholds solely using ID data to meet a target TPR, leaving FPR uncontrolled. As a result, FPRs can be very high—for instance, ranging from 32% to 91% when CIFAR-10 is used as ID in the OpenOOD benchmark ( Yang et al., 2022 ) . 2) Lack of Adaptivity. During deployment, systems encounter diverse, novel OOD inputs. However, no single scoring function works well for all types of OOD data. As a result, the common approach of relying on a pre-designed scoring function and threshold risks being stuck with one that performs poorly on newly encountered OOD inputs—thereby limiting achievable TPR. These methods miss the opportunity to improve their scoring functions based on OOD inputs observed during deployment (Figure 2 ). Thus, real-world systems must adapt their scoring functions and thresholds over time to handle diverse OOD inputs, maximizing TPR while keeping FPR under control. These challenges motivate the following goal. Goal: Develop a human-in-the-loop OOD system that strictly controls FPR, adaptively maximizes TPR, and thus minimizes human intervention. Our Contribution. Toward this goal, we make the following contributions: 1. We introduce a framework, ASAT (adaptive scoring, adaptive threshold), that leverages human feedback to identify OOD inputs and simultaneously update scoring functions and thresholds , thereby maximizing TPR while ensuring strict FPR control throughout deployment (Figure 1 ). 2. We provide a theoretical analysis that guarantees FPR control at all times, even as scoring functions and thresholds are updated. Our analysis shows that our approach can maintain FPR below a user-specified tolerance \alpha (e.g., 5%) when the OOD remains constant. 3. We present extensive empirical evaluations under both stationary (OOD fixed) and nonstationary (OOD changing over time) conditions. On OpenOOD benchmarks, we show our framework consistently outperforms existing approaches, achieving higher TPR while ensuring strict FPR control. Figure 1 : Overview of the ASAT workflow, updating both scoring function g_{t} and threshold \lambda_{t} via human feedbacks. The ID data consists of brain MRI scans from healthy individuals and those with tumors. The OOD data includes brain scans with other non-tumorous conditions—for example, scans from patients with Alzheimer’s disease. We refer to our method as ASAT ( adaptive scoring, adaptive threshold ), in contrast to the common approach FSFT ( fixed scoring, fixed threshold ), which uses fixed scoring functions and thresholds derived from ID data. We also compare with FSAT ( fixed scoring, adaptive threshold ), which updates thresholds while keeping scoring functions fixed. Refer to Section 3.3 for descriptions of FSAT . See Table 1 for a summary. Method Score Fn Threshold FPR \bm{\leq\alpha} TPR FSFT Fixed Fixed \times Fixed (95%) FSAT Fixed Adaptive \checkmark Limited ASAT (ours) Adaptive Adaptive \checkmark Improved Table 1 : Comparison of FSFT , FSAT , and ASAT across scores, thresholds, FPR control, and TPR. (a) EBO (b) KNN (c) VIM (d) ASAT (ours) Figure 2 : Comparison of score distributions between post-hoc fixed scoring functions (trained solely on ID data) and our learned function g^{\ast} from ( P2 ) (trained offline on both ID and OOD). CIFAR-10 and Places365 are the ID and OOD datasets, respectively. As t increases, the ASAT -adapted scoring function achieves higher TPR at 5% FPR compared to EBO, KNN, and VIM methods from the Open-OOD benchmarks. This comparison suggests that incorporating human-labeled OOD inputs encountered during deployment enables ASAT to update scoring functions that better align with real-world OOD points. For more details, see Section 5 . 2 Preliminaries 2.1 Problem Setting Data Stream. Let \mathcal{X}\subseteq\mathbb{R}^{d} and \mathcal{Y}=\{0,1\} denote feature and label spaces, respectively, where 0 represents OOD and 1 represents ID. Let \mathcal{D}_{0} and \mathcal{D}_{1} be the unknown distributions of the OOD and ID data over \mathcal{X} . At each time t during deployment, our model sequentially receives a sample x_{t} drawn independently from the mixture model, x_{t}\overset{\mathrm{i.i.d.}}{\sim}\gamma\mathcal{D}_{0}+(1-\gamma)\mathcal{D}_{1}, where the mixture rate \gamma\in(0,1) is fixed but unknown. Let y_{t}\in\mathcal{Y} be the true label for x_{t} , indicating whether it is an OOD or ID point. Scoring