Interval-Based AUC(iAUC): Extending ROC Analysis to Uncertainty-Aware Classification Yuqi Li 1 Matthew M. Engelhard 1 1 Department of Biostatistics & Bioinformatics, Duke University {yuqi.li, m.engelhard}@duke.edu Abstract In high-stakes risk prediction, quantifying uncertainty through interval-valued predictions is essential for reliable decision-making. However, standard evaluation tools like the receiver operating characteristic (ROC) curve and the area under the curve (AUC) are designed for point scores and fail to capture the impact of predictive uncertainty on ranking performance. We propose an uncertainty-aware ROC framework specifically for interval-valued predictions, introducing two new measures: AUC L \operatorname{AUC}_{L} and AUC U \operatorname{AUC}_{U} . This framework enables an informative three-region decomposition of the ROC plane, partitioning pairwise rankings into correct, incorrect, and uncertain orderings. This approach naturally supports selective prediction by allowing models to abstain from ranking cases with overlapping intervals, thereby optimizing the trade-off between abstention rate and discriminative reliability. We prove that under valid class-conditional coverage, AUC L \operatorname{AUC}_{L} and AUC U \operatorname{AUC}_{U} provide formal lower and upper bounds on the theoretical optimal AUC ( AUC ∗ \operatorname{AUC}^{*} ), characterizing the physical limit of achievable discrimination. The proposed framework applies broadly to interval-valued prediction models, regardless of the interval construction method. Experiments on real-world benchmark datasets, using bootstrap-based intervals as one instantiation, validate the framework’s correctness and demonstrate its practical utility for uncertainty-aware evaluation and decision-making. 1 Introduction In many high-stakes risk prediction tasks, predicting a single event probability is insufficient, because it does not acknowledge the model’s confidence or lack thereof regarding the true event or label probability. A prediction accompanied by a measure of uncertainty enables more careful decision-making: confident predictions may be acted upon immediately, whereas uncertain cases can be deferred to human review. This is particularly important in medical risk prediction, where model outputs are often used to guide screening, diagnosis, or treatment decisions. For example, in diabetes risk screening, an uncertainty-aware model might output a predicted risk of 0.45 with a 95% confidence interval of [0.25, 0.65]. If this interval lies entirely above a clinical decision threshold, immediate intervention may be justified, whereas if it spans the threshold, further testing or specialist consultation may be warranted. Motivated by this need, modern uncertainty quantification methods often produce interval-valued predictions rather than point estimates. Examples include prediction intervals derived from Bayesian credible intervals, bootstrap procedures, and ensemble methods ( 6 ; 11 ; 9 ) . For each input X , the model outputs an interval (L(X),U(X)) that intends to contain the true event or label probability. While these methods provide richer predictive information, they raise more questions: how can we enhance our evaluation of uncertainty-aware classification beyond point-based metrics, and how can the quality of our prediction intervals be evaluated when the true event probabilities are unobserved? Standard evaluation tools for binary classification were designed for point predictions. The Receiver Operating Characteristic (ROC) curve and its summary statistic, the Area Under the Curve (AUC), remain the most widely used metrics. The classical AUC admits a clear probabilistic interpretation as the probability that a randomly chosen positive instance is ranked above a randomly chosen negative one ( 14 ) . This interpretation relies on the ability to rank all instances using a scalar score. While existing methods handle tied scores by assigning partial credit to unranked pairs ( 13 ) , they are insufficient for interval-valued predictions. In this setting, interval overlap represents explicit ranking ambiguity rather than a mere statistical coincidence of identical scores. Therefore, the induced partial ordering calls for an evaluation framework that directly reflects uncertainty in interval-valued scores. In current practice, interval predictions are often collapsed to point estimates, such as the mean or midpoint, and then evaluated using the standard AUC ( 16 ; 15 ) . This approach discards uncertainty information and prevents analysis of how interval width or overlap relates to discrimination performance. Alternatively, interval predictions are evaluated through properties such as calibration or coverage, typically reported separately from discrimination metrics ( 12 ; 2 ) . Moreover, in binary prediction settings, coverage of event probabilities is not directly observable and can usually be assessed only through simulation or modeling assumptions. Taken together, these practices treat discrimination and uncertainty as separate concerns, leaving no unified metric for evaluating uncertainty-aware classifiers. Figure 1 : Illustration of interval-based comparisons. Top: pairwise comparisons between a positive instance I_{1} and a negative instance I_{0} . Bottom: comparisons between an interval prediction I and a decision threshold t , illustrating confident decisions ( I>t or IU_{0} , (ii) confidently incorrect if U_{1}U_{0} nor U_{1}I_{0}),\qquad\operatorname{AUC}_{U}=1-\mathbb{P}(I_{0}>I_{1}). We first prove that \operatorname{AUC}_{L} and \operatorname{AUC}_{U} equal the probabilities of strict interval orderings (Theorems 1 and 2 ). Together with the overlap probability, these yield a three-region decomposition : \mathbb{P}(I_{1}>I_{0})+\mathbb{P}(I_{1}f(X_{0})) over all scoring functions f , we show that interval-based discrimination metrics provide informative bounds on \operatorname{AUC}^{*} under mild coverage assumptions. These results connect observable interval predictions to fundamental limits on ranking performance, and clarify how predictive uncertainty constrains achievable discrimination. We validate the framework empirically using the Pima Indians Diabetes dataset with bootstrap-based prediction intervals. Experiments verify the theoretical equivalences and characterize how interval width affects the three-region decomposition. Our main contributions are: (i) extending ROC analysis to interval-valued predictions with \operatorname{AUC}_{L} and \operatorname{AUC}_{U} metrics; (ii) proving a three-region decomposition of the ROC plane characterizing ranking uncertainty; (iii) establishing bounds on optimal AUC under class-conditional coverage; and (iv) providing practical tools for evaluating selective prediction and uncertainty-aware model selection. This framework offers a principled approach to discrimination analysis for interval-valued predictions. 2 Related Work Classical ROC Analysis and AUC. The Receiver Operating Characteristic (ROC) curve originated in signal detection theory and is now a standard tool for evaluating binary classifiers 14 ; 8 . It plots the true positive rate against the false positive rate as a classification threshold varies, while the area under the curve (AUC) summarizes discriminative ability in a single scalar. A key theoretical result establishes the probabilistic interpretation of AUC: for a scoring function f , \operatorname{AUC}(f)=\mathbb{P}\bigl(f(X^{+})>f(X^{-})\bigr)+\tfrac{1}{2}\mathbb{P}\bigl(f(X^{+})=f(X^{-})\bigr), where X^{+} and X^{-} are independently drawn positive and negative instances. This interpretation links the AUC to pairwise ranking accuracy and underlies its widespread use in applications such as medical risk prediction 18 . Numerous extensions have been proposed, including the partial AUC, cost-sensitive ROC analysis, and multi-class generalizations 8 . Related work has also studied the Bayes-optimal scoring rule that maximizes the AUC under the true data-generating process, often referred to as the optimal AUC 4 ; 3 . Methods Producing Interval-Valued Predictions. A variety of approaches produce interval-valued predictions for binary risk prediction tasks. Bootstrap methods generate empirical prediction distributions by resampling the training data and constructing percentile-based confidence intervals 6 ; 5 . Bayesian methods provide posterior predictive distributions from which credible intervals can be derived, including Bayesian generalized linear models, Gaussian processes, and Bayesian neural networks 17 ; 11 ; 9 . Ensemble methods estimate uncertainty through variability across models or repeated forward passes, yielding intervals via empirical quantiles 16 . Our framework is agnostic to the interval generation mechanism and applies to any method that outputs interval-valued predictions. Evaluation of Prediction Intervals. Standard evaluation metrics for prediction intervals focus on calibration and sharpness , often following the principle of maximizing sharpness (measured by average width) subject to valid calibration ( 12 ) . These properties are typically assessed via proper scoring rules like the Weighted Interval Score (WIS) , or by examining under- and over-coverage rates separately ( 2 ) . However, these metrics are fundamentally local and pointwise; they evaluate uncertainty quantification for individual instances but do not characterize the global discriminative performance or ranking consistency ( 12 ) . Furthermore, while group-level calibration is estimable using binary labels, individual-level coverage of the true posterior \eta(x) remains unobservable in real-world settings. Our framework bridges this gap by mapping unobservable coverage properties to observable bounds on the optimal AUC 3 . This allows practitioners to translate uncertainty guarantees from methods like conformal prediction ( 19 ; 1 ) into a tangible range of discriminative performance. Selective Prediction and Abstention. Selective prediction studies decision-making under uncertainty by allowing models to abstain when confidence is low, which enables a trade-off between retention rate and accuracy on the non-abstaining instances ( 7 ; 10 ) . Conventional approaches typically rely on scalar confidence scores to implement pointwise rejection, with most research focusing on label prediction and the empirical estimation of thresholds to control error rates. However, this literature primarily focuses on decision policies for individual labels rather than on how uncertainty propagates to ranking or global discrimination metrics ( 7 ) . Furthermore, while label-based confidence can be verified directly against observed outcomes, there is no inherent way to assess the coverage of second-order uncertainty quantification, which captures uncertainty over the predicted probabilities themselves, as the true posterior \eta(x) remains unobservable in real-world binary data. Our framework addresses this gap by characterizing how interval-valued predictions induce pairwise ranking ambiguity. Instead of rejecting individual points, we utilize interval overlaps to identify ambiguous pairs and assess discrimination via the uncertainty-aware AUC (see Section 3.4 ), which measures the fraction of non-overlapping pairs that are correctly ordered. Research Gap and Our Contribution. Taken together, existing work provides well-developed tools for evaluating scalar classifiers and for assessing the calibration and sharpness of prediction intervals. What remains missing is a principled framework to incorporate interval-valued uncertainty into discrimination analysis. In particular, existing metrics do not quantify ranking ambiguity induced by overlapping intervals, nor do they provide AUC-style summaries that account for uncertainty. This paper fills this gap by extending ROC analysis to interval-valued predictions, providing probabilistic interpretations, and introducing the uAUC metric for uncertainty-aware evaluation. Furthermore, by linking uncertainty calibration directly to bounds on the optimal AUC under class-conditional coverage, our framework enables practitioners to translate observable interval predictions into a tangible range of the best achievable discrimination. 3 Setup and Theory 3.1 Problem Setup and Interval Comparisons We consider a binary risk prediction problem with labels Y\in\{0,1\} , where Y=1 denotes the positive class and Y=0 the negative class. The goal is to predict a continuous risk score associated with the positive class, which can subsequently be used to support threshold-based decisions. Instead of scalar prediction scores, we suppose the classifier outputs an interval-valued score I(x)=(L(x),U(x)) , where L(x)\leq U(x) for each input x . Let I_{1}=(L_{1},U_{1}) and I_{0}=(L_{0},U_{0}) denote random prediction intervals obtained by applying this scoring rule to independent draws from the positive and negative class distributions, respectively. Note that we use subscripts 1 and 0 to denote conditioning on the true class label, and this pairwise notation is used to characterize ranking behavior. We write I_{1}\sim F_{1} and I_{0}\sim F_{0} for the corresponding distributions over intervals. Throughout, we assume L_{i}\leq U_{i} almost surely for i\in\{0,1\} . We compare interval-valued scores using strict non-overlap criteria, under which one object is ranked above another only when the ordering is unambiguous given the reported uncertainty. For an interval I=(L,U) and a threshold t\in\mathbb{R} , we write I>t if L>t and II_{0}\iff L_{1}>U_{0},\qquad I_{1}t), \displaystyle\text{TPR}_{U}(t) \displaystyle=\mathbb{P}(U_{1}>t), \displaystyle\text{FPR}_{L}(t) \displaystyle=\mathbb{P}(L_{0}>t), \displaystyle\text{FPR}_{U}(t) \displaystyle=\mathbb{P}(U_{0}>t). By construction, \text{TPR}_{L}(t)\leq\text{TPR}_{U}(t) and \text{FPR}_{L}(t)\leq\text{FPR}_{U}(t) for all t . We define two ROC-style curves by pairing rate functions with different levels of strictness. The first curve plots \text{TPR}_{L}(t) against \text{FPR}_{U}(t) as t varies, and the second plots \text{FPR}_{L}(t) against \text{TPR}_{U}(t) . The associated areas under these curves are denoted by \displaystyle\operatorname{AUC}_{L} \displaystyle=\int\text{TPR}_{L}(t)\,d[\text{FPR}_{U}(t)], (1) \displaystyle\operatorname{AUC}_{U} \displaystyle=\int\text{TPR}_{U}(t)\,d[\text{FPR}_{L}(t)]. (2) The pairing of rate functions reflects different notions of conservativeness in interval-based discrimination. The curve (\text{TPR}_{L},\text{FPR}_{U}) corresponds to a strict comparison rule. Here, \text{TPR}_{L} is conservative in that a positive instance contributes to the true positive rate only if its entire interval lies above the threshold, while \text{FPR}_{U} is conservative in the opposite direction, counting a negative instance as a false positive whenever any part of its interval exceeds the threshold. Together, this pairing yields a conservative assessment of discrimination that requires certainty for correct rankings and penalizes any potential error. In contrast, the curve (\text{TPR}_{U},\text{FPR}_{L}) corresponds to a permissive rule. Under this pairing, \text{TPR}_{U} credits a positive instance whenever the threshold is at least partially exceeded, while \text{FPR}_{L} penalizes a negative instance only when its entire interval exceeds the threshold. This rule favors potential separation and yields an upper bound on discriminative performance under interval uncertainty. Figure 2 : Geometric interpretation of interval-based ROC analysis. The blue curve plots \mathrm{TPR}_{L} versus \mathrm{FPR}_{U} (area =\operatorname{AUC}_{L} ), and the red curve plots \mathrm{TPR}_{U} versus \mathrm{FPR}_{L} (area above =1-\operatorname{AUC}_{U} ). The three regions correspond to \mathbb{P}(I_{1}>I_{0}) (blue), \mathbb{P}(\text{overlap}) (white), and \mathbb{P}(I_{1}f(X_{0})\bigr) , the probability that a randomly chosen positive instance is ranked above a randomly chosen negative one. We show that this property extends naturally to interval-valued predictions, yielding analogous interpretations for \operatorname{AUC}_{L} and \operatorname{AUC}_{U} . For a randomly chosen positive interval I_{1}=(L_{1},U_{1}) and an independently chosen negative interval I_{0}=(L_{0},U_{0}) , the following two results hold: Theorem 1 . \displaystyle\operatorname{AUC}_{L}=\mathbb{P}(L_{1}>U_{0})=\mathbb{P}(I_{1}>I_{0}). (3) Proof. Let G_{1}(l)=\mathbb{P}(L_{1}\leq l) and H_{0}(u)=\mathbb{P}(U_{0}\leq u) . Since \text{TPR}_{L}(t)=\mathbb{P}(L_{1}>t)=1-G_{1}(t) and \text{FPR}_{U}(t)=\mathbb{P}(U_{0}>t)=1-H_{0}(t) , we have d[\text{FPR}_{U}(t)]=-dH_{0}(t) . Therefore, \displaystyle\operatorname{AUC}_{L} \displaystyle=\int\bigl(1-G_{1}(t)\bigr)\,d(1-H_{0}(t)) \displaystyle=\mathbb{E}_{U_{0}}\!\left[1-G_{1}(U_{0})\right] \displaystyle=\mathbb{P}(L_{1}>U_{0}), ∎ Theorem 2 . \displaystyle\operatorname{AUC}_{U}=1-\mathbb{P}(U_{1}I_{0})+\mathbb{P}(I_{1}I_{0}) , while the area above the reflected \text{TPR}_{U} – \text{FPR}_{L} curve corresponds to \mathbb{P}(I_{1}I_{0})}{\mathbb{P}(I_{1}>I_{0})+\mathbb{P}(I_{1}s(X_{0})\text{ is correct}\mid|s(X_{1})-s(X_{0})|=\Delta s) , is a non-decreasing function of the score difference \Delta s . Then the uncertainty-aware AUC, uAUC(\gamma) , is non-decreasing in \gamma . This result guarantees that the interval-based framework acts as a valid filter for ranking reliability: as the confidence level \gamma increases, the model abstains more frequently but maintains or improves the quality of its definitive decisions. The proof is provided in Appendix A . 4 Estimating the Bounds of the Optimal AUC In this section, we investigate the relationship between our proposed interval-based metrics and the theoretical limit of discriminative performance. We show that under mild coverage assumptions, \operatorname{AUC}_{L} and \operatorname{AUC}_{U} provide principled bounds on the optimal AUC achievable by any scoring function. 4.1 Optimal AUC and Bayes-Optimal Ranking Let (X,Y)\sim P with labels Y\in\{0,1\} . We define the true (unknown) posterior probability (the regression function) as \eta(x)=\mathbb{P}(Y=1\mid X=x) . For any measurable scoring function f:\mathcal{X}\to\mathbb{R} , its population-level AUC is defined as \operatorname{AUC}(f)=\mathbb{P}\bigl(f(X_{1})>f(X_{0})\bigr) , where X_{1}\sim P(X\mid Y=1) and X_{0}\sim P(X\mid Y=0) are independent. The optimal AUC , denoted by \operatorname{AUC}^{*} , is the maximum ranking performance attainable under the true data distribution: \operatorname{AUC}^{*}:=\sup_{f}\operatorname{AUC}(f). (7) A fundamental result in statistical learning theory shows that the Bayes posterior \eta(x) induces the optimal ranking. As shown by 3 , any scoring function that is a strictly monotone transformation of \eta(x) maximizes the ROC curve at every point and thus achieves \operatorname{AUC}^{*} : \operatorname{AUC}^{*}=\mathbb{P}\bigl(\eta(X_{1})>\eta(X_{0})\bigr). (8) This value represents the physical limit of discrimination due to the intrinsic overlap of class-conditional distributions. 4.2 Bounding Optimal AUC under Marginal Coverage While \eta(x) is generally unknown, interval-valued predictions I(x)=[L(x),U(x)] allow us to reason about the location of \eta(x) with a certain degree of confidence. To link I(x) to \operatorname{AUC}^{*} , we assume the intervals satisfy class-conditional coverage guarantees. Let the miscoverage rates be defined as: \alpha_{i}:=\mathbb{P}\bigl(\eta(X)\notin I(X)\mid Y=i\bigr),\qquad i\in\{0,1\}. (9) For a randomly drawn pair (X_{1},X_{0}) , we define the pairwise coverage event E_{\text{pair}} as the case where both intervals correctly capture their respective posterior probabilities: E_{\text{pair}}:=\bigl\{\eta(X_{1})\in I(X_{1})\bigr\}\cap\bigl\{\eta(X_{0})\in I(X_{0})\bigr\}. (10) Assuming independence between X_{1} and X_{0} , the probability that at least one interval fails to cover \eta , denoted as p_{\text{pair}} , is: p_{\text{pair}}:=\mathbb{P}(E_{\text{pair}}^{c})=1-(1-\alpha_{1})(1-\alpha_{0})=\alpha_{1}+\alpha_{0}-\alpha_{1}\alpha_{0}. (11) In practice, when \alpha_{1},\alpha_{0} are small, p_{\text{pair}} can be tightly approximated by \alpha_{1}+\alpha_{0} . On the event E_{\text{pair}} , the strict interval ordering directly implies the Bayes ordering. Specifically, if L_{1}>U_{0} , then \eta(X_{1})\geq L_{1}>U_{0}\geq\eta(X_{0}) , which necessitates \eta(X_{1})>\eta(X_{0}) . Conversely, if \eta(X_{1})>\eta(X_{0}) , it must hold that U_{1}>L_{0} for any overlapping or correctly ordered intervals. This logical connection allows us to bound the optimal AUC using observable interval-based quantities. Theorem 3 (Bounds on the Optimal AUC) . Given interval-valued predictions I(x) with class-conditional miscoverage rates \alpha_{1} and \alpha_{0} , the optimal AUC satisfies: \operatorname{AUC}_{L}-p_{\text{pair}}\;\leq\;\operatorname{AUC}^{*}\;\leq\;\operatorname{AUC}_{U}+p_{\text{pair}}. (12) The proof is provided in Appendix B . This result provides a principled way to estimate the range of the best achievable discrimination. As the model’s uncertainty quantification becomes more precise (shorter intervals) while maintaining coverage (small \alpha ), \operatorname{AUC}_{L} and \operatorname{AUC}_{U} converge toward each other, effectively sandwiching the optimal AUC. This framework allows practitioners to quantify not just how well their current model performs, but also how much room remains for improvement relative to the Bayes-optimal limit. 5 Experiments We illustrate and empirically validate the proposed interval-based AUC framework on the Pima Indians Diabetes dataset. Our evaluation focuses on verifying the theoretical equivalences and characterizing the dynamics of ranking ambiguity. In addition, we demonstrate how the proposed framework supports selective prediction by abstaining on uncertain cases and examining the trade-off between the abstention rate and uncertainty-aware ranking performance as measured by \operatorname{AUC}_{L} and \operatorname{AUC}_{U} . 5.1 Experimental Setup The Pima dataset contains clinical measurements from 768 female patients aged 21 and above, with 8 features. The binary outcome indicates diabetes onset within five years. The dataset is partitioned into a 30% training (230 samples) and 70% test (538 samples) split with stratification to preserve the class distribution. We train a logistic regression classifier with standard feature scaling using bootstrap resampling. For each test instance x_{i} , we fit 300 logistic regression models on bootstrap samples of the training data and obtain predicted probabilities. Prediction intervals at level (1-\alpha) are constructed using empirical quantiles of the bootstrap predictions, with lower and upper bounds given by L_{i}=\mathrm{Q}_{\alpha/2} and U_{i}=\mathrm{Q}_{1-\alpha/2} , yielding interval-valued predictions I(x_{i})=[L_{i},U_{i}] . As a reference, the baseline point AUC computed from mean predicted probabilities is 0.831. 5.2 Empirical Results and Analysis Experiment 1: Validation of AUC-Probability Equivalence. We first verify the core theoretical results of Theorems 1 and 2 on real data. Using 90% confidence intervals, we compute \operatorname{AUC}_{L} via trapezoidal integration of the \text{TPR}_{L} vs \text{FPR}_{U} curve and compare it with the empirical estimate \mathbb{P}(I_{1}>I_{0}) obtained by counting pairwise interval comparisons. Similarly, we compute \operatorname{AUC}_{U} from the \text{FPR}_{L} vs \text{TPR}_{U} curve and verify its relationship with 1-\mathbb{P}(I_{1}I_{0}) 0.6074 / 0.6072 0.0002 \operatorname{AUC}_{U} vs. 1-\mathbb{P}(I_{1}I_{0}) 0.6072 — \mathbb{P}(\text{overlap}) 0.3367 — \mathbb{P}(I_{1}I_{0}) is less than 0.02%, and a similarly small discrepancy is observed for \operatorname{AUC}_{U} , confirming the theoretical equivalences. The three probabilities sum to 1.0000, validating Corollary 1 . With 90% confidence intervals, we observe \mathbb{P}(I_{1}>I_{0})=0.607 , indicating that approximately 61% of pairwise rankings are definitively correct, \mathbb{P}(\text{overlap})=0.337 are uncertain, and \mathbb{P}(I_{1}I_{0})+\mathbb{P}(\text{overlap})+\mathbb{P}(I_{1}I_{0}) recovers the classical point-based AUC. As intervals widen, probability mass shifts primarily from \mathbb{P}(I_{1}>I_{0}) to the overlap region, while the rate of confident misorderings \mathbb{P}(I_{1}I_{0}) (blue, confident correct rankings), \mathbb{P}(\text{overlap}) (gray, ambiguous rankings), and \mathbb{P}(I_{1}\Omega(\gamma)\} . By definition, the uncertainty-aware AUC is the conditional expectation: uAUC(\gamma)=\mathbb{E}[\mathbf{1}\{\text{correct ranking}\}\mid A_{\gamma}]. (13) Since \delta(x,\gamma) is non-decreasing in \gamma for all x , the threshold \Omega(\gamma) is also non-decreasing. It follows that for any \gamma_{1}<\gamma_{2} , the decisive events satisfy the nesting property A_{\gamma_{2}}\subseteq A_{\gamma_{1}} . Let h(\Delta s)=\mathbb{P}(\text{correct ranking}\mid\Delta s) be the ranking accuracy function, which is non-decreasing by assumption. The uAUC(\gamma) can be expressed as a truncated expectation of h(\Delta s) : uAUC(\gamma)=\mathbb{E}[h(\Delta s)\mid\Delta s>\Omega(\gamma)]. (14) As \gamma increases, the condition \Delta s>\Omega(\gamma) restricts the expectation to a subset of pairs with strictly larger score differentials. Because h(\Delta s) is non-decreasing, the average accuracy over this more restrictive set must be greater than or equal to that of the broader set. Therefore, uAUC(\gamma_{2})\geq uAUC(\gamma_{1}) , which completes the proof. ∎ Appendix B Proof of Theorem 3 Proof. Let E_{\mathrm{pair}} denote the event that both interval predictions cover the corresponding Bayes posterior values, that is, E_{\mathrm{pair}}:=\{\eta(X_{1})\in I_{1}\}\cap\{\eta(X_{0})\in I_{0}\}, and let p_{\mathrm{pair}}=\mathbb{P}(E_{\mathrm{pair}}^{c}) . For the lower bound, observe that whenever E_{\mathrm{pair}} holds, L_{1}>U_{0}\;\Rightarrow\;\eta(X_{1})>\eta(X_{0}). This implies the pointwise inequality \mathbf{1}\{L_{1}>U_{0}\}\;\leq\;\mathbf{1}\{\eta(X_{1})>\eta(X_{0})\}+\mathbf{1}\{E_{\mathrm{pair}}^{c}\}. Taking expectations yields \operatorname{AUC}_{L}\leq\operatorname{AUC}^{*}+p_{\mathrm{pair}}, or equivalently \operatorname{AUC}_{L}-p_{\mathrm{pair}}\leq\operatorname{AUC}^{*} . For the upper bound, note that under E_{\mathrm{pair}} , \eta(X_{1})>\eta(X_{0})\;\Rightarrow\;U_{1}>L_{0}. Hence, \mathbf{1}\{\eta(X_{1})>\eta(X_{0})\}\;\leq\;\mathbf{1}\{U_{1}>L_{0}\}+\mathbf{1}\{E_{\mathrm{pair}}^{c}\}. Taking expectations gives \operatorname{AUC}^{*}\leq\operatorname{AUC}_{U}+p_{\mathrm{pair}}. Combining the two bounds completes the proof. ∎