Label-free estimation of clinically relevant performance metrics under distribution shifts

Tim Flühmann (🖂), Alceu Bissoto, Trung-Dung Hoang, Lisa M. Koch (🖂) · 2025

Read Label-free estimation of clinically relevant performance metrics under distribution shifts by Tim Flühmann (🖂), Alceu Bissoto, Trung-Dung Hoang, Lisa M. Koch (🖂) (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-22776.txt.

Introduction

Tim Flühmann and co-authors tackle how to judge a medical AI's accuracy when no labeled answers exist for new data, in this 2025 paper. Hospitals need to watch model performance after deployment, yet fresh scans rarely come with truth labels. Older tricks infer accuracy from the model's own confidence scores. The team extends those tricks to estimate the full confusion matrix, not just one score.

They test the methods on chest X-rays under real site shifts and under simulated shifts in scan style and disease rates. The matrix estimates tracked clinically relevant counts well on real shifts. Simulated shifts exposed failure modes in current techniques. The authors warn that monitoring tools must be matched to the true deployment setting before use in safety oversight.

Catalog record

CREATORTim Flühmann (🖂), Alceu Bissoto, Trung-Dung Hoang, Lisa M. Koch (🖂)
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE22 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-22776

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Label-free estimation of clinically relevant performance metrics under distribution shifts Tim Flühmann (🖂), Alceu Bissoto, Trung-Dung Hoang, Lisa M. Koch (🖂) Abstract Performance monitoring is essential for safe clinical deployment of image classification models. However, because ground-truth labels are typically unavailable in the target dataset, direct assessment of real-world model performance is infeasible. State-of-the-art performance estimation methods address this by leveraging confidence scores to estimate the target accuracy. Despite being a promising direction, the established methods mainly estimate the model’s accuracy and are rarely evaluated in a clinical domain, where strong class imbalances and dataset shifts are common. Our contributions are twofold: First, we introduce generalisations of existing performance prediction methods that directly estimate the full confusion matrix. Then, we benchmark their performance on chest x-ray data in real-world distribution shifts as well as simulated covariate and prevalence shifts. The proposed confusion matrix estimation methods reliably predicted clinically relevant counting metrics on medical images under distribution shifts. However, our simulated shift scenarios exposed important failure modes of current performance estimation techniques, calling for a better understanding of real-world deployment contexts when implementing these performance monitoring techniques for postmarket surveillance of medical AI models. 1 1 1 Code available at https://github.com/mlm-lab-research/clin_perf_est 1 Introduction Deep learning for medical image classification exhibits excellent performance in controlled settings [ 1 ] , but distribution shifts in the target domain may cause silent failures in real-world applications [ 2 , 3 ] . For safe deployment in clinical domains, continuous performance monitoring is crucial. Several methods have been proposed to estimate model classification performance on unlabelled target datasets, enabling clinicians to anticipate model failures before they affect patients. Some performance estimation approaches estimate accuracy based on the distance between source and target distribution [ 4 ] , or train a reverse model on the pseudo-labelled test data to evaluate reverse performance on the source distribution [ 5 ] . Here, we focus on performance estimation based on the model’s confidence scores [ 4 , 6 , 7 , 8 , 9 , 10 ] . They have shown the best trade-off between accuracy and computational efficiency [ 7 , 8 , 11 ] , as they require neither retraining, other labelled datasets, nor ensemble agreement [ 12 ] . Despite their potential, it remains unclear whether confidence-based performance-estimation methods apply in the clinical setting. Most were proposed and evaluated outside the clinical domain and focus on predicting only accuracy, which is often an inadequate metric for clinical tasks [ 13 ] . Instead, validating medical image classification models requires a suite of clinically relevant metrics depending on the domain of interest, such as precision, recall, etc. Currently, no benchmark exists for these metrics, and we are aware of only one first naive approach [ 10 ] to estimate these metrics without access to labelled test data. In this paper, we propose a generalisation of two popular performance estimation techniques [ 4 , 7 ] , which allows us to go beyond accuracy and reliably estimate the full confusion matrix (i.e., true positives (tp), false positives (fp), true negatives (tn), and false negatives (fn)), and thus any counting metric (e.g., recall, PPV) as well as the multi-threshold area under the ROC curve (AUC). We then present a comprehensive benchmark for confidence-based performance estimation in chest x-ray data, predicting a range of clinically relevant performance metrics (see overview in Fig. 1 ). We study real-world distribution shifts as well as the effects of covariate and prevalence shifts, which are common in medical data and can impair the clinical translation of medical classification models. Figure 1 : Performance monitoring in a clinical setting. ( a ) An idealised, in-distribution scenario with labelled test data. ( b ) Our method for estimating metrics in the more realistic, out-of-distribution, unlabelled setting. 2 Background: performance estimation without labels We define a binary classification problem with targets y\in\{0,1\} , where models f(x) are trained on inputs \{(x_{i},y_{i})\}_{i=1}^{m}\sim\mathcal{D}_{\mathrm{train}} and validated on \mathcal{D}_{\mathrm{val}} , which is assumed to be in-distribution (i.d.) with respect to \mathcal{D}_{\mathrm{train}} . Predictions \widehat{y} are obtained by applying a decision threshold t\in[0,1] to the model’s sigmoid output \tilde{s}_{i}=\sigma(f(x_{i})) , which also represents the model’s positive class confidence score. To obtain the confidence in the predicted class, we set s_{i}=\mathbb{I}_{\{\tilde{s}_{i}\geq t\}}\,\tilde{s}_{i}+\mathbb{I}_{\{\tilde{s}_{i}<t\}}\,(1-\tilde{s}_{i}) . Our objective is to assess the model’s performance through metrics like accuracy, recall, PPV, and AUC on a previously unseen, potentially out-of-distribution (o.o.d.) dataset \{(x_{i},y_{i})\}_{i=1}^{n}\sim\mathcal{D}_{\mathrm{test}} , for which ground-truth labels are not available. Furthermore, we define the sets of positive and negative class predictions for distributions {d\in\{{\mathrm{val},\mathrm{test}}}\} as I^{+}_{d}=\{\tilde{s}_{i}\,|\,\tilde{s}_{i}\geq t,\,x_{i}\sim\mathcal{D}_{d}\} and I^{-}_{d}=\{1-\tilde{s}_{i}\,|\,\tilde{s}_{i}<t,\,x_{i}\sim\mathcal{D}_{d}\} with cardinalities n^{+}_{d} and n^{-}_{d} respectively. Confidence Based Performance Estimation (CBPE). A model is considered calibrated when its confidence score reflects the true probability of class 1; formally, P(Y=1|\tilde{S}=\tilde{s})=\tilde{s},\forall\,\tilde{s}\in[0,1] [ 14 ] . For calibrated models, accuracy can thus be estimated by the average confidence [ 9 , 15 ] \widehat{\text{acc}}_{\text{CBPE}}=\frac{1}{n}\sum_{i=1}^{n}s_{i}. This approach has recently been generalised for other counting metrics based on the confusion matrix [ 10 ] . CBPE builds on the observation that scores with \tilde{s}_{i}\geq t are either tp or fp, whereas scores with \tilde{s}_{i}<t are either tn or fn. Averaging the subsets I_{\text{test}}^{+} and I_{\text{test}}^{-} provides estimates for positive predictive value (PPV) and negative predictive value (NPV): \widehat{\text{PPV}}_{\text{CBPE}}=\mathbb{E}_{s\sim I_{\text{test}}^{+}}[s]\,,\,\,\ \widehat{\text{NPV}}_{\text{CBPE}}=\mathbb{E}_{s\sim I_{\text{test}}^{-}}[s]. (1) All counting metrics can then be estimated from the confusion matrix point estimates, which are derived from: \begin{split}\hat{\text{tp}}&=n^{+}_{\text{test}}\cdot\widehat{\text{PPV}},\,\,\,\,\,\hat{\text{fp}}=n^{+}_{\text{test}}-\hat{\text{tp}},\\ \hat{\text{tn}}&=n^{-}_{\text{test}}\cdot\widehat{\text{NPV}},\,\,\,\,\hat{\text{fn}}=n^{-}_{\text{test}}-\hat{\text{tn}}.\end{split} (2) Average Threshold Confidence (ATC). ATC [ 7 ] predicts the model accuracy on the test distribution \mathcal{D}_{\mathrm{test}} by computing the proportion of samples with scores s exceeding a learned threshold t_{\text{ATC}} . This threshold is determined on the validation set \mathcal{D}_{\mathrm{val}} such that the proportion of scores above t_{\text{ATC}} matches the empirical accuracy on \mathcal{D}_{\mathrm{val}} : \mathbb{E}_{x\sim\mathcal{D}_{\mathrm{val}}}[\mathbb{I}[s>t_{\text{ATC}}]]=\mathbb{E}_{(x,y)\sim\mathcal{D}_{\mathrm{val}}}[\mathbb{I}[\widehat{y}=y]]. The accuracy on \mathcal{D}_{\mathrm{test}} is then estimated as the fraction of test samples with confidence scores above the learned threshold t_{\text{ATC}} . Difference of Confidences (DoC). DoC [ 4 ] can be used as a confidence-based performance estimation method that estimates test accuracy via: \widehat{\text{acc}}_{\text{DoC}}=\text{acc}_{\text{val}}-\Delta;\quad\Delta=\mathbb{E}_{x\sim\mathcal{D}_{\mathrm{val}}}[s]-\mathbb{E}_{x\sim\mathcal{D}_{\mathrm{test}}}[s] (3) where \text{acc}_{\text{val}} is the observed accuracy in \mathcal{D}_{\mathrm{val}} . In other words, the scores on the test distribution are re-calibrated by the amount that the average validation confidence deviates from the validation accuracy. 3 Performance estimation beyond accuracy So far, estimating clinically relevant metrics beyond accuracy was only possible with the naive confidence-based CBPE. Here, we propose a method to extend ATC and DoC to estimate PPV (precision) and NPV. From these estimates, we can compute individual entries of the confusion matrix through Eq. ( 2 ), allowing us to then predict any counting metric from the confusion matrix estimators; for example, recall is estimated as \hat{\text{tp}}/(\hat{\text{tp}}+\hat{\text{fn}}) . To approximate the AUC, we evaluate the true-positive rate and false-positive rate at 100 decision thresholds based on score quantiles and then numerically integrate the resulting ROC curve. Confusion Matrix Estimation via Average Threshold Confidence (CM-ATC). To extend the ATC framework toward estimating elements of the confusion matrix, we build on an idea from a previously proposed variant of ATC [ 8 ] . They applied separate thresholds t_{\text{ATC}}^{+} to positive and t_{\text{ATC}}^{-} to negative predicted cases, learned on I_{\text{val}}^{+} and I_{\text{val}}^{-} , respectively. In [ 8 ] ,

Read the complete text