Conditional Conformal Risk Adaptation
Rui Luo, Zhixin Zhou · 2025
Read Conditional Conformal Risk Adaptation by Rui Luo, Zhixin Zhou (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-07611.txt.
Introduction
A medical image model can be right on average yet dangerously wrong on some patients, missing disease in a subset of scans. Rui Luo and Zhixin Zhou tackle that unevenness in a 2025 paper on uncertainty for image segmentation. Their method, conformal risk adaptation, builds a new score so that prediction sets adjust per image, aiming to keep the miss rate steady across cases.
They prove a fresh link between risk control and classic prediction theory, and add a calibration step for the poorly scaled probabilities segmentation models produce. On polyp segmentation tests, their variants held valid overall risk while spreading errors far more evenly across images.
Catalog record
| CREATOR | Rui Luo, Zhixin Zhou |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-07611
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Conditional Conformal Risk Adaptation Rui Luo, Zhixin Zhou Abstract Uncertainty quantification is becoming increasingly important in image segmentation, especially for high-stakes applications like medical imaging. While conformal risk control generalizes conformal prediction beyond standard miscoverage to handle various loss functions such as false negative rate, its application to segmentation often yields inadequate conditional risk control—some images experience very high false negative rates while others have negligibly small ones. We develop Conformal Risk Adaptation (CRA), which introduces a new score function for creating adaptive prediction sets that significantly improve conditional risk control for segmentation tasks. We establish a novel theoretical framework that demonstrates a fundamental connection between conformal risk control and conformal prediction through a weighted quantile approach, applicable to any score function. To address the challenge of poorly calibrated probabilities in segmentation models, we introduce a specialized probability calibration framework that enhances the reliability of pixel-wise inclusion estimates. Using these calibrated probabilities, we propose Calibrated Conformal Risk Adaptation (CCRA) and a stratified variant (CCRA-S) that partitions images based on their characteristics and applies group-specific thresholds to further enhance conditional risk control. Our experiments on polyp segmentation demonstrate that all three methods—CRA, CCRA, and CCRA-S—provide valid marginal risk control and deliver more consistent conditional risk control across diverse images compared to standard approaches, offering a principled approach to uncertainty quantification that is particularly valuable for high-stakes and personalized segmentation applications. 1 Introduction Image segmentation is a fundamental computer vision task with critical applications in medical diagnostics, autonomous driving, and remote sensing. While deep learning has significantly advanced segmentation performance, reliable uncertainty quantification remains challenging but essential for safety-critical applications. Traditional evaluation metrics like Dice or IoU provide overall performance measures but fail to offer instance-wise reliability guarantees. Conformal prediction (CP) has emerged as a powerful framework for providing distribution-free uncertainty quantification with finite-sample guarantees. It constructs prediction regions that contain the true label with a user-specified probability, regardless of the underlying data distribution. Recent work on conformal risk control (CRC) [ 1 ] has extended this framework to handle more complex performance metrics beyond simple miscoverage, including controlling the false negative rate in segmentation tasks. However, image segmentation presents distinct challenges when applying CRC: 1. Weak conditional risk control : While CRC guarantees marginal risk control across the dataset, the conditional risk can vary substantially between individual images. Existing CRC approaches cannot adequately address this image-specific variability. 2. Dependence on accurate probability estimates : CRC’s effectiveness relies heavily on well-calibrated prediction probabilities. Image segmentation models often produce poorly calibrated confidence estimates, resulting in suboptimal prediction sets that fail to satisfy the intended risk constraints. In this paper, we first establish a fundamental connection between conformal risk control and conformal prediction through a weighted quantile approach. This connection not only provides theoretical insights but also leads to improved conditional guarantees. Building on this foundation, we make the following contributions: 1. We propose a weighted quantile formulation that enables better conditional risk control across different image characteristics. This approach can be applied to any general score functions for risk control while maintaining the theoretical guarantees of conformal prediction. 2. We develop Conformal Risk Adaptation (CRA), a novel segmentation score function derived from adaptive prediction sets in conformal classification. This score function allows prediction sets to adapt to the underlying confidence distribution of each image, further enhancing conditional risk control. 3. To further reduce the gap between the conditional risk and the desired control level, we introduce a comprehensive calibration framework that combines probability calibration with stratified calibration strategies inspired by group conditional conformal prediction. This integrated approach improves the reliability of pixel-wise inclusion probabilities and reduces absolute error in coverage across varying image characteristics, resulting in more consistent conditional risk control. Our comprehensive experiments on both medical and natural image segmentation tasks demonstrate that our method provides valid risk control with significantly improved conditional guarantees compared to existing approaches. 2 Related Work 2.1 Conformal Risk Control Conformal prediction, introduced by Vovk et al . [ 2 ] , provides distribution-free uncertainty quantification with finite-sample guarantees. The split conformal prediction variant [ 3 ] has gained popularity due to its computational efficiency. This methodology has been widely applied in classification [ 4 ] , regression tasks [ 5 ] , and can be adapted to diverse real-world scenarios, such as games [ 6 ] . Recent work has extended conformal prediction to control a range of risk metrics beyond miscoverage [ 1 , 7 ] . Angelopoulos et al . [ 1 ] introduced Conformal Risk Control (CRC), which guarantees that the expected value of any monotone loss function (e.g., false negative rates in segmentation) is bounded by a user-specified tolerance. Additionally, Luo et al . [ 8 ] introduced entropy-based techniques to enhance the reliability of conformal methods. To prevent the average interval length of the consistency set from inflating due to the use of identical scalars, Teneggi et al . [ 9 ] proposed assigning each pixel to one of K groups that share some statistical data and ensuring risk control through a convex surrogate loss. However, this approach may fail in the presence of pixel-level semantic inconsistencies, such as in CT imaging with significant anatomical variations. To address this, Teneggi et al . [ 10 ] introduced sem-CRC, which leverages state-of-the-art segmentation models (U-Net [ 11 ] , nnU-Net [ 12 ] ) and calibrates uncertainty intervals separately for each semantic group, thereby achieving more stringent clinically relevant risk control. For structured data applications, Luo et al . [ 13 ] developed anomaly detection methods for graph-based scenarios, extending conformal false positive rate guarantees to network data. In addition, Bereska et al . [ 14 ] introduced Spatially-Aware Conformal Prediction (SACP), which explicitly takes into account the distance from critical structures by incorporating a locally adaptive inconsistency score, thereby achieving more conservative uncertainty estimation near key anatomical interfaces (such as tumor-vessel boundaries). Argaw et al . [ 15 ] investigated heterogeneous effects in randomized clinical trials and employed joint confidence intervals derived from conformal quantile regression for prediction. He et al . [ 16 ] proposed a training-aware conformal risk control method that integrates conformal risk control with conformal training, incorporating domain-specific decision thresholds and clinical risk functions into the uncertainty estimation framework. By focusing on both accuracy and uncertainty quantification during the training process, their method achieves high sensitivity and specificity while reducing the workload of the quality assurance process. Similarly, Luo et al . [ 17 ] advanced conformal methods for multi-output regression settings. Together, these advances move from global, fixed-group strategies to adaptive methods that align uncertainty quantification with underlying image semantics and spatial context, making conformal risk control increasingly practical for real-world clinical applications and other domains such as graph-based applications [ 18 ] . 2.2 Conditional Conformal Prediction Although conformal methods guarantee marginal coverage, in high-stakes decision-making areas such as healthcare [ 19 ] , radiation therapy [ 16 ] , and drug affinity [ 20 ] , marginal guarantees are insufficient–significant disparities in coverage across relevant subpopulations may persist. An effective remedy is to target conditional coverage. However, without distributional assumptions, achieving conditional coverage–that is, ensuring prediction sets attain the desired coverage for every possible