Budget-Aware Uncertainty for Radiotherapy Segmentation QA Using nnU-Net

Ricardo Coimbra Brioso 1 , Lorenzo Mondo 1 , Damiano Dei 2 3 , Nicola Lambri 2 3 , Pietro Mancosu 3 , Marta Scorsetti 2 3 , and Daniele Loiacono 1 · 2026

Read Budget-Aware Uncertainty for Radiotherapy Segmentation QA Using nnU-Net by Ricardo Coimbra Brioso 1 , Lorenzo Mondo 1 , Damiano Dei 2 3 , Nicola Lambri 2 3 , Pietro Mancosu 3 , Marta Scorsetti 2 3 , and Daniele Loiacono 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-11798.txt.

Introduction

Brioso and six colleagues build a budget-aware quality check for auto-segmentation in radiotherapy, using nnU-Net. Their maps show, voxel by voxel, where the model is unsure, so reviewers can focus manual checks where they matter most. They test four ways to gauge and tune that doubt on total marrow and lymph node cases. Tuning with temperature scaling sharpens calibration most, and tuned checkpoint-based runs best match doubt to real errors.

Catalog record

CREATORRicardo Coimbra Brioso 1 , Lorenzo Mondo 1 , Damiano Dei 2 3 , Nicola Lambri 2 3 , Pietro Mancosu 3 , Marta Scorsetti 2 3 , and Daniele Loiacono 1
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36795
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.11798

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Budget-Aware Uncertainty for Radiotherapy Segmentation QA Using nnU-Net Ricardo Coimbra Brioso 1 , Lorenzo Mondo 1 , Damiano Dei 2 3 , Nicola Lambri 2 3 , Pietro Mancosu 3 , Marta Scorsetti 2 3 , and Daniele Loiacono 1 Abstract Accurate delineation of the Clinical Target Volume (CTV) is essential for radiotherapy planning, yet remains time-consuming and difficult to assess, especially for complex treatments such as Total Marrow and Lymph Node Irradiation (TMLI). While deep learning–based auto-segmentation can reduce workload, safe clinical deployment requires reliable cues indicating where models may be wrong. In this work, we propose a budget-aware uncertainty-driven quality assurance (QA) framework built on nnU-Net, combining uncertainty quantification and post-hoc calibration to produce voxel-wise uncertainty maps (based on predictive entropy) that can guide targeted manual review. We compare temperature scaling (TS), deep ensembles (DE), checkpoint ensembles (CE), and test-time augmentation (TTA), evaluated both individually and in combination on TMLI as a representative use case. Reliability is assessed through ROI-masked calibration metrics and uncertainty–error alignment under realistic revision constraints, summarized as AUC over the top 0–5% most uncertain voxels. Across configurations, segmentation accuracy remains stable, whereas TS substantially improves calibration. Uncertainty–error alignment improves most with calibrated checkpoint-based inference, leading to uncertainty maps that highlight more consistently regions requiring manual edits. Overall, integrating calibration with efficient ensembling seems a promising strategy to implement a budget-aware QA workflow for radiotherapy segmentation. I Introduction Radiotherapy is used in more than 50% of cancer patients, as a primary treatment or within multimodal care [ 3 ] . Treatment planning requires delineating the Clinical Target Volume (CTV) and organs at risk (OARs) on CT to deliver ionizing radiation dose to the target while sparing healthy tissues, a process that remains time-consuming and error-prone. Over the last decade, deep learning (DL) has enabled accurate automatic contouring for many common structures [ 13 , 7 , 25 ] ; however, clinical adoption is still limited for complex targets , where reliability and interpretability are as critical as average segmentation accuracy. This limitation is particularly evident in Total Marrow and Lymph Node Irradiation (TMLI) [ 31 ] , where targets are large, spatially extended, and heterogeneous (e.g., marrow compartments and lymph-node chains). In this setting, clinically relevant errors can be subtle yet consequential: omissions may lead to underdosage and risk of recurrence, while over-contouring can increase widespread toxicity due to the large treated volume. Although automatic segmentation can reduce workload, full-body CT scans span hundreds of slices and multiple anatomical regions, making uniform and exhaustive manual verification unrealistic within routine clinical constraints. Therefore, the key practical question becomes how to prioritize review towards regions where the model is most likely wrong. Compared to OARs, complex targets such as CTVs often present weaker and ambiguous boundaries on CT, higher inter-patient variability, and greater inter-observer disagreement; as a result, a model may output seemingly confident contours even when clinically relevant regions are missed [ 28 , 10 ] . Uncertainty quantification (UQ) can mitigate this trust gap by associating each voxel prediction with a confidence estimate and visualizing it as an uncertainty map. Yet, many UQ works in medical segmentation emphasize global calibration and scoring rules (e.g., NLL/Brier/ECE) without assessing whether uncertainty is spatially actionable for quality assurance (QA), i.e., whether it highlights true errors under realistic, budget-limited review. In addition, computationally expensive choices (e.g., deep ensembles) are often used as references without a systematic comparison against practical alternatives (e.g., checkpoint ensembles, test-time augmentation) within the same QA objective. In this work, we aim at investigating whether combining complementary UQ strategies with post-hoc calibration yields uncertainty maps that better align with segmentation errors and therefore better support clinical QA. Building on a strong nnU-Net baseline for TMLI target segmentation [ 14 , 2 ] , we compare a single segmentation model, deep ensembles, and checkpoint ensembles, each optionally combined with test-time augmentation and temperature scaling, and we produce predictive-entropy maps to guide review. To evaluate clinical utility, we introduce ROI-masked, budget-based uncertainty–error alignment analyses over constrained uncertain-volume budgets, and we illustrate how threshold/budget operating points can generate uncertainty overlays that qualitatively match clinician corrections and enable progressive, time-aware inspection. II Related Work II-A Deep learning for complex target delineation in radiotherapy DL is increasingly adopted for auto-contouring in RT, with benefits in efficiency and contour consistency, especially for organs-at-risk (OARs) [ 33 , 12 ] . Isensee et al. [ 14 ] introduced the nnU-Net framework, which has enabled robust 3D segmentation pipelines and large-scale RT auto-contouring systems [ 26 , 8 , 30 ] . Despite the proliferation of architectural variants, Isensee et al. showed that nnU-Net remains highly competitive when assessed under rigorous validation protocols, supporting its broad adoption as a reliable baseline [ 15 ] . However, clinical target volumes (CTV), especially complex ones like lymphatic targets (CTV LN ), remain more challenging than OARs. Sharp et al. [ 24 ] discussed how guideline-driven definitions and limited image contrast increase inter-/intra-observer variability and create local failure modes that require careful manual review, while Kalantar et al. [ 18 ] highlighted the impact of anatomical variability and ambiguous boundaries on pelvic target delineation. In TMLI, Wong et al. introduced targeted marrow/lymphoid irradiation as an alternative to conventional TBI, and Mancosu et al. reviewed its technological and clinical development, emphasizing the practical challenges of large-field target definition [ 32 , 31 ] . Dei et al. [ 9 ] showed that internal contouring guidelines can reduce variability for lymph node targets in TMLI, underscoring both the complexity of CTV LN and the value of protocol-driven standardization. II-B Uncertainty quantification and visualization for clinical review Reliable clinical deployment requires signals of when and where a model may fail. Guo et al. [ 11 ] demonstrated that modern neural networks are often miscalibrated and proposed temperature scaling as a simple post-hoc calibration method. Mehrtash et al. [ 21 ] and Jungo et al. [ 16 ] analyzed calibration and predictive uncertainty in medical image segmentation, noting that voxel-wise uncertainty can be noisy and that subject-level reliability may degrade even when dataset-level calibration appears acceptable. UQ methods include epistemic approximations via deep ensembles [ 19 ] and efficient posterior sampling such as checkpoint ensembles [ 34 ] . Wang et al. [ 29 ] used test-time augmentation (TTA) to probe input-related ambiguity via prediction variability, while Baumgartner et al. [ 4 ] introduced PHiSeg to model multiple plausible segmentations in ambiguous settings. At the evaluation level, Wahid et al. [ 28 ] reviewed UQ in RT and noted that head-to-head comparisons and calibration are still relatively uncommon, and Kahl et al. [ 17 ] proposed ValUES to systematize validation across downstream tasks and emphasize the role of ablations and score aggregation. Clinical usefulness depends on intuitive visualization and actionable summaries. De Biase et al. [ 6 ] designed and assessed a GUI for tumor probability maps, reporting that radiation oncologists (ROs) value threshold sliders and controls to suppress low-importance values without discarding information. Rodríguez Outeiral et al. [ 22 ] proposed score-based QA metrics for review triage, and De Biase et al. [ 5 ] showed that uncertainty/probability-map statistics can correlate with accuracy in external cohorts. Maruccio et al. [

Read the complete text