Towards Trustworthy Breast Tumor Segmentation in Ultrasound using Monte Carlo Dropout and Deep Ensembles for Epistemic Uncertainty Estimation

Toufiq Musah, Chinasa Kalaiwo, Maimoona Akram, Ubaida Napari Abdulai, Maruf Adewole, Farouk Dako, Adaobi Chiazor Emegoakor, Udunna C. Anazodo, Prince Ebenezer Adjei, Confidence Raymond · 2025

Read Towards Trustworthy Breast Tumor Segmentation in Ultrasound using Monte Carlo Dropout and Deep Ensembles for Epistemic Uncertainty Estimation by Toufiq Musah, Chinasa Kalaiwo, Maimoona Akram, Ubaida Napari Abdulai, Maruf Adewole, Farouk Dako, Adaobi Chiazor Emegoakor, Udunna C. Anazodo, Prince Ebenezer Adjei, Confidence Raymond (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-17768.txt.

Introduction

Ten authors led by Toufiq Musah make breast scan tumour outlines that own up to their own doubt. Lump edges in ultrasound are fuzzy, and sets fed to past tools held twin copies that skewed grades. Their net, a tweaked U build, first had its set de-twinned for fair marks. Doubt was then read three ways: drop-out dice rolls, team votes, and both at once.

Top lump marks landed on one fresh set in home tests of the build. Doubt maps lit up where the net felt weak, a guide for a second human read. On far sets the marks fell and doubt rose, as true field use would show. Trust, not just edge skill, is the bar they set for ward tools.

Catalog record

CREATORToufiq Musah, Chinasa Kalaiwo, Maimoona Akram, Ubaida Napari Abdulai, Maruf Adewole, Farouk Dako, Adaobi Chiazor Emegoakor, Udunna C. Anazodo, Prince Ebenezer Adjei, Confidence Raymond
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE17 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-17768

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Towards Trustworthy Breast Tumor Segmentation in Ultrasound using Monte Carlo Dropout and Deep Ensembles for Epistemic Uncertainty Estimation Toufiq Musah, Chinasa Kalaiwo, Maimoona Akram, Ubaida Napari Abdulai, Maruf Adewole, Farouk Dako, Adaobi Chiazor Emegoakor, Udunna C. Anazodo, Prince Ebenezer Adjei, Confidence Raymond Abstract Automated segmentation of BUS images is important for precise lesion delineation and tumor characterization, but is challenged by inherent artifacts and dataset inconsistencies. In this work, we evaluate the use of a modified Residual Encoder U-Net for breast ultrasound segmentation, with a focus on uncertainty quantification. We identify and correct for data duplication in the BUSI dataset, and use a deduplicated subset for more reliable estimates of generalization performance. Epistemic uncertainty is quantified using Monte Carlo dropout, deep ensembles, and their combination. Models are benchmarked on both in-distribution and out-of-distribution datasets to demonstrate how they generalize to unseen cross-domain data. Our approach achieves state-of-the-art segmentation accuracy on the Breast-Lesion-USG dataset with in-distribution validation, and provides calibrated uncertainty estimates that effectively signal regions of low model confidence. Performance declines and increased uncertainty observed in out-of-distribution evaluation highlight the persistent challenge of domain shift in medical imaging, and the importance of integrated uncertainty modeling for trustworthy clinical deployment. 1 1 1 Code available at: https://github.com/toufiqmusah/caladan-mama-mia.git 1 Introduction Breast tumors are masses resulting from abnormal cellular proliferation within breast tissues, encompassing a broad range of pathologies, the most clinically significant of which is breast cancer. Breast cancer remains highly prevalent, and was reported as the most common cancer among females in 157 out of 185 countries [ 1 ] , resulting in approximately 670,000 deaths in 2021, with projections indicating a constant increase in cases past 2050, especially impacting low- and middle-income regions of the world [ 2 ] . Early detection and accurate diagnosis are fundamental strategies for improving survival outcomes [ 3 , 4 ] . Multiple medical imaging techniques are employed in the detection and diagnosis of breast cancers, including mammography, breast ultrasonography (BUS), and magnetic resonance imaging (MRI). Breast ultrasonography serves as an essential complement to mammography, as it is particularly valuable for early scanning, follow-ups, and treatment monitoring [ 5 , 6 ] . It offers several practical advantages, including real-time imaging without exposure to ionizing radiation, suitability for repeated examinations, and particular effectiveness in imaging dense breast tissue commonly found in younger populations. It plays a central role in clinical workflows, especially in low- and middle-income settings where mammography or MRI may be inaccessible [ 5 ] . Accurate segmentation aids in reporting tumor features with BI-RADS [ 7 ] , and clinical decision-making by improving lesion characterization, radiation therapy planning, response monitoring, and surgical preparation [ 8 , 9 , 10 ] . Though ultrasound-based segmentation faces notable challenges due to inherent imaging artifacts, including low contrast, speckle noise, blurred lesion boundaries, and significant operator dependence. The diverse morphological presentation of breast tumors and limitations arising from inadequate and imbalanced datasets further complicate downstream tasks including segmentation [ 11 ] . In this body of work, we explore the use of deep learning methods in the segmentation of breast ultrasound images, and further estimate the uncertainty in model predictions using various combinations of epistemic methods. The widely used Breast Ultrasound Images (BUSI) dataset is shown to have unreliable segmentation performance due to data duplication and inconsistent annotations across the same subject images, resulting in data leakage between training and validation sets. Epistemic uncertainty is estimated via Bayesian inference approximation using Monte Carlo dropout, followed by deep ensembling. We also experiment with a combined Monte Carlo dropout–deep ensembling approach. These methods are evaluated on an out-of-distribution test set to emulate real-world deployment scenarios. 2 Related Works The paradigm shifted with encoder–decoder deep neural network architectures such as U-Net [ 12 ] and its improved variants, including UNet++ [ 13 ] and Attention - UNet [ 14 ] , which significantly advanced segmentation accuracy and robustness in breast ultrasound segmentation [ 15 , 16 , 17 ] . Recent innovations include AAU - Net [ 18 ] , HCTNet [ 19 ] , and LightBTSeg [ 20 ] . Despite these advances, most methods focus on in-distribution data without robust cross-domain validation. Epistemic uncertainty can be approximated via MC dropout [ 21 ] or deep ensembles [ 22 ] . Combining these approaches produces well-calibrated uncertainty maps aligned with areas of anatomical ambiguity [ 23 ] . In a study by Marisa et al. [ 24 ] , epistemic uncertainty was quantified in the classification of breast tumor sub-types, exploring approximated Bayesian inference in MC dropout, and deep ensembles. These models produce coherent uncertainty estimates across anatomical regions or entire structures, enabling more meaningful confidence assessment along boundaries and complex areas. Such structured uncertainty frameworks improve interpretability, and can better support clinical decision-making where trustworthiness is necessary. 3 Methods 3.1 Dataset Figure 1: (a) Sample cases with duplicate masks from the training and validation sets. ( Annotator-1 - Red | Annotator-2 - Blue | Overlap - Magenta) (b) Sample cases from the out-of-distribution testing dataset This study utilizes two datasets; the Breast UltraSound Images (BUSI) (Fig. 1 (a)) dataset [ 25 ] for model training and validation, and the Breast-Lesions-USG dataset [ 26 ] (Fig. 1 (b)) for out-of-distribution testing and uncertainty quantification. This is to enable both in-distribution performance assessment and evaluation of model generalizability. The original BUSI dataset contained several discrepancies identified by [ 27 ] , such as duplicated images, and the inadvertent inclusion of non-breast images (maxilla ultrasound scans), which were not explicitly stated in the dataset publication [ 25 ] . We further note that the duplicated sets were of varying annotations, which led us to systematically deduplicate the dataset in three distinct ways: 1. BUSI-A1: Removed the first occurrence of each duplicate pair. 2. BUSI-A2: Removed the second occurrence of each duplicate pair. 3. BUSI-A3: Retained the duplicate deemed most accurate by a radiologist. 3.2 Modelling We employ a modified Residual Encoder U-Net with dropout layers, trained with the nnUNet framework [ 28 ] . It follows an identical setup as described in previous work [ 29 ] including 8 encoder stages and 7 decoder stages with increasing feature sizes per stage. A typical residual block in the modified setup comprises 6 layers; Conv2D\rightarrow Dropout\rightarrow InstanceNorm\rightarrow LeakyReLU\rightarrow Conv2D\rightarrow InstanceNorm The models were trained with deep supervision and optimized using stochastic gradient descent with a batch dice loss. We used a patch size of 512\times 512 for the input of 2D breast ultrasound images, and a batch size of 13. By default, we train all folds for 250 epochs, and further train BUSI-A3 for another 750 epochs before applying it on the test dataset for out-of-distribution evaluation. 3.3 Uncertainty Estimation We quantify uncertainty using three complementary methods: Monte Carlo (MC) dropout, Deep Ensembles, and a combined Deep Ensemble-MC dropout approach. MC Dropout Estimates epistemic uncertainty via multiple stochastic forward passes with dropout active at inference [ 21 ] . For input x , predictions are averaged as: p(y|x)\approx\frac{1}{T}\sum_{t=1}^{T}f_{\theta_{t}}(x), where f_{\theta_{t}}(x) is the prediction with dropped weights at iteration t . Uncertainty is the variance across these predictions. Deep Ensembles Aggregate predictions from K independently trained models [ 22 ] :

Read the complete text