Improving the generalization of deep learning models in the segmentation of mammography images

Jan Hurtado, João P. Maia, Cesar A. Sierra-Franco, Alberto Raposo · 2025

Read Improving the generalization of deep learning models in the segmentation of mammography images by Jan Hurtado, João P. Maia, Cesar A. Sierra-Franco, Alberto Raposo (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-22052.txt.

Introduction

Jan Hurtado and co-authors published a computing paper in 2025 on making breast scan segmentation models work across scanner brands. Mammography is the main screening tool for early breast cancer, and marking landmark structures aids risk judgment and image quality checks. Models often fail on images from other vendors. The team offers data-centered tricks to widen training variety.

Their augmentations reshape image intensity under annotation guidance and transfer style between images. Applied in balance, the tricks teach the model varied vendor looks while keeping skill on original data. Wide tests on a large mixed-vendor dataset show better generalization than standard training. The authors also chart where the methods help and where they strain.

Catalog record

CREATORJan Hurtado, João P. Maia, Cesar A. Sierra-Franco, Alberto Raposo
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-22052

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Improving the generalization of deep learning models in the segmentation of mammography images Jan Hurtado, João P. Maia, Cesar A. Sierra-Franco, Alberto Raposo Abstract Mammography stands as the main screening method for detecting breast cancer early, enhancing treatment success rates. The segmentation of landmark structures in mammography images can aid the medical assessment in the evaluation of cancer risk and the image acquisition adequacy. We introduce a series of data-centric strategies aimed at enriching the training data for deep learning-based segmentation of landmark structures. Our approach involves augmenting the training samples through annotation-guided image intensity manipulation and style transfer to achieve better generalization than standard training procedures. These augmentations are applied in a balanced manner to ensure the model learns to process a diverse range of images generated by different vendor equipments while retaining its efficacy on the original data. We present extensive numerical and visual results that demonstrate the superior generalization capabilities of our methods when compared to the standard training. For this evaluation, we consider a large dataset that includes mammography images generated by different vendor equipments. Further, we present complementary results that show both the strengths and limitations of our methods across various scenarios. The accuracy and robustness demonstrated in the experiments suggest that our method is well-suited for integration into clinical practice. keywords mammography image, image segmentation, deep learning, generalization, data augmentation † † equal-contributors: These authors contributed equally to this work. † † equal-contributors: These authors contributed equally to this work. † † equal-contributors: These authors contributed equally to this work. Manuscript number of words: 10270. Abstract number of words: 192. Number of figures: 13. Number of tables: 12. 1 Introduction Mammography involves utilizing low-dose x-ray technology to examine the breast, making it one of the most effective screening methods in use today. Regular mammographies are vital for early detection of breast cancer, greatly enhancing the likelihood of successful treatment. While there are various types of mammography, the most prevalent method is the digital mammography, known for generating easily manipulable high-quality 2D digital images. These images comprise two primary views applied to both breasts, known as Medio-Lateral Oblique (MLO) and Cranio-Caudal (CC), which enable healthcare professionals comprehensive analysis from multiple angles. Accurately identifying health conditions within digital mammography images can be influenced by factors such as interpreter expertise, acquisition quality, and patient’s anatomy. Therefore, providing software assistants can support image interpretation and medical assessment, alleviating the challenges posed by these factors. Several methods were proposed in the literature for this support, mostly focusing on the detection of abnormalities, the estimation of breast density, and the prediction of cancer risk. However, one of the most critical applications involves the estimation of anatomical landmark structures Sierra-Franco et al. (2024) , such as the nipple, pectoral muscle, fibroglandular tissue, and fatty tissue. The correct identification of these structures and their extent in the image is essential for categorizing the risk of abnormalities and evaluating image acquisition adequacy. The estimation of the pectoral muscle is essential for aiding in the assessment of potential abnormalities and the image acquisition correctness. Some deep learning-based methods were proposed to segment the pectoral muscle contour in the MLO view, which is enough for supporting image adequacy assessment Rampun et al. (2019) ; Soleimani and Michailovich (2020) . For the full pectoral muscle shape segmentation, some approaches considered U-Net architectures Ali et al. (2020) ; Rubio and Montiel (2021) , generative adversarial networks Guo et al. (2020) , attention mechanisms Yu et al. (2022) , and domain-oriented augmentation operations to achieve better generalization Verboom et al. (2024) . The nipple constitutes another important landmark structure, facilitating the registration of multiple views or modalities by enabling efficient region matching and anatomical measurements. Most of the proposed methods for nipple estimation are hand-crafted, involving the analysis of breast boundary Yin et al. (1994) ; Méndez et al. (1996) ; Chandrasekhar and Attikiouzel (1997) ; Mustra et al. (2009) , texture Casti et al. (2013) , and convergence of fibroglandular tissue Zhou et al. (2004) ; Kinoshita et al. (2008) . Some data-driven methods were proposed to estimate the nipple position, considering random forest classifiers Jiang et al. (2019) and deep neural networks Lin et al. (2019) . The fibroglandular tissue represents a critical area of concern warranting specific attention during medical assessments. Depending on the patient’s unique anatomy, this tissue can exhibit varying characteristics, ranging from dense formations to more dispersed patterns, with higher density correlating to increased risk. Numerous methodologies have been proposed in the existing literature for segmenting dense fibroglandular tissue regions He et al. (2015) , encompassing both handcrafted Matsubara et al. (2001) ; El-Zaart (2010) ; Torres et al. (2019) and data-driven methods Saffari et al. (2020) ; Larroza et al. (2022) ; Hu et al. (2022) . Several methodologies aim to integrate the segmentation of various landmark structures within a unified framework. Tiryaki et al. conduct experiments employing multiple U-Net-based models to segment the pectoral muscle, dense fibroglandular tissue regions, and fatty tissues Tiryaki and Kaplanoğlu (2022) . In a similar way, considering these structures and incorporating the nipple, Dubrovina et al. introduce a novel deep learning-based framework for comprehensive segmentation tasks Dubrovina et al. (2018) . By leveraging multiple deep learning models, Bou demonstrates segmentation results encompassing more intricate structures, including vessels, calcifications, and skin, among others Bou (2019) . In a recent study, Sierra-Franco et al. Sierra-Franco et al. (2024) introduced a large dataset alongside deep learning experiments for the segmentation of mammography images, encompassing both MLO and CC views. The study highlights four primary structures of interest in both views: nipple, pectoral muscle, fibroglandular tissue, and fatty tissue. We propose a data-centric approach for the improvement of the generalization of the solution introduced in this work on the processing of mammography images generated by different vendor equipments. In this paper, we propose a set of data-centric strategies to achieve better generalization on the processing of mammography images acquired using different vendor equipment. More precisely, we introduce augmentation procedures based on image intensity manipulation and style-transfer methods, incorporating samples during training that enable the model to learn from diverse hypothetical domains. We present extensive numerical and visual results on analyzing the reference method, i.e. Sierra-Franco et al. (2024) , and highlighting the benefits of the proposed strategies. These results demonstrate the promising potential of our strategies, making them strong candidates for integration into clinical practice. 2 Materials and Methods 2.1 Datasets In this paper, our primary focus is on utilizing MLO view digital mammography images sourced from two distinct datasets: the private dataset introduced in Sierra-Franco et al. (2024) , and the VinDr-Mammo dataset introduced in Nguyen et al. (2023) . More precisely, we compose four different datasets, each one representing a different vendor of mammography equipment. These datasets are named as GE, IMS, PLANMED, and HOLOGIC, containing MLO view mammography images generated by equipments of the General Electric, IMS Giotto, Planmed Oy, and Hologic vendors, respectively. The main purpose of these datasets is image segmentation, and they include annotations for four major structures of interest: the nipple, pectoral muscle, fibroglandular tissue, and fatty tissue. A team of eight annotators received training from two clinical experts to identify and

Read the complete text