Investigating Label Bias and Representational Sources of Age-Related Disparities in Medical Segmentation

Aditya Parikh, Sneha Das, Aasa Feragen · 2025

Read Investigating Label Bias and Representational Sources of Age-Related Disparities in Medical Segmentation by Aditya Parikh, Sneha Das, Aasa Feragen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-00477.txt.

Introduction

Aditya Parikh, Sneha Das, and Aasa Feragen audit age bias in medical image segmentation, where models outline structures in scans. In breast cancer segmentation, models perform worse for younger patients, a gap usually blamed on denser breast tissue. The team audits the MAMA-MIA dataset and quantifies the bias in its automated labels, uncovering a biased ruler effect: flawed validation labels can misstate a model's true bias.

Controlled experiments then test where the bias comes from. It does not stem from label quality sensitivity, nor from an imbalance in case difficulty counts, and balancing training data by difficulty fails to close the gap. Younger cases appear intrinsically harder to learn. Training on biased machine-made labels teaches and amplifies the disparity, a warning for automated annotation pipelines.

Catalog record

CREATORAditya Parikh, Sneha Das, Aasa Feragen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE20 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-00477

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Investigating Label Bias and Representational Sources of Age-Related Disparities in Medical Segmentation Aditya Parikh, Sneha Das, Aasa Feragen Abstract Algorithmic bias in medical imaging can perpetuate health disparities, yet its causes remain poorly understood in segmentation tasks. While fairness has been extensively studied in classification, segmentation remains underexplored despite its clinical importance. In breast cancer segmentation, models exhibit significant performance disparities against younger patients, commonly attributed to physiological differences in breast density. We audit the MAMA-MIA dataset, establishing a quantitative baseline of age-related bias in its automated labels, and reveal a critical Biased Ruler effect where systematically flawed labels for validation misrepresent a model’s actual bias. However, whether this bias originates from lower-quality annotations (label bias) or from fundamentally more challenging image characteristics remains unclear. Through controlled experiments, we systematically refute hypotheses that the bias stems from label quality sensitivity or quantitative case difficulty imbalance. Balancing training data by difficulty fails to mitigate the disparity, revealing that younger patient cases are intrinsically harder to learn. We provide direct evidence that systemic bias is learned and amplified when training on biased, machine-generated labels, a critical finding for automated annotation pipelines. This work introduces a systematic framework for diagnosing algorithmic bias in medical segmentation and demonstrates that achieving fairness requires addressing qualitative distributional differences rather than merely balancing case counts. 1 1 1 Code for the experimental framework and evaluation is made available at https://(tobereleaseduponacceptance) † † address: DTU Compute, Technical University of Denmark 1 Introduction The integration of deep learning in medical imaging has shown potential for automating critical tasks like tumor segmentation, yet it carries substantial risk of inheriting and amplifying biases present in clinical data [ 1 , 2 ] . Algorithmic bias in healthcare is concerning and can perpetuate existing demographic disparities [ 3 ] . In breast cancer diagnostics, a well-documented challenge is that segmentation performance is often lower for younger patients [ 4 , 5 ] . This is commonly attributed to their higher breast density [ 6 ] , which can obscure tumor margins and complicate segmentation for both radiologists and automated systems. Meanwhile, fairness – the principle that a model should not systematically disadvantage certain patient subgroups – remains underexplored in segmentation, a task with direct implications for treatment planning and clinical decision-making. Figure 1: Inherent age-related bias in the Silver-Standard automated labels. An OLS regression reveals a positive correlation between patient age and segmentation performance (Dice Score), establishing a quantitative baseline of disparity. While the correlation between age and performance is established, its underlying reasons remain unclear. While higher segmentation difficulty due to higher breast density is a previously cited possible reason, there are other potential contributing factors. Performance disparities often come from representational bias , arising from differences in case distribution or intrinsic imaging characteristics across age groups [ 7 , 4 ] . This includes not only class imbalance and prevalence of challenging cases but also their qualitative nature. Factors like non-mass enhancement, irregular tumor morphology, or variable presentation patterns that may be more prevalent in younger women make them systematically harder for the model to learn [ 8 , 9 ] . Another potential reason is label bias – where the ground truth annotations for younger patients are systematically less accurate due to the inherent difficulty of manual segmentation. If the annotations have lower quality in younger subjects, then our ability to measure performance is also lower in the very same subjects. Differentiating between the causes and sources of bias is critical for developing effective fairness interventions. To date, label bias has remained an unrecognised and unquantified source of bias in image segmentation. As segmentation benchmarks and even datasets used in real systems are often created using semi- or fully-automatic tools (e.g., ISIC Challenge datasets [ 10 ] , FreeSurfer for neuroimaging [ 11 ] , nnU-Net-based annotations [ 12 , 13 , 14 ] ), we have every reason to assume that segmentation labels can have systematic biases. It is known from classification tasks that this gives a biased ruler effect, where we are unable to effectively measure and mitigate bias. In this paper, we therefore let machine-generated labels from a pre-existing system serve as a methodological probe to measure a model’s apparent performance compared to its real performance. This allows us to quantify the impact of using a flawed, real-world benchmark. In this paper, we thus present a systematic analysis designed to disentangle the potential sources of bias in image segmentation through a series of controlled experiments on the MAMA-MIA dataset [ 14 ] , a large-scale dataset of breast cancer MRI images. Our contributions are: (i) A first comprehensive fairness audit of the MAMA-MIA dataset , establishing a quantitative baseline of the age-related bias present in its automated labels; (ii) To the best of our knowledge, the first study of label bias and its effect on bias audit in image segmentation ; (iii) A framework of controlled experiments designed to isolate the effects of label bias from representational bias ; (iv) Direct quantitative evidence of bias amplification, demonstrating how systemic bias is learned and propagated through machine learning pipelines. 2 Methodology 2.1 Dataset The MAMA-MIA dataset [ 14 ] is a large, publicly available multi-center breast cancer benchmark of dynamic contrast-enhanced magnetic resonance images (DCE-MRI). It comprises 1,506 unique patient cases, each including volumetric imaging data, rich demographic metadata, and a pair of segmentation masks: An expert-annotated mask and a mask automatically generated by a standard nnU-Net framework [ 12 ] trained on an external dataset, including resampling to a target isotropic voxel spacing of [1.0\times 1.0\times 1.0mm] and Z-score intensity normalization. For our experiments, we utilize the second T1-weighted, post-contrast phase as 3D volumetric input for all models. The patient age was stratified into three distinct age cohorts: Young ( \leq 40 , n=349 ), Middle ( 40-55 , n=754 ), and Older ( \geq 55 , n=400 ), based on established clinical relevance in breast cancer diagnostics [ 15 ] . Evaluation Benchmarks: We use both types of masks as validation labels: The term Gold-Standard Labels is used to refer to expert-annotated labels, created by 16 expert radiologists. As these are likely the least affected by image quality biases, we regard these as ground truth, used as a definitive benchmark for measuring a model’s true performance . Silver-Standard Labels are the automated nnU-Net masks. Note that these resemble the semi- or fully-automatic annotations often found in real-world segmentation datasets, and are therefore a realistic assumption of what segmentation labels frequently look like. The silver-standard labels include dual-expert qualitative ratings (Good, Acceptable, Poor, Missed) assessing their visual quality. Case Difficulty Stratification: To analyze label quality and case difficulty, we stratify cases into four tiers combining dual-expert ratings with silver-standard metrics (Dice, HD95) as summarized in Table 1 . This approach provides a proxy that captures both clinical utility and geometric precision. Tier Criteria Difficulty Tier 1 Both experts rate “Good” AND (Unambiguously Good) (Dice \geq 0.80 & HD95 \leq 10) Easy Tier 1.5 Both experts rate “Good” BUT (Expert-Metric Mismatch) (Dice < 0.80 OR HD95 > 10) Tier 2 Any case with “Acceptable” (Clinically Acceptable) ratings OR expert disagreement Hard Tier 3 Both experts rate “Poor”

Read the complete text