Worst-Group Equalized Odds Regularization for Multi-Attribute Fair Medical Image Classification
Nikhil Cherian Kurian, Victor Caquilpan Parra, Abin Shoby, Luke Whitbread, Lauren Oakden-Rayner, Robert Vandersluis, Jessica Schrouff, Lyle J. Palmer, Mark Jenkinson · 2026
Read Worst-Group Equalized Odds Regularization for Multi-Attribute Fair Medical Image Classification by Nikhil Cherian Kurian, Victor Caquilpan Parra, Abin Shoby, Luke Whitbread, Lauren Oakden-Rayner, Robert Vandersluis, Jessica Schrouff, Lyle J. Palmer, Mark Jenkinson (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-19214.txt.
Introduction
Nikhil Cherian Kurian and eight colleagues propose a fairness fix for medical imaging AI at the set decision point. Group scores can hide harm: some groups get too many positive calls, others too few. Their worst group penalty targets the worst gaps in true and false positive rates at once, across age, sex, and race. On two imaging sets, it cuts equal odds and equal chance gaps while barely denting accuracy. It keeps diagnostic power while making care fairer at the point of use.
Catalog record
| CREATOR | Nikhil Cherian Kurian, Victor Caquilpan Parra, Abin Shoby, Luke Whitbread, Lauren Oakden-Rayner, Robert Vandersluis, Jessica Schrouff, Lyle J. Palmer, Mark Jenkinson |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24064 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.19214
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Worst-Group Equalized Odds Regularization for Multi-Attribute Fair Medical Image Classification Nikhil Cherian Kurian, Victor Caquilpan Parra, Abin Shoby, Luke Whitbread, Lauren Oakden-Rayner, Robert Vandersluis, Jessica Schrouff, Lyle J. Palmer, Mark Jenkinson Abstract D iagnostic performance in medical AI varies systematically across demographic groups, yet subgroup AUC can mask clinically important disparities. At a fixed inference-time operating point, some groups may exhibit over-diagnostic behaviour, characterized by elevated true and false positive rates, while others show under-diagnostic patterns with reduced true and false positive rates. These opposing tendencies can cancel in aggregate AUCs while producing meaningful inequities in clinical decision-making. Motivated by the need to assess and mitigate such disparities at the operating point and across multiple demographic attributes simultaneously, we propose a worst-group equalized-odds margin regularizer. The proposed regularizer explicitly targets subgroup-level deviations on both the true positive and false positive sides at inference. At each update, the method identifies subgroups defined by explicit demographic attributes (e.g., age, sex, and race) that exhibit the most extreme margin deviations and applies a unified penalty, enabling fairness optimization across multiple demographic axes without requiring explicit intersectional constraints. Across two medical imaging datasets in realistic multi-label settings, our method consistently reduces disparities in Equalized Odds and Equalized Opportunity with minimal impact on AUC, preserving diagnostic performance while improving fairness. 1 Motivation and Background Fairness is a critical concern in medical AI, as diagnostic performance often varies systematically across demographic groups [ 23 , 14 ] . At inference time, subgroups defined by age, sex, or race/ethnicity can exhibit markedly different error profiles—for example, younger females may have lower true positive rates (TPR) than older males for the same condition [ 20 ] . Such disparities can be obscured when subgroup AUCs appear similar: at a fixed global threshold, some groups are effectively over-diagnosed (high TPR and false-positive rate, FPR), while others are under-diagnosed (low TPR and FPR), leading opposing behaviours to cancel out in aggregate [ 6 ] . In radiology benchmark studies, race-stratified AUCs for White and Black patients are often comparable, yet at a global operating point Black patients show reduced sensitivity while White patients experience higher false-positive rates [ 20 , 6 ] . Consequently, fairness is better assessed using Equalized Odds (EO) and Equalized Opportunity (EOpp), which explicitly capture TPR/FPR disparities that AUC-based summaries can miss [ 7 ] . Despite this, many existing mitigation methods—such as GDRO [ 19 ] , JTT [ 12 ] , or FairBatch [ 17 ] —reweight, resample, or modify log-loss, an objective primarily intended to reduce average predictive risk which may fail to capture localized subgroup disparities [ 22 ] . Moreover, most prior work considers fairness relating to a single demographic attribute, leaving disparities along other axes unaddressed or even exacerbated [ 11 ] . Approaches that address multiple attributes together (e.g., FairRead [ 4 ] , FCRO [ 1 ] ) often have to adopt coarsened subgroup definitions across all attributes to preserve statistical power within intersectional groups. Representation-level debiasing methods that enforce demographic invariance or suppress mutual information [ 11 , 16 ] also struggle in multi-attribute settings: they become unstable for small subgroup sizes, and removing demographic signal independently for each attribute can overcompensate, eliminating task-relevant information and worsening the fairness–accuracy trade-off. Most such approaches are evaluated only in simplified binary classification settings, limiting their relevance to the multi-label scenarios common in clinical imaging [ 14 ] . In this work, we study fairness across multiple demographic subgroups in a realistic multi-label diagnostic setting. We introduce a worst-group equalized-odds margin regularizer that targets operating-point level subgroup disparities using threshold-free logit margins. Beyond standard log-loss—which primarily improves AUC through re-ranking—our bi-directional regularizer penalizes both over-diagnosis and under-diagnosis. Crucially, our definition of the “worst” subgroup is attribute inclusive: at each update, we search across all demographic groups (e.g., age bins, race categories, sex groups) and identify the subgroup exhibiting the largest potential deviation in TPR or FPR, without maintaining separate constraints per attribute. This provides a unified mechanism to address fairness across multiple demographic axes. Empirically, we observe consistent improvements in EO and EOpp with minimal changes in overall AUC, reducing subgroup disparities without incurring substantial accuracy losses or improving fairness for one subgroup at the expense of worsening it for others—a behaviour commonly observed in classical fairness–accuracy trade-offs [ 15 , 14 , 4 ] . 2 Method EO defines fairness via parity of true and false positive rates across demographic groups at a fixed inference-time operating point [ 23 ] . Cross-entropy training improves overall score separation and often benefits groups with already favorable TPR and FPR at test time, but does not explicitly penalize worst-case subgroup deviations, allowing large EO violations to persist despite strong average performance. We therefore introduce a Worst-Group Equalized Odds regularizer that targets TPR and FPR deviations by improving the separation of worst-group positives from negatives, and vice versa, using a threshold-free differentiable logit margin-based objective. 2.1 Problem Formulation Consider a binary classification dataset \mathcal{D}=\{(\mathbf{x}_{i},y_{i},\mathbf{a}_{i})\}_{i=1}^{N} , where \mathbf{x}_{i}\in\mathcal{X} is the input (e.g., a medical image), y_{i}\in\{0,1\} is the label, and \mathbf{a}_{i}=(a_{i}^{\text{age}},a_{i}^{\text{sex}},a_{i}^{\text{race}}) denotes the demographic attributes of sample i . For each attribute (e.g., age, sex, race), we define a set of demographic subgroups of interest, and collect all such subgroups into a unified set \mathcal{G} . Each subgroup g\in\mathcal{G} corresponds to a single attribute–value pair (e.g., female for sex, White for race, or age \geq 60 ). For notational convenience, we write g_{i}=g to indicate that sample i belongs to subgroup g according to its attributes \mathbf{a}_{i} ; a sample may satisfy this relation for multiple subgroups. We use a neural network f_{\theta}:\mathcal{X}\rightarrow\mathbb{R} that outputs logits \ell_{i}=f_{\theta}(\mathbf{x}_{i}) , which are mapped to probabilities via a link function such as the sigmoid, p_{i}=\sigma(\ell_{i})=\frac{1}{1+e^{-\ell_{i}}} . 2.2 Worst Sub-Group Identification To address fairness violations, we dynamically identify the worst-performing subgroups (agnostic to the attribute as mentioned before) within each mini-batch. For positives ( y_{i}=1 ), we seek the demographic subgroup g_{\min}^{[+]} , with the lowest mean predicted probability (as a surrogate of TPR - indicating under-diagnosis risk), while for negatives ( y_{i}=0 ), we identify the subgroup g_{\max}^{[-]} , with the highest mean probability (as a surrogate of FPR - indicating over-diagnosis risk). We compute per-group average probabilities by \mu_{g}^{[+]}=mean\{p_{i}\mid y_{i}=1,g_{i}=g\} and \mu_{g}^{[-]}=mean\{p_{i}\mid y_{i}=0,g_{i}=g\} . The worst-performing subgroups are then identified as g_{\min}^{[+]}=\arg\min_{g}\mu_{g}^{[+]} for positives and g_{\max}^{[-]}=\arg\max_{g}\mu_{g}^{[-]} for negatives. 2.3 Log-Sum-Exp Margin Regularization Our goal is to penalize cases in which the lowest-scoring positive sample from the worst subgroup g_{\min}^{[+]} is scored below all negative samples and conversely where the highest scoring negative sample from the worst subgroup g_{\max}^{[-]} is scored above all positive samples This encourages separation between positive and negative samples from the worst-group, reducing under-diagnosis and over-diagnosis, respectively. Ideally we want \displaystyle\min_{\begin{subarray}{c}m:y_{m}=1,\\ g_{m}=g_{\min}^{[+]}\end{subarray}}\ell_{m}>\max_{\begin{subarray}{c}n:y_{n}=0\end{subarray}}\ell_{n}\qquad\max_{\begin{subarray}{c}m:y_{m}=0,\\ g_{m}=g_{\max}^{[-]}\end{subarray}}\ell_{m}<\min_{\begin{subarray}{c}n:y_{n}=1\end{subarray}}\ell_{n} (1) In Eq. ( 1 ), m and n index individual samples within the current mini-batch. The index m is restricted to samples from the identified worst subgroup (positives with g_{m}=g_{\min}^{[+]} in the left constraint, negatives with g_{m}=g_{\max}^{[-]} in the right), whereas n ranges over all samples with the opposite label in the batch. Thus, each inequality compares the worst-case logit in the worst subgroup (a \min over positives or