MESD: Detecting and Mitigating Procedural Bias in Intersectional Groups

Gideon Popoola and John Sheppard · 2026

Read MESD: Detecting and Mitigating Procedural Bias in Intersectional Groups by Gideon Popoola and John Sheppard (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-13452.txt.

Introduction

Gideon Popoola and John Sheppard introduce MESD, a metric for explanation fairness across intersectional subgroups. Outcome metrics like demographic parity cannot show whether a model reasons in different ways for different groups. That gap breaks procedural fairness, and fairness gerrymandering can hide it in single-attribute checks. MESD measures gaps in explanation quality across subgroups formed by multiple protected attributes. It joins label-aware aggregation, empirical-Bayes shrinkage for small groups, and CVaR weighting for worst cases. Tests show it reveals disparities that outcome metrics miss.

Catalog record

CREATORGideon Popoola and John Sheppard
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31648
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.13452

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MESD: Detecting and Mitigating Procedural Bias in Intersectional Groups Gideon Popoola and John Sheppard Abstract Research about bias in machine learning has mostly focused on outcome-oriented fairness metrics (e.g., equalized odds) and on a single protected category. Although these approaches offer great insight into bias in ML, they provide limited insight into model procedure bias. To address this gap, we proposed multi-category explanation stability disparity (MESD), an intersectional, procedurally oriented metric that measures the disparity in the quality of explanations across intersectional subgroups in multiple protected categories. MESD serves as a complementary metric to outcome-oriented metrics, providing detailed insight into the procedure of a model. To further extend the scope of the holistic selection model, we also propose a multi-objective optimization framework, UEF (Utility-Explanation-Fairness), that jointly optimizes three objectives. Experimental results across multiple datasets show that UEF effectively balances objectives. Also, the results show that MESD can effectively capture the explanation difference between intersectional groups. This research addresses an important gap by examining explainability with respect to fairness across multiple protected categories. I Introduction Machine learning (ML) systems have increasingly been used in day-to-day human decision-making, such as criminal justice, credit scoring, hiring, and healthcare [ 12 ] . As these ML models become more common, concerns about bias have become essential to responsible use of these models [ 3 ] . Most of the previous fairness research focuses on outcome-oriented fairness, which measures whether predictions \hat{Y} satisfy group-level statistical constraints relative to the true label Y and a protected attribute A [ 17 ] . Examples of these outcome-oriented fairness metrics include Demographic Parity, Equal Opportunity, and Equalized Odds [ 10 ] . Recently, a novel body of research proposes that fair outcomes alone are insufficient, and that fairness must also attend to the procedural aspect of model reasoning [ 9 ] . A model may satisfy outcome-oriented fairness metrics such as Equalized Odds while relying on unstable or group-dependent reasoning processes for individual predictions, which can cause the model to be nontransparent or violate fundamental principles of procedural fairness [ 28 ] . Beyond fairness, the field of explainability has produced several tools for analyzing models, including Shapley Additive Explanation (SHAP) [ 16 ] and Local Interpretable Model-Agnostic Explanation (LIME) [ 20 ] . These post-hoc explanation methods have the capability to decompose predictions into feature-level attributions, helping users to explain how a model arrives at a decision. However, the explainability literature has historically operated independently of the fairness literature. Recent work has begun to formalize how to bridge explanation research and fairness research to assess the stability, robustness, and fidelity of explanations derived from an ML model [ 6 ] . These works have demonstrated that two models with identical outcome-oriented fairness (e.g., equalized odds) can differ widely in whether they provide stable, consistent explanations across groups [ 2 ] . However, most of these works are limited in scope because they handle only single protected attributes, not intersectional identities (e.g., race \times gender). Also, most fairness optimization studies balance only utility and outcome-fairness [ 25 ] , This paper addresses these gaps by developing the Multi-category Explanation Stability Disparity (MESD), a procedural fairness metric designed to operate across intersectional groups using multiple post-hoc explainers and label-aware aggregation. MESD assesses whether individuals across different intersectional groups receive explanations of comparable stability, consistency, and robustness when subjected to small perturbations. To the best of our knowledge, MESD is the first procedural metric that addresses the issue of multiple protected attributes. Also, we integrate MESD into a multi-objective optimization framework that optimizes utility, fairness, and explanation. This optimization framework reveals trade-offs that are invisible under outcome-oriented fairness alone and provides models that are simultaneously accurate, statistically fair, and procedurally fair. The contributions of this work are summarized as follows: 1. We formulate the problem of detecting intersectional group-level disparities in explanation quantity and propose a new procedural metric named MESD to quantify disparities in explanation robustness, stability, and robustness. 2. We proposed label-aware aggregation to align MESD with the label-conditional nature of outcome fairness, empirical-Bayes shrinkage to stabilize estimates for small intersectional groups, and a Conditional Value-at-Risk (CVaR)-based tail formulation to emphasize worst-case subgroup disparities, addressing fairness gerrymandering [ 14 ] . 3. We proposed a multi-objective optimization framework that optimizes utility, explainability, and fairness, coupled with Chebyshev scalarization for Pareto front selection. 4. We demonstrate empirically that MESD reveals disparities and mitigation opportunities overlooked by traditional fairness metrics alone. II Related Work Fairness in ML has become a rapidly expanding research area, motivated by the increasing reliance on ML systems in socially consequential domains [ 18 ] . The majority of the existing fairness research work is centered on group fairness, wherein predictions must satisfy statistical criteria across protected groups (e.g., race, gender). Among the most common definitions is Demographic Parity (DP) [ 15 ] , which requires independence between the positive predicted label and the protected attribute; however, DP disregards the ground truth (Y) , often leading to undesirable incentives. To address these drawbacks, label-conditional metrics such as Equalized Odds Difference(EOD) [ 10 ] were introduced. EOD requires equal false-positive and true-positive rates across groups. Several algorithms have been proposed to enforce DP or EOD, including re-weighting [ 13 ] , adversarial debiasing [ 27 ] , and calibrated score adjustments [ 10 ] . However, most of these metrics and the algorithms share a core limitation: they evaluate only the distributions of outcomes, not the stability of explanations that justify them, and thus cannot mitigate bias arising from these explanations. The fairness community has increasingly recognized that evaluating fairness across single protected attributes overlooks disparities affecting individuals who belong to multiple protected categories simultaneously (e.g., black women). This problem can lead to a phenomenon known as fairness gerrymandering, which occurs when models appear fair on each individual attribute but remain unfair for intersections [ 14 ] . Approaches to intersectional fairness include distributionally robust optimization [ 11 ] , probabilistic overlapping-group fairness [ 26 ] , and resampling [ 19 ] . Beyond outcome-oriented fairness, recent research emphasizes that fairness should extend beyond model outcome to explain the procedures by which decisions are made [ 8 ] . Procedural fairness argues that fairness should be evaluated not only on the basis of outcomes but also on transparency, consistency, and the quality of reasoning behind the model decision [ 21 ] . In ML, this means to determine whether feature attributions, gradients, saliency maps, or surrogate models behave coherently across demographic groups. Recent research has uncovered substantial procedural disparities in model explanation that models can satisfy Equalized Odds yet use qualitatively different reasoning for protected groups [ 28 , 6 ] . To address inconsistencies in model reasoning across demographic groups, researchers have used post-hoc explanation algorithms that aim to explain how a trained model arrives at a given prediction [ 7 ] . However, a common challenge here is explanation instability, where small input perturbations can produce substantially different explanations [ 22 ] . From a model selection perspective, recent research has begun treating the context of model selection as a multi-objective optimization problem, with objectives including utility, outcome-oriented fairness, and procedural-oriented fairness [ 24 ,

Read the complete text