GESD: Beyond Outcome-Oriented Fairness
Gideon Popoola, John Sheppard · 2026
Read GESD: Beyond Outcome-Oriented Fairness by Gideon Popoola, John Sheppard (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-15295.txt.
Introduction
Gideon Popoola and John Sheppard propose a procedural fairness metric for machine learning in high-stakes decisions like loans, hiring, and recidivism forecast. Outcome metrics capture gaps in choices but not in the reasons behind them. Their Group-level Explanation Stability Disparity gauges group gaps in how stable, robust, and touchy model reasons are. Built in a multi-objective framework balancing fairness, explainability, and utility, it lifts both utility and fairness on benchmarks.
Catalog record
| CREATOR | Gideon Popoola, John Sheppard |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34714 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.15295
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
GESD: Beyond Outcome-Oriented Fairness 1 Gideon Popoola is a PhD student with the Gianforte School of Computing, Montana State University, Bozeman, MT 59717, USA [email protected] 2 John Sheppard is a Professor with the Gianforte School of Computing, Montana State University, Bozeman, MT 59717, USA [email protected] Gideon Popoola, John Sheppard Abstract Machine learning (ML) algorithms are increasingly deployed in high-stakes decision-making domains such as loan approvals, hiring, and recidivism predictions. While existing fairness metrics (e.g., statistical parity, equal opportunity) effectively quantify outcome-oriented disparities, they offer limited insight into the procedure or explanation behind biased decisions. To address this gap, we propose Group-level Explanation Stability Disparity (GESD), a procedural-oriented fairness metric that measures disparities in the stability, robustness, and sensitivity of model explanations across different subgroups in a protected category. We further integrate GESD into a multi-objective optimization framework that jointly optimizes for utility, outcome-based fairness, and explanation-based fairness called FEU (Fairness–Explainability–Utility). Empirical results on multiple benchmark datasets show that GESD effectively captures group-wise discrepancies in explanation quality, and that FEU improves both utility and fairness over state-of-the-art methods. By bridging outcome-based and explanation-based fairness, GESD offers a comprehensive tool for diagnosing and mitigating bias in predictive modeling. Our code and datasets are available on GitHub https://github.com/horlahsunbo/GESD I Introduction Machine learning (ML) algorithms are increasingly deployed in high-impact domains such as hiring, college admissions, loan approvals, and criminal justice [ 5 ] . Despite the potential for efficiency and scalability, previous works have raised serious concerns about algorithmic bias, where models are systematically unfair to certain members of protected categories such as age, race, and gender [ 22 ] . Early research determined that ML systems can inherit social prejudices from the datasets they are trained on, inadvertently amplifying historical biases [ 7 ] . These findings led to developing a series of outcome-oriented fairness metrics, which focus on measuring and mitigating disparities in model prediction or outcomes, such as statistical parity [ 9 ] , equalized odds [ 16 ] , and predictive parity [ 10 ] . Although these outcome-oriented metrics can quantify bias and optimize the model for fairness, most of these methods still rely on model predictions. This reliance on model prediction means these metrics ignore the potential bias in decision-making (otherwise known as the procedure or explanation). This negligence means the metric cannot further mitigate the procedural-oriented bias, which is crucial for developing a fair and explainable ML model [ 3 ] . Given the above, there is a growing research community interested in bridging the gap between explainability, which represents the degree to which humans can understand or trust the reasoning of a model, and fairness, which represents the extent to which the model does not unfairly disadvantage protected categories. Lipton ( [ 20 ] ) highlights that merely observing fair outputs might be insufficient, which means an algorithm can produce seemingly equitable outcomes but still rely on questionable or discriminatory internal procedures. Recent studies have pointed to the necessity of examining model procedures rather than relying solely on outcome statistics [ 15 ] . Some efforts propose examining how sensitive the reasoning of a model is when masking the most important feature, known as explanation fidelity [ 2 ] . However, these remain limited in scope because they still rely somewhat on model prediction. A more comprehensive, procedural-oriented fairness metric would explicitly evaluate whether members of different protected attributes receive explanations with similar degrees of stability, robustness, and sensitivity. Such a metric could, for example, detect if the explanatory patterns of a model drastically fluctuate across subgroups. Beyond bridging fairness and explainability, recent studies have also begun treating fairness, explainability, and utility as a multi-objective problem in machine learning models. One common approach to addressing this problem is through the use of a composite loss function, which combines metrics into a single loss function with tunable weights [ 29 ] . Furthermore, Pareto-based strategies explore the spectrum of balancing the objectives using methods like multi-objective evolutionary algorithms (MOEA) to generate Pareto sets that balance utility, explainability, and fairness [ 26 ] . This paper introduces a procedural-oriented fairness framework to balance fairness and explainability. Specifically, we define the Group-level Explanation Stability Disparity (GESD) metric to quantify the robustness, stability, and sensitivity of model explanations across protected subgroups, thereby exposing procedural biases that outcome-oriented fairness metrics often overlook. Unlike prior measures that compare average feature importance or mean explanations across groups [ 29 ] , GESD evaluates the reliability of explanations themselves by assessing their stability under perturbations, ensuring that different groups receive explanations of comparable consistency. The metric is both model- and explainer-agnostic, making it compatible with a wide range of learning algorithms and post-hoc interpretability methods. Importantly, GESD complements traditional prediction-level fairness metrics by identifying disparities in explanation quality even when a model appears fair in terms of its outcomes. Under our framework, we integrate GESD into a multi-objective optimization process called Fairness-Explanation-Utility (FEU), which jointly optimizes outcome-based fairness, explanation-based fairness, and model utility. Our approach thus provides a more holistic view of equitable modeling, ensuring that both the final predictions and the underlying process are fair across protected groups. The contributions of this work are summarized as follows: 1. We formulate the problem of detecting group-level disparities in explanation quality and propose a new procedural-oriented metric (GESD) to quantify disparities in explanation robustness, stability, and sensitivity. 2. We proposed an evolutionary algorithm-inspired multi-objective optimization framework named FEU that optimizes utility, fairness, and explainability metrics to generate a balanced model in these objectives. 3. We demonstrate that GESD effectively detects hidden group-level explanation bias on multiple benchmark datasets. 4. We show that FEU can achieve superior trade-offs in utility and fairness compared to existing fair models. II Group-level Explanation Stability Disparity GESD builds on prior definitions of explanation sensitivity and robustness to ensure that no group receives significantly less stable explanations than another [ 21 , 3 ] . We show the complete algorithm in Algorithm 1 . Algorithm 1 Group-level Explanation Disparity (GESD) 1: Trained model f , evaluation dataset X\in\mathbb{R}^{n\times d} , sensitive attributes s\in\mathbb{R}^{n} , training data X_{\text{train}} , number of perturbations N , Gaussian scale \sigma , mask probability p , baseline value b , sample size m 2: Initialize stability list \mathcal{S}\leftarrow\emptyset 3: Randomly sample X_{\text{sample}}\subset X of size m 4: for each x\in X_{\text{sample}} with sensitive attribute s_{x} do 5: Compute E_{\text{SHAP}}(x) using f and X_{\text{train}} 6: Compute E_{\text{LIME}}(x) using f and X_{\text{train}} 7: Compute aggregated explanation (Eq. 1 ) 8: Initialize perturbation stability list L\leftarrow\emptyset 9: for i=1 to N do 10: Generate noise: \epsilon\sim\mathcal{N}(0,\sigma^{2}I) 11: Compute perturbed instance: x^{\prime}\leftarrow x+\epsilon 12: Generate binary mask: M\in\{0,1\}^{d},\ p_{j}=P(M_{j}=0),\ j=1,\ldots,d 13: Apply masking: \tilde{\mathbf{x}}\leftarrow M\odot(\mathbf{x}+\boldsymbol{\epsilon})+(\mathbf{1}-M)\odot\mathbf{x}^{(0)} 14: Compute perturbed instance explanation (Eq. 1 ) 15: Compute distance (Eq. 2 ) 16: Compute stability score for the perturbation: S(x)\leftarrow\frac{1}{1+\Delta{(x)}} 17: Append S_{i}(x) to L 18: Compute average stability for x : S_{i}(x)\leftarrow\frac{1}{N}\sum_{i=1}^{N}S(x) 19: Record the pair (s_{x},S(x)) in \mathcal{S} 20: for each group G_{i} do S_{i}\leftarrow\frac{1}{|X_{G_{i}}|}\sum_{\mathbf{x}\in X_{G_{i}}}S_{i}(\mathbf{x})~, 21: if number of groups K=2 then \text{GESD}\leftarrow\left|{S}_{0}-{S}_{1}\right| 22: else \displaystyle\bar{S} \displaystyle\leftarrow \displaystyle\frac{1}{K}\sum_{g=1}^{K}{S}_{i} \displaystyle\text{GESD}_{K\text{-groups}} \displaystyle\leftarrow \displaystyle\frac{1}{K}\sum_{g=1}^{K}\left({S}_{i}-\bar{S}\right)^{2} 23: return GESD II- 1 Explanation Aggregation Let f(\mathbf{x}) be the prediction of a model for input \mathbf{x}\in\mathbb{R}^{d}