Decomposing Direct and Indirect Biases in Linear Models under Demographic Parity Constraint
Bertille Tierny, Arthur Charpentier, François Hu · 2025
Read Decomposing Direct and Indirect Biases in Linear Models under Demographic Parity Constraint by Bertille Tierny, Arthur Charpentier, François Hu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-11294.txt.
Introduction
Bertille Tierny, Arthur Charpentier, and François Hu present a post-processing frame that splits the bias of a fairness-adjusted linear model into direct and indirect parts. Linear models are prized in high-stakes decisions for their clarity, but adding a demographic parity constraint reshapes every coefficient in ways that are hard to read. Prior work often assumed too much or ignored the sensitive attribute's own role.
Applied on top of any trained linear model with no retraining, the method shows exactly how parity shifts each coefficient, for sensitive and ordinary features alike. That feature-level view lets auditors see where bias persists or migrates through correlated variables. Tests cover synthetic and real data.
Catalog record
| CREATOR | Bertille Tierny, Arthur Charpentier, François Hu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 80 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-11294
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Decomposing Direct and Indirect Biases in Linear Models under Demographic Parity Constraint Bertille Tierny, Arthur Charpentier, François Hu Abstract Linear models are widely used in high-stakes decision-making due to their simplicity and interpretability. Yet when fairness constraints such as demographic parity are introduced, their effects on model coefficients, and thus on how predictive bias is distributed across features, remain opaque. Existing approaches on linear models often rely on strong and unrealistic assumptions, or overlook the explicit role of the sensitive attribute, limiting their practical utility for fairness assessment. We extend the work of ( 6 ) and ( 9 ) by proposing a post-processing framework that can be applied on top of any linear model to decompose the resulting bias into direct (sensitive-attribute) and indirect (correlated-features) components. Our method analytically characterizes how demographic parity reshapes each model coefficient, including those of both sensitive and non-sensitive features. This enables a transparent, feature-level interpretation of fairness interventions and reveals how bias may persist or shift through correlated variables. Our framework requires no retraining and provides actionable insights for model auditing and mitigation. Experiments on both synthetic and real-world datasets demonstrate that our method captures fairness dynamics missed by prior work, offering a practical and interpretable tool for responsible deployment of linear models. Code — https://github.com/bias-mitigator/interpretable.git 1 Introduction Linear models remain a foundational tool in statistical learning due to their interpretability, scalability, and simplicity ( 12 ) . They are widely used in high-stakes domains such as credit scoring, hiring, insurance, and healthcare, where algorithmic decisions have significant consequences and fairness considerations are critical ( 17 ; 3 ) . In these settings, linear models may inadvertently encode or amplify unfair biases. These biases can arise directly , through the explicit use of sensitive attributes such as race or gender, or indirectly , through features correlated with those attributes ( 11 ; 16 ; 22 ) . Fairness in machine learning has been extensively studied, with various formal definitions and mitigation strategies proposed ( 7 ; 15 ; 18 ) . One of the most common criteria is Demographic Parity (DP), which requires that the predictions be statistically independent of sensitive attributes. Although many methods aim to enforce DP in classification settings ( 1 ; 10 ; 13 ) , few provide systematic tools to quantify and separate the sources of unfairness, especially in linear models. In particular, existing approaches, such as ( 6 ; 9 ) , do not provide a systematic decomposition of bias stemming from the sensitive feature versus that induced by correlated non-sensitive features. This lack of decomposition is especially problematic in linear models, which, despite their transparency, are not well understood in terms of how fairness constraints affect individual model coefficients. As a result, practitioners often lack insight into how these constraints redistribute predictive contributions across features or whether indirect biases persist even after sensitive variables are removed. 1.1 Main Contributions We propose a framework for learning fair linear models, designed to identify and mitigate both indirect and direct biases in linear models. Specifically: • We introduce a linear modeling framework aligned with standard practices and derive a closed-form solution for the optimal fair regressor. To our knowledge, this is the first solution that remains linear under group-wise feature standardization. In practice, it can be applied on top of any linear model (penalized, with or without intercept) making it broadly compatible and easily deployable. • Building on this optimal solution, we disentangle the contributions of sensitive and non-sensitive features to fairness violations (see Fig. 1 ) while providing clear guidance on how to adjust coefficients toward fairness. • We illustrate the effectiveness of our approach on both synthetic and real-world datasets, demonstrating its ability to produce fair linear models while offering interpretability of both direct and indirect biases. Total Unfairness First-Moment Disparity (Mean Bias) Second-Moment Disparity (Indirect Structural Bias) Indirect Direct Interaction Arises from group disparities in the feature covariance structure Figure 1: Conceptual decomposition of the total unfairness measure.The unfairness splits into two bias sources: disparities in the mean of predictions (First-Moment) and disparities in the variance of predictions (Second-Moment). This work advances the understanding of fairness in linear models and contributes to the broader literature by providing tools to dissect and interpret bias at the feature level. For clarity of presentation, all proofs are provided in the supplementary materials. 1.2 Related Work The study of fairness constraints in linear regression, particularly under DP, is relatively recent. Most existing methods either focus on model-level fairness objectives or rely on restrictive assumptions that limit their applicability in practice. ( 6 ) propose a minimax solution for linear regression under DP, deriving a closed-form intercept correction. However, their formulation is based on a strong assumption: the sensitive feature is independent of the other covariates. Therefore, they are omitting completely the indirect biases. This assumption rarely holds in real-world data and significantly restricts both the predictive accuracy of the model and the relevance of its fairness guarantees. ( 9 ) extend this line of work by adjusting both intercept and non-sensitive feature coefficients. Although this allows more flexibility, their framework still omits an explicit treatment of the sensitive feature’s contribution, which limits bias diagnostics. Moreover, their solution also still builds on simplifying assumptions that may distort the fairness-performance trade-off. In contrast, our approach explicitly characterizes the effect of DP constraints on all model components, including the sensitive feature. This enables a fine-grained decomposition of direct and indirect biases and provides clearer insights into how fairness interventions affect both predictive behavior and feature-level fairness contributions. Direct (Mean) Indirect (Mean) Interaction Indirect (Structural) [CS22] ✓ ✓ [FS23] ✓ ✓ ✓ ours ✓ ✓ ✓ ✓ Table 1: Comparison of bias mitigation methods across linear models proposed by [CS22] ( 6 ) , [FS23] ( 9 ) , and our approach. Checkmarks indicate addressed biases. 1.3 Outline of the Paper The remainder of this article is structured as follows: Section 2 , introduces the problem setup and the key metrics used throughout the article. Section 3 reviews the limitations of existing fair linear models. Section 4 presents our main contribution: a general framework for learning optimal fair linear models. This is followed in Section 5 by a decomposition of unfairness into direct and indirect biases. Finally, Section 6 details the practical implementation of our methodology and Section 7 presents numerical results comparing our method to state-of-the-art baselines. 2 Problem Formulation Let (\bm{X},S,Y) be a random triplet, where \bm{X}\in\mathcal{X}\subset\mathbb{R}^{d} is a non-sensitive feature vector, Y\in\mathcal{Y}\subset\mathbb{R} is the target variable, and S\in\mathcal{S}=[M] is a discrete sensitive attribute where [M]:=\{1,\dots,M\} . We define p_{s}=\mathbb{P}(S=s) for all s\in[M] . Additional notations are provided in Appendix A . Our goal is to find a predictor f:\mathcal{X}\times\mathcal{S}\to\mathcal{Y} from a set \mathcal{F} that balances predictive utility with fairness. We denote by \nu_{f} the distribution of f(\bm{X},S) , and by \nu_{f\mid s} its distribution given S=s . We make the following standard assumption. Assumption 1 . For f\in\mathcal{F} , measures (\nu_{f\mid s})_{s\in[M]} are non atomic with finite second moments. We evaluate any predictor f along three key and potentially competing dimensions: predictive risk, fairness, and goodness-of-fit. Each is formally defined below. 2.1 Measuring Risk We measure the predictive performance of a