A Systems Thinking Approach to Algorithmic Fairness DOI: 10.48550/arXiv.2412.16641 Conference: ACM Conference on Fairness, Accountability, and Transparency; 2025; Athens, Greece ISBN: 978-1-4503-XXXX-X/18/06 CCS: Computing methodologies Causal reasoning and diagnostics CCS: Computing methodologies P
Chris Lam · 2024
Read A Systems Thinking Approach to Algorithmic Fairness DOI: 10.48550/arXiv.2412.16641 Conference: ACM Conference on Fairness, Accountability, and Transparency; 2025; Athens, Greece ISBN: 978-1-4503-XXXX-X/18/06 CCS: Computing methodologies Causal reasoning and diagnostics CCS: Computing methodologies P by Chris Lam (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-16641.txt.
Introduction
Chris Lam applies systems thinking to algorithmic fairness in a 2024 paper. Fairness debates often stall because bias can enter at many points in the process that generates data and decisions.
Systems thinking lets analysts encode prior beliefs about where bias sits as causal graphs. Those graphs link machine learning systems to politics and law in one frame. Methods from causal inference and system dynamics then expose how fairness rules play out over time, including side effects. The approach helps policymakers across the political spectrum weigh trade-offs among fairness policies. Lam frames this sociotechnical base as a path to AI policy that fits democratic values while staying honest about complexity.
Catalog record
| CREATOR | Chris Lam |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 68 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-16641
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Systems Thinking Approach to Algorithmic Fairness DOI: 10.48550/arXiv.2412.16641 Conference: ACM Conference on Fairness, Accountability, and Transparency; 2025; Athens, Greece ISBN: 978-1-4503-XXXX-X/18/06 CCS: Computing methodologies Causal reasoning and diagnostics CCS: Computing methodologies Probabilistic reasoning CCS: Computing methodologies Reasoning about belief and knowledge CCS: Applied computing Law CCS: Applied computing Sociology CCS: Applied computing Economics CCS: Applied computing Psychology CCS: Social and professional topics Governmental regulations Chris Lam Abstract . Systems thinking provides us with a way to model the algorithmic fairness problem by allowing us to encode prior knowledge and assumptions about where we believe bias might exist in the data generating process. We can then encode these beliefs as a series of causal graphs, enabling us to link AI/ML systems to politics and the law. This allows us to combine techniques from machine learning, causal inference, and system dynamics in order to capture different emergent aspects of the fairness problem. We can use systems thinking to help policymakers on both sides of the political aisle to understand the complex trade-offs that exist from different types of fairness policies, providing a sociotechnical foundation for designing AI policy that is aligned to their political agendas and with society’s values. X W A D Y Data Mediator Protected Attribute Decision Outcome ML Model ML Model Data X Decision D Protected Attribute A Outcome Y Decision D Data X_{A} Data X_{B} Outcome Y_{A} Outcome Y_{B} Protected Attribute A_{A} Protected Attribute A_{B} ML Model + – + + + – – – + – – – R1 R2 B1 B2 R3 R4 || || (b) Causal Inference Causal Bayesian Network (a) Machine Learning Block Diagram (c) System Dynamics Causal Loop Diagram Figure 1. Three representations of algorithmic fairness A block diagram, a causal Bayesian network, and a causal loop diagram. 1. Introduction For several years, AI researchers have struggled with how to build AI/ML systems that are fair and aligned to society’s values. Purely technical approaches that rely on correlation alone have fallen far short of what is needed to solve this difficult problem. Systems thinking offers a novel approach to the algorithmic fairness problem by allowing us to use causality to unify complex ideas from the social sciences and computer science into a comprehensive and integrated theory. By leveraging prior knowledge and assumptions about where we believe bias might exist in the data generating process, we can help policymakers on both sides of the aisle to design AI policy that is aligned to their political agendas. To address the algorithmic fairness problem, we need to take a sociotechnical approach. The first part of this paper will briefly cover concepts from the social sciences to address the controversial question: Why do we believe disparities exist across protected groups like race or gender? This will give us insights into the political debate around fairness and why policymakers fundamentally disagree on how to close those disparities. We will then turn our attention to the technical aspects of the fairness problem, which forms the bulk of this paper. We will use systems thinking to show how to combine analytical techniques from machine learning, causal inference, and system dynamics to model different facets of the fairness problem. Machine learning is necessary for building AI systems that can make fair predictions. Causal inference allows us to visualize different forms of bias, showing us what interventions are needed to make a machine learning model fair. System dynamics allows us to model the bias in the data generating process, providing counterintuitive explanations as to why disparities continue to persist across protected groups. Finally, we will demonstrate how these three techniques can form the basis of a new causal hierarchy for modeling algorithmic fairness. 2. Related work The field of algorithmic fairness is a relatively new field that has drawn significant attention since the release of a ProPublica article that claimed racial bias in COMPAS, a software tool that is widely used in the US court system to predict recidivism ( Angwin et al. 2016 ) . Since then, there have been multiple attempts to align the legal definitions of discrimination (e.g. disparate treatment and disparate impact in the US or direct discrimination and indirect discrimination in the EU) with their equivalent mathematical definitions. But these approaches, which have oftentimes relied on statistical correlation, have not been successful. Narayanan for example identified nearly two dozen fairness metrics, none of which could fully align to the legal definitions of discrimination ( Narayanan 2018 ) . Pearl has argued for a few decades that the discrimination problem is fundamentally a causality problem ( Pearl 2001 ) . He has argued that fairness can be modeled using causal Bayesian networks (CBNs) as a series of direct, indirect, and spurious effects. This work was later expanded upon by Plecko and Bareinboim, who proposed the idea of a standard fairness model ( Plecko and Bareinboim 2022 ) . They argued that there exists a causal template through which entire classes of fairness models can be derived using a small number of modeling assumptions. Kusner et al. argued for the use of counterfactuals in modeling fairness ( Kusner et al. 2017 ) . Chiappa and Isaac showed that certain paths within a CBN could be labeled as fair or unfair ( Chiappa and Isaac 2019 ) . Another attempt of building causal fairness models was made by Nilforoshan et al., but their approach had encountered limitations ( Nilforoshan et al. 2022 ) . Barocas et al. devoted a chapter in their textbook on fairness and machine learning to discuss how causality might be used to model fairness ( Barocas et al. 2023 ) . However, their causal approaches were not really sociotechnical and didn’t take full account of the social and political aspects of the fairness problem. Society has different ideological beliefs about what is fair and unfair based on different sets of assumptions about where bias is in the data generating process. Our paper addresses this issue by encoding society’s different mental models of bias into causal models using first principles. By taking into account a diversity of perspectives, we can understand the normative aspects of the fairness problem. This is necessary for linking machine learning to politics and ultimately the law. Another key difference is that their causal approaches relied solely on causal inference, which has limitations in its ability to model the data generating process. Our approach leverages systems thinking and specifically system dynamics to gain a fuller understanding of the data generating process through the modeling of feedback loops. Martin has also explored modeling AI bias using community-based system dynamics ( Jr 2023 ; Jr 2021 ) . Furthermore, we link supervised machine learning to causal inference by recognizing that a CBN can be used as a higher level abstraction of a black box ML model. By bringing machine learning, causal inference, and systems thinking together, we can model the different aspects of the algorithmic fairness problem. 3. Towards a unified theory of fairness To build fair AI/ML systems, we begin from first principles with the strong assumption that all humans have free will ( Carus 1910 ) . This forms the basis of moral responsibility ( Talbert 2024 ) . If we humans