Evaluating Causal Discovery Algorithms for Path-Specific Fairness and Utility in Healthcare

Nitish Nagesh, Elahe Khatibi, Thomas Hughes, Mahdi Bagheri, Pratik Gajane, Amir M. Rahmani · 2026

Read Evaluating Causal Discovery Algorithms for Path-Specific Fairness and Utility in Healthcare by Nitish Nagesh, Elahe Khatibi, Thomas Hughes, Mahdi Bagheri, Pratik Gajane, Amir M. Rahmani (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-15926.txt.

Introduction

Nagesh and co-authors grade causal discovery tools on fairness paths in data. True causal graphs stay unknown in real clinical records. The team built expert proxy graphs as truth stand-ins. Synthetic Alzheimer's and heart failure records supply test data. Peter-Clark, Greedy Equivalence Search, and Fast Causal Inference face off. Peter-Clark recovered structure best on synthetic data. Fast Causal Inference gave top utility on heart failure data. Ejection fraction drove 3.37 points of indirect effect in truth. Fairness grades swing with the graph each tool finds.

Catalog record

CREATORNitish Nagesh, Elahe Khatibi, Thomas Hughes, Mahdi Bagheri, Pratik Gajane, Amir M. Rahmani
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE22613
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.15926

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Evaluating Causal Discovery Algorithms for Path-Specific Fairness and Utility in Healthcare Nitish Nagesh, Elahe Khatibi, Thomas Hughes, Mahdi Bagheri, Pratik Gajane, Amir M. Rahmani Abstract Causal discovery in health data faces evaluation challenges when ground truth is unknown. We address this by collaborating with experts to construct proxy ground-truth graphs, establishing benchmarks for synthetic Alzheimer’s disease and heart failure clinical records data. We evaluate the Peter-Clark, Greedy Equivalence Search, and Fast Causal Inference algorithms on structural recovery and path-specific fairness decomposition, going beyond composite fairness scores. On synthetic data, Peter-Clark achieved the best structural recovery. On heart failure data, Fast Causal Inference achieved the highest utility. For path-specific effects, ejection fraction contributed 3.37 percentage points to the indirect effect in the ground truth. These differences drove variations in the fairness-utility ratio across algorithms. Our results highlight the need for graph-aware fairness evaluation and fine-grained path-specific analysis when deploying causal discovery in clinical applications. 1 Introduction Determining which causal pathways drive disparity in health outcomes is a critical task in informatics for goals including targeting interventions, assessing comparative fairness of prediction models, and deciding which effects are legally or ethically permissible to adjust [ 5 ] . Disparities can arise through direct effects of protected attributes on outcomes, indirect effects mediated by clinical variables, or spurious effects from confounders. Causal fairness frameworks decompose total variation into direct, indirect, and spurious components, enabling a nuanced understanding of which pathways contribute to disparity [ 6 , 14 ] . The trade-off between fairness and predictive utility [ 15 , 16 ] quantifies the cost of blocking each pathway. One challenge is that a known causal graph is required to identify which variables act as mediators and which as confounders. Causal discovery algorithms learn graph structure from observational data [ 19 , 9 , 12 ] , yet evaluating whether discovered graphs support reliable path-specific fairness analysis in clinical settings remains an open question. We address this gap by establishing expert-defined benchmarks and evaluating causal discovery for path-specific fairness on both synthetic and real-world clinical data. Our work makes the following contributions: • We establish a causal graph benchmark for a real-world clinical dataset and ground our evaluation in a synthetic clinical benchmark. • We map each discovered graph to a fairness model and apply causal discovery algorithms, evaluating both structural recovery and path-specific fairness decomposition. • We examine the trade-off between fairness and utility by evaluating the causal fairness utility ratio per path, enabling fine-grained analysis of which pathways offer the best fairness gain per unit accuracy cost. Figure 1 : Proposed Discovery and Evaluation Framework 2 Methods In this section, we describe our proposed architecture, datasets, ground truth graphs, causal discovery algorithms, evaluation metrics, and experimental setup. 2.1 Proposed Architecture We develop a pipeline to evaluate causal discovery algorithms for utility and fairness. Using a combination of domain knowledge and expert-driven inputs, we establish the ground truth causal graph. We then discover the underlying causal graph by running causal discovery algorithms. We evaluate the discovered graph on utility and causal fairness [ 14 ] metrics accounting for disentangled effects of individual mediators and confounders on outcome. Finally, we examine tensions between fairness and utility through the causal fairness utility ratio [ 16 ] . Our framework is outlined in Figure 1 . 2.2 Datasets To evaluate the utility and fairness metrics, we leverage two datasets. We first use a synthetically generated Alzheimer’s disease dataset that has a well defined ground truth graph [ 1 ] . Then we consider another real-world dataset related to heart failure [ 28 ] where we work with an expert to establish the causal graph. We generate synthetic data based on the known structural causal model [ 1 ] for the Alzheimer’s disease dataset. The parameters under consideration are sex, education, age, apoe4, moca, av45, tau, brain volume and ventricular volume. Sex is the protected attribute. Age is as the name suggests. Education refers to the number of years of education. APOE4 is a genetic risk factor. Tau is a biomarker that suggests cognitive decline. MOCA is the Montreal Cognitive Assessment Score. Brain volume refers to the total brain matter volume. Ventricular volume refers to the total ventricular volume. We omit slice number and Brain MRI variables from our analysis since those details are references to the raw Alzheimer’s disease dataset in the repo. We initially begin with experimental setup for generating linear dataset and then add the effect of unobserved confounders through a latent variable as is commonplace [ 23 ] . We generate 1,000 samples. Figure 2 : Ground truth causal graph derived for Alzheimer’s Disease dataset [ 1 ] . We use the heart failure clinical records dataset [ 7 ] for evaluating causal discovery algorithms and path-specific effects. The dataset comprises 299 participants with a combination of demographic and clinical features and is open source, making it well suited for analysis. The features include demographic variables (age, gender), comorbidities (anaemia, diabetes, hypertension status, smoking status), physiological measurements (serum creatinine, serum sodium, ejection fraction, platelets, creatinine phosphokinase), time from admission to death, and the mortality outcome. 2.3 Ground Truth Causal Graph We use the Alzheimer’s disease benchmark dataset based on the paper in the causal modeling agents paper [ 1 ] . The graph is as shown in Fig 2 . We selected a graph from a single expert to demonstrate the effect of protected attributes on the outcome along with the mediators and confounders. Figure 3 : Benchmark causal graph for Heart Failure Clinical Record Dataset [ 7 ] . We establish the causal graph benchmark shown in Figure 3 by working closely with a domain expert. Higher blood pressure and elevated serum creatinine indicate presence of chronic kidney disease causing electrolyte imbalance leading to lower serum sodium [ 21 ] . Further, advanced heart failure increases likelihood of cardiac injury leading to elevated creatine phosphokinase (CPK) levels [ 2 ] . Lifestyle and metabolic factors act as critical precursors in this network. Smoking serves as a significant accelerator by causing elevated blood pressure and doubling the risk of developing heart failure [ 10 ] . Similarly, untreated hypertension eventually causes heart failure and a subsequent reduction in ejection fraction [ 13 ] . Diabetes acts as a central node in this causal structure, directly leading to kidney disease and frequently co-existing with high blood pressure to exacerbate heart failure progression [ 25 ] . Anemia often emerges as a consequence of CKD, forcing the heart to work harder to pump oxygen-deficient blood, thereby worsening heart failure outcomes [ 18 ] . Serum creatinine levels may rise due to direct damage from diabetes or as a secondary effect of low ejection fraction, leading to fluid retention and decreased serum sodium [ 18 ] . Finally, a lack of consistent follow-up, particularly in patients with chronic conditions like diabetes, leads to poor disease management and an increased probability of a death event [ 11 ] . 2.4 Causal Discovery We perform causal discovery using constraint-based, score-based, and continuous-optimization methods. We chose this mix to compare how different algorithm families recover structure under mixed-type data and latent confounders. For the Alzheimer’s disease dataset, we ran

Read the complete text