Counterfactual Fairness Evaluation of Machine Learning Models on Educational Datasets
Woojin Kim, Hyeoncheol Kim · 2025
Read Counterfactual Fairness Evaluation of Machine Learning Models on Educational Datasets by Woojin Kim, Hyeoncheol Kim (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-11504.txt.
Introduction
Woojin Kim and Hyeoncheol Kim examine counterfactual fairness in machine learning for education in a 2025 paper. Models now flag at risk students and predict performance, raising bias concerns. Most fairness work in education checks group averages, while fairness for a single student in a causal sense is rarely studied.
Counterfactual fairness asks whether a model's call on a student would change if a sensitive trait were different, with all else held fixed. The authors run such checks on benchmark education datasets. They show the method reveals how sensitive traits cause outcomes, not just correlate with them. The paper argues causal individual fairness adds a layer of insight that group measures miss in school settings.
Catalog record
| CREATOR | Woojin Kim, Hyeoncheol Kim |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-11504
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Counterfactual Fairness Evaluation of Machine Learning Models on Educational Datasets Woojin Kim, Hyeoncheol Kim Abstract As machine learning models are increasingly used in educational settings, from detecting at-risk students to predicting student performance, algorithmic bias and its potential impacts on students raise critical concerns about algorithmic fairness. Although group fairness is widely explored in education, works on individual fairness in a causal context are understudied, especially on counterfactual fairness. This paper explores the notion of counterfactual fairness for educational data by conducting counterfactual fairness analysis of machine learning models on benchmark educational datasets. We demonstrate that counterfactual fairness provides meaningful insight into the causality of sensitive attributes and causal-based individual fairness in education. 1 Introduction Machine learning models are increasingly implemented in educational settings to support automated decision-making processes. Such applications ranges from academic success prediction [ 33 , 50 ] , at-risk detection [ 25 ] , automated grading [ 42 ] , knowledge tracing [ 38 ] and personalized recommendation [ 53 ] . However, the application of machine learning models to automate decision-making in high-stakes scenarios calls for consideration of algorithmic bias [ 1 ] . In education, predictive models have been shown to exhibit lower performance for students from underrepresented demographic groups [ 40 , 3 , 6 , 21 , 34 ] . The majority of research on fairness in education focuses on group fairness [ 40 , 21 ] , while works on individual fairness are limited to aiming for similar treatment of similar individuals [ 20 , 10 ] . Under context where students’ demographics causally shape their education [ 45 , 11 , 27 ] , taking causality in consideration of fairness is crucial. Causal fairness asserts that it is unfair to produce different decisions for individuals caused by factors beyond their control [ 28 ] . In this sense, algorithmic decisions that impact students should eliminate the causal effects of uncontrollable variables, such as race, gender, and disability. Group and individual fairness definitions have certain limitations, and the inherent incompatibility between group and individual fairness presents challenges [ 2 , 31 , 52 , 48 ] . Group fairness can mask heterogeneous outcomes of individuals by using group-wise averaging measurements [ 2 , 31 ] . While group fairness may be achieved, it does not ensure fairness for each individual [ 52 ] . Furthermore, ignoring individual fairness in favor of group fairness can result in algorithms making different decisions for identical individuals [ 29 ] . Individual fairness faces difficulty in selecting distance metrics for measuring the similarity of individuals and is easily affected by outlier samples [ 49 ] . Based on the limitations of group and individual fairness notions, we empirically investigate the potential of counterfactual fairness on educational datasets. Counterfactual fairness ensures that the algorithm’s decision would have remained the same when the individual belongs to a different demographic group, other things being equal [ 23 ] . Counterfactual fairness promotes individual-level fairness by removing the causal influence of sensitive attributes on the algorithm’s decisions. To the best of our current knowledge, the notion of counterfactual fairness has not been investigated in the educational domain. In this paper, we aim to answer the following research questions(RQ): 1. What causal relationships do sensitive attributes have in educational data? 2. Does counterfactual fairness in educational data lead to identical outcomes for individual students regardless of demographic group membership? 3. Does counterfactually fair machine learning models result in a performance trade-off in educational data? These questions are investigated by estimating a causal model and implementing a counterfactual fairness approach on real-world educational datasets. Section 2 introduces counterfactual fairness and algorithmic fairness in education. In Section 3 , we provide methodologies for creating causal models and counterfactual fairness evaluation metrics. We present the experiment result in Section 4 . In Section 5 , we discuss the key findings of our study, exploring their implications for fairness in educational data before concluding in Section 6 . 2 Background 2.1 Causal Model and Counterfactuals Counterfactual fairness adopts the Structural Causal Model(SCM) framework [ 35 ] for the calculation of counterfactual samples. SCM is defined as a triplet (U,V,F) where U is a set of unobserved variables, V is a set of observed variables, and F is a set of structural equations describing how observable variables are determined. Given a SCM, counterfactual inference is to determine P(Y_{Z\leftarrow z}(U)|W=w) , which indicates the probability of Y if Z is set to z (i.e. counterfactuals), given that we observed W=w . Imagine a female student with a specific academic record. What would be the probability of her passing the course if her gender were male while keeping all other observed academic factors constant? Counterfactual inference on SCM allows us to calculate answers to counterfactual queries by abduction, action, and prediction inference steps detailed in [ 35 ] . 2.2 Counterfactual Fairness We follow the definition of counterfactual fairness by Kusner et al. [ 23 ] . Definition 1 (Counterfactual Fairness) Predictor \hat{Y} is counterfactually fair if under any context X=x and A=a , P(\hat{Y}_{A\leftarrow a}(U)=y|X=x,A=a)=P(\hat{Y}_{A\leftarrow a^{\prime}}(U)=y|X=x,A=a), for all y and for any value a’ attainable by A. The definition states that changing A should not change the distribution of the predicted outcome \hat{Y} . An algorithm is counterfactually fair towards an individual if an intervention in demographic group membership does not change the prediction. For instance, the predicted probability of a female student passing a course should remain the same as if the student had been a male. Implementing counterfactual fairness requires a causal model of the real world and the counterfactual inference of samples under the causal model. This process allows for isolating the causal influence of the sensitive attribute on the outcome. Counterfactual fairness is explored in diverse domains, such as in clinical decision support [ 47 ] and clinical risk prediction [ 36 , 44 ] for healthcare, ranking algorithm [ 37 ] , image classification [ 9 , 22 ] and text classification [ 16 ] . 2.3 Algorithmic Fairness in Education Most works on algorithmic fairness in education focus on group fairness [ 40 , 21 ] . The group fairness definition states that an algorithm is fair if its prediction performance is equal among subgroups, specifically requiring equivalent prediction ratios for favorable outcomes. Common definitions of group fairness are Equalized Odds [ 17 ] , Demographic Parity [ 14 ] and Equal Opportunity [ 17 ] . Individual fairness requires individuals with similar characteristics to receive similar treatment. Research on individual fairness in education focuses on the similarity. Marras et al. [ 32 ] proposed a consistency metric for measuring the similarity of students’ past interactions for individual fairness under a personalized recommendation setting. Hu and Rangwala [ 20 ] developed a model architecture for individual fairness in at-risk student prediction task. Doewes et al. [ 12 ] proposed a methodology to evaluate individual fairness in automated essay scoring. Deho et al. [ 10 ] performed individual fairness evaluation of existing fairness mitigation methods in learning analytics. There have been attempts to understand causal factors influencing academic success. Ferreira de Carvalho et al. [ 4 ] identifies causal relationships between