Can Synthetic Data be Fair and Private? A Comparative Study of Synthetic Data Generation and Fairness Algorithms
Qinyi Liu, Oscar Deho, Farhad Vadiee, Mohammad Khalil, Srecko Joksimovic, George Siemens · 2025
Read Can Synthetic Data be Fair and Private? A Comparative Study of Synthetic Data Generation and Fairness Algorithms by Qinyi Liu, Oscar Deho, Farhad Vadiee, Mohammad Khalil, Srecko Joksimovic, George Siemens (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-01785.txt.
Introduction
Qinyi Liu and co-authors ask in 2025 whether fake data can be both fair and private for learning analytics. Schools use models on student data, which raises bias and privacy worries. Synthetic data promises to guard both at once, yet the two goals often pull apart. The team compared data generators and fairness methods, including ones usually applied to real data.
A method called DECAF struck the best balance between privacy and fairness, though its accuracy lagged. Fairness pre-processing worked even better on synthetic data than on real data. The authors suggest pairing the two approaches. Their study offers a route to school models that treat students more evenly while keeping records safe.
Catalog record
| CREATOR | Qinyi Liu, Oscar Deho, Farhad Vadiee, Mohammad Khalil, Srecko Joksimovic, George Siemens |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-01785
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Can Synthetic Data be Fair and Private? A Comparative Study of Synthetic Data Generation and Fairness Algorithms Qinyi Liu, Oscar Deho, Farhad Vadiee, Mohammad Khalil, Srecko Joksimovic, George Siemens Abstract . The increasing use of machine learning in learning analytics (LA) has raised significant concerns around algorithmic fairness and privacy. Synthetic data has emerged as a dual-purpose tool, enhancing privacy and improving fairness in LA models. However, prior research suggests an inverse relationship between fairness and privacy, making it challenging to optimize both. This study investigates which synthetic data generators can best balance privacy and fairness, and whether pre-processing fairness algorithms, typically applied to real datasets, are effective on synthetic data. Our results highlight that the DEbiasing CAusal Fairness (DECAF) algorithm achieves the best balance between privacy and fairness. However, DECAF suffers in utility, as reflected in its predictive accuracy. Notably, we found that applying pre-processing fairness algorithms to synthetic data improves fairness even more than when applied to real data. These findings suggest that combining synthetic data generation with fairness pre-processing offers a promising approach to creating fairer LA models. † † doi: XXXXXXX.XXXXXXX † † conference: ACM International Conference on Learning Analytics & Knowledge; March 03–07, 2025; Dublin,Ireland † † journalyear: 2025 † † copyright: rightsretained † † conference: LAK25: The 15th International Learning Analytics and Knowledge Conference; March 03–07, 2025; Dublin, Ireland † † booktitle: LAK25: The 15th International Learning Analytics and Knowledge Conference (LAK 2025), March 03–07, 2025, Dublin, Ireland † † doi: 10.1145/3706468.3706546 † † isbn: 979-8-4007-0701-8/25/03 † † ccs: Security and privacy Privacy-preserving protocols † † ccs: Computing methodologies ML approaches † † ccs: Applied computing Interactive learning environments 1. Introduction Machine learning (ML) models have been widely applied in the Learning Analytics (LA) field for various predictive tasks (Hellas et al . , 2018 ; Doroudi, 2024 ) . The widespread use of ML models in LA brings numerous benefits, such as improving students’ learning experiences by generating personalized learning paths through the analysis of student behavior (Sciarrone, 2018 ) . Additionally, ML provides strategic support for optimizing teaching strategies by analyzing students’ responses to courses (Sciarrone, 2018 ) . However, applying ML in LA also raises privacy concerns. Many types of student data, such as mental health data, are considered personal information and must be de-identified according to data protection laws (Liu and Khalil, 2023 ) . In this context, many privacy-preserving methods are used in conjunction with ML to meet legal privacy requirements. Among them, Synthetic Data Generators (SDGs) are considered a promising method (Jordon et al . , 2022 ) . SDGs protect privacy by allowing the sharing and publication of synthetic data instead of real data containing personal information. In addition to being used as a privacy-preserving method, SDGs can also improve algorithmic fairness. ML models that are used in LA may have different impacts on minority groups for various reasons, including class imbalance in the underlying training datasets (Luque et al . , 2019 ) and smaller sample sizes for minority groups (Buolamwini and Gebru, 2018 ) . These effects often amplify existing societal biases against minority groups under the guise of automated fairness (Cheng et al . , 2021 ) . Creating balanced synthetic datasets using SDGs to enhance classification training has been shown to help mitigate the disparate impacts caused by minority group imbalances (Abroshan et al . , 2024b ; Abusitta et al . , 2019 ) . It can be seen that SDGs can function both as contributing to fairness improvements and privacy-preserving methods. However, the impact of SDGs on fairness and privacy is not entirely positively correlated. SDGs have been proven to enhance either privacy or fairness, and there are dedicated SDGs designed specifically for privacy-preserving purposes (e.g., (Jordon et al . , 2019 ) ), as well as SDGs focused on generating fair synthetic data (e.g., (van Breugel et al . , 2021 ) ). Some studies, meanwhile, indicate that it is challenging for a single SDG to simultaneously improve both privacy and fairness (Pujol et al . , 2024 ) . Specifically, if an SDG performs well in terms of privacy, its improvement in fairness tends to be more limited, and vice versa (Pujol et al . , 2024 ) . Through our literature review, we find that previous research has primarily focused on studying which privacy-preserving SDG balanced well in terms of privacy and utility (Pereira et al . , 2024 ) or focused on studying which SDGs balance well in terms of utility and fairness (Pereira et al . , 2024 ) . There is a lack of studies examining the trade-offs between privacy and fairness across a broader range of SDGs, including privacy-preserving SDGs, fairness-focused SDGs, and general SDGs. This paper aims to fill this gap. Moreover, considering the recent advancements in Large Language Models (LLMs) within the synthetic tabular data (Borisov et al . , 2023 ) , this paper also includes an LLM-based SDG in the evaluation. In addition to studying the balance between fairness and privacy in SDGs, we also observed that prior research on improving fairness in synthetic data has predominantly applied fairness constraints during the data generation process (Pujol et al . , 2024 ; van Breugel et al . , 2021 ) . Few studies have explored the use of pre-processing fairness algorithms with SDGs. But pre-processing fairness algorithms have demonstrated good performance on real data (Mehrabi et al . , 2021 ; Deho et al . , 2022b ; Weerts et al . , 2023 ) , and investigating whether they perform similarly on synthetic data could help advance fairness in SDGs. More formally, this paper aims to investigate the following research questions (RQs) RQ1 . Which synthetic data generator performs best in terms of balancing both privacy and fairness? RQ2 . How can we improve the fairness of synthetic datasets with pre-processing fairness algorithms? To answer RQ1, we generate synthetic datasets from 3 real-world datasets using 5 SDGs and evaluate them across 4 widely used privacy metrics. We go on to train 4 popularly used ML models on the synthetic datasets and evaluate the fairness of models using 3 fairness metrics. We finally perform the privacy vs. fairness analysis. To answer RQ2, we do the following: (1) we debias the synthetic datasets that were generated in RQ1 by applying 4 pre-processing fairness algorithms, (2) we train 4 ML models on the debiased data, and (3) we investigate the improvement (or lack thereof) in fairness in terms of the 3 fairness metrics. Furthermore, we evaluate the utility of the models for both RQs by examining their predictive accuracy. By answering these questions, we make the following important contributions to privacy and fairness in LA research: • We perform an extensive and rigorous study that highlights the triangular relationship between privacy, fairness and utility. Specifically, we show that privacy and fairness might have a direct relationship as pair and joint inverse relationship with utility (i.e., predictive accuracy). • We show that the combination of the synthetic datasets with fairness algorithms results in fairer predictions as compared to the combination of real-world data and fairness algorithms. • We provide important policy implications and