Comparing Methods for Bias Mitigation in Graph Neural Networks

Barbara Hoffmann, Ruben Mayer · 2025

Read Comparing Methods for Bias Mitigation in Graph Neural Networks by Barbara Hoffmann, Ruben Mayer (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-22569.txt.

Introduction

Barbara Hoffmann and Ruben Mayer compare three ways to cut bias in graph neural networks, which prep data for generative AI systems. Fairness in such networks shapes how just the end systems act. Their work came out in twenty twenty-five.

The three routes are data thinning, feature edits, and synthetic data growth. Trials on a German credit data set scored each by fairness gauges like parity, equal opportunity, and false positive rates. All three beat the raw data. Stratified sampling and synthetic growth via GraphSAGE stood out, balancing group shares while holding model skill, the authors report.

Catalog record

CREATORBarbara Hoffmann, Ruben Mayer
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE18 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-22569

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Comparing Methods for Bias Mitigation in Graph Neural Networks Barbara Hoffmann, Ruben Mayer Abstract This paper examines the critical role of Graph Neural Networks (GNNs) in data preparation for generative artificial intelligence (GenAI) systems, with a particular focus on addressing and mitigating biases. We present a comparative analysis of three distinct methods for bias mitigation: data sparsification, feature modification, and synthetic data augmentation. Through experimental analysis using the german credit dataset, we evaluate these approaches using multiple fairness metrics, including statistical parity, equality of opportunity, and false positive rates. Our research demonstrates that while all methods improve fairness metrics compared to the original dataset, stratified sampling and synthetic data augmentation using GraphSAGE prove particularly effective in balancing demographic representation while maintaining model performance. The results provide practical insights for developing more equitable AI systems while maintaining model performance. Introduction The increasing use of generative artificial intelligence (GenAI) systems has increased the importance of data preparation to ensure fair and unbiased results ( Sengar et al. 2024 ) . Graph Neural Networks (GNNs), with their ability to process and learn from complex relational data structures, can be used as powerful tools in this preparatory phase. The effectiveness of GNNs, though, is inherently limited by the quality and representativeness of the underlying data they process ( Min et al. 2022 ) . Data bias presents a particular challenge in this context, as it can be amplified through the various stages of artificial intelligence (AI) system development, from initial data preparation to final model outputs. Datasets often do not reflect a perfect world scenario, underrepresenting certain groups or individuals. Such imbalances can lead to discriminatory outcomes in AI applications, if not properly addressed. Our research investigates different distinct approaches to mitigating biases while maintaining the utility of GNNs in data preparation. This paper makes the following key contributions to the field: • A comparative analysis of different bias mitigation strategies • An evaluation of their impact on both fairness metrics and model performance • A balanced approach to synthetic data generation using GraphSAGE ( Hamilton, Ying, and Leskovec 2017 ) that preserves network structure while improving demographic representation The Role of GNNs in Generative AI GNNs have the potential to significantly contribute to the preparation of data for GenAI systems. GNNs are a type of neural network specifically designed to process graph-structured data ( Scarselli et al. 2008 ) ( Gori, Monfardini, and Scarselli 2005 ) , where they model both the entities as nodes and their interconnections as edges. By learning representations of these graphs or their components, GNNs are able to make predictions based on their structure ( Vatter, Mayer, and Jacobsen 2023 ) . While GNNs are not inherently generative models, they can be integrated into generative workflows in several ways. 1. GNNs as a tool for data preparation in generative AI: GNNs can play a role in preparing data for generative models, particularly when the data exhibits complex relationships between entities. GNNs can learn the underlying structure of these relationships and provide representative graph-based features as input for generative models. By extracting meaningful information from graph data, GNNs help generative models produce more realistic and contextually appropriate results. This means the GNNs process existing graph data to create input features for generative models. The role is to understand and represent relationships, whereas the actual generation is done in the next step by a separate model. 2. Graph-based generative models: Generative models that utilize graph structures can also be applied in data preparation. For example, a graph-based generative model can be used to impute missing data or infer new connections in an incomplete dataset ( Zikas et al. 2023 ) , making it more suitable for subsequent machine learning tasks. The focus lies on improving existing datasets with a specific purpose for the generated content. Some generative models are built on GNNs to create new structures, such as molecular compounds or networks ( Xia et al. 2019 ) ( Ingraham et al. 2019 ) . The focus is on creating entirely new structure and the end goal is the generated content itself. The Importance of Data Quality for Bias Mitigation Data quality is essential for the effective performance of machine learning (ML) models, as low-quality data can lead to unreliable and inaccurate predictions ( Kariluoto et al. 2021 ) . There are different dimensions that influence the quality of data, for example: 1. Completeness: The degree to which a dataset has missing values across its features ( Budach et al. 2022 ) . 2. Feature Accuracy: The degree to which the feature values in the dataset accurately represent the true/ground truth values ( Budach et al. 2022 ) . Completeness is one of the most influential dimensions, as missing values can significantly impair performance, particularly when the training data is largely complete while the test data is not ( Daraio, Di Leo, and Scannapieco 2022 ) . Feature accuracy also plays a crucial role, as errors in feature values can lead to unreliable patterns, causing the model to learn spurious relationships that reduce generalization to new data ( Budach et al. 2022 ) . Bias can emerge through these data quality dimensions in several ways. Completeness is particularly susceptible to bias, as missing data often isn’t random but systematically related to underlying social, economic, or demographic factors. For instance, in financial datasets, certain populations might be underrepresented due to limited access to banking and credit services or through facing systemic barriers like gender-based income disparities. This incompleteness can create a feedback loop where models trained on such data further marginalize these groups by making less accurate predictions for them. Feature accuracy bias arises when measurement errors or data collection processes disproportionately misrepresent characteristics of specific groups. When expanding or generating data for a dataset, it is crucial to account for feature accuracy to ensure fairness and reliability. Methods to Mitigate Bias in GNNs Graph data is frequently derived from models of the real world, but these graphs often present a skewed or incomplete picture of reality. This issue becomes particularly concerning when a dataset includes sensitive information that could lead to biased treatment of certain groups due to their underrepresentation. To establish the fairest foundation, we assume it is ideal for a dataset to contain an equal distribution of nodes with regard to the sensitive attribute. Since simply omitting a sensitive attribute, such as removing the sensitive feature, does not always suit the needs of the use case, a better approach is to adjust the dataset to ensure the feature is evenly represented across groups. Achieving equal distribution requires adjustments to the dataset, such as sparsification of the overrepresented group, augmentation of the underrepresented group, or changing features to shift group membership. Mitigation via Sparsification We propose using three sampling methods for handling graph sparsification with a focus on fairness: random sampling, stratified sampling ( Cochran 1977 ) ( He and Garcia 2009 ) , and class weighted sampling ( Chawla et al. 2002 ) ( Batista, Prati, and Monard 2004 ) . The advantage of these methods lies in their simplicity and ability to balance the dataset while retaining key information. Mitigation via Changing Features We assume that the

Read the complete text