Debiasing Message Passing to Mitigate Popularity Bias in GNN-based Collaborative Filtering

Md Aminul Islam, Ahmed Sayeed Faruk, Sourav Medya, Elena Zheleva · 2026

Read Debiasing Message Passing to Mitigate Popularity Bias in GNN-based Collaborative Filtering by Md Aminul Islam, Ahmed Sayeed Faruk, Sourav Medya, Elena Zheleva (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-11145.txt.

Introduction

Md Aminul Islam, Ahmed Sayeed Faruk, Sourav Medya, and Elena Zheleva debias message passing in graph-neural-network recommenders to fight popularity bias. Recommenders pass user-item signals over interaction graphs, but skewed distributions and repeated high-order message combining boost popular items while burying long-tail ones.

Existing re-weighting, penalty, causal, and post-processing debiasing falls short in graph settings because it never counters bias inside message combining. Recent in-combining weightings lean on static rules of thumb or unstable vectors. Their DPAA framework weaves adaptive interaction weights that respect encodings, plus layer-wise weights, straight into message passing. Weights come from a representation-based popularity signal steadied by a smooth shift from pretrained to shifting vectors. Recommender teams get debiasing that acts where bias actually spreads.

Catalog record

CREATORMd Aminul Islam, Ahmed Sayeed Faruk, Sourav Medya, Elena Zheleva
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE74499
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.11145

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Debiasing Message Passing to Mitigate Popularity Bias in GNN-based Collaborative Filtering Conference: ACM Conference; May 2026; Washington, DC, USA Thanks: This is a preprint version. CCS: Information systems Recommender systems Md Aminul Islam, Ahmed Sayeed Faruk, Sourav Medya, Elena Zheleva Abstract . Collaborative filtering (CF) models based on graph neural networks (GNNs) achieve strong performance in recommender systems by propagating user-item signals over interaction graphs. However, they are highly susceptible to popularity bias, since skewed interaction distributions and repeated message passing across high-order neighborhoods amplify the influence of popular items while suppressing long-tail ones. Existing debiasing approaches, including re-weighting objectives, regularization, causal methods, and post-processing, are less effective in GNN-based settings because they do not directly counteract bias propagated through the aggregation process, and recent in-aggregation weighting methods often rely on static heuristics or unstable embedding estimates. We propose Debiasing Popularity Amplification in Aggregation (DPAA), a popularity debiasing framework for GNN-based CF that integrates adaptive, embedding-aware interaction weighting and layer-wise weighting directly into message passing. DPAA assigns interaction-level weights from a representation-aware popularity signal, stabilized by a smooth transition from pre-trained to evolving model embeddings during training. It further introduces a layer-wise weighting that amplifies higher-order neighborhoods, surfacing long-range interactions with diverse and underexposed items. Experiments on real-world and semi-synthetic datasets show that DPAA outperforms state-of-the-art popularity-bias correction methods for GNN-based CF. 1. Introduction Recommender systems have become a fundamental component of modern online platforms, enabling users to efficiently navigate large-scale information spaces and discover personalized content. These systems are deployed across diverse and increasingly complex digital ecosystems, including e-commerce platforms, social networks, video-sharing platforms, and lifestyle applications ( 12 ) . Collaborative filtering (CF) is a widely used recommendation paradigm that underpins many modern recommender systems. It infers user preferences directly from historical interaction data by leveraging patterns of similar user behavior ( 35 ) . In recent years, Graph Neural Networks (GNNs) have emerged as a powerful extension of traditional CF methods ( 22 ; 23 ; 33 ; 65 ) . By representing user-item interactions as a bipartite graph, GNN-based CF models learn expressive embeddings through iterative neighborhood aggregation, capturing high-order connectivity and collaborative signals. This graph-based formulation enables more accurate modeling of complex user-item interactions and has yielded state-of-the-art performance on recommendation tasks ( 18 ; 22 ; 65 ) . Recommender systems rely heavily on interaction data (e.g., clicks) to infer user preferences, but such data is often biased ( 3 ; 25 ) , especially toward popular items ( 77 ) . User interactions are not only driven by true preferences but are also influenced by exposure mechanisms, as users are more likely to interact with frequently displayed items ( 12 ) . Hence, observed interactions typically follow a long-tail distribution ( 68 ) , causing CF models trained on them to capture and reinforce popularity bias ( 8 ; 64 ) . Figure 1 shows the training data distributions for three real-world datasets. Popular items are the smallest set of items that accounts for 80\% of observed interactions, while the remaining items are treated as long-tail items. A small fraction of items receives 80% of interactions, highlighting the strong popularity skew in real-world data. Figure 1 . Training data distribution across real-world datasets. Popular items account for \bm{80\%} of interactions, while the remaining items form the long-tail group. The popularity bias problem is further amplified in GNN-based CF, where message passing repeatedly propagates signals from high-degree popular items across local and higher-order neighborhoods ( 77 ; 11 ) . Compared with sparsely connected niche items, popular items appear in many neighborhoods and exert disproportionate influence as their signals diffuse more broadly during message passing ( 10 ; 11 ) . This repeated aggregation pulls user embeddings toward popularity-dominated regions, making popular items appear close to many users, increasing their predicted scores ( 77 ) , and causing them to be recommended more frequently. Such dynamics create a “rich-get-richer” feedback loop ( 9 ) , where popular items get more exposure while relevant long-tail items remain underexposed, degrading recommendation quality and user experience. Existing popularity bias mitigation methods typically rely on IPW-based re-weighting ( 3 ; 20 ; 25 ) , regularization ( 6 ; 14 ; 31 ; 34 ; 51 ; 69 ) , causal modeling ( 5 ; 21 ; 41 ; 53 ; 59 ; 75 ) , or post-processing ( 2 ; 11 ; 24 ; 48 ; 78 ) techniques. However, they do not directly address the repeated propagation and amplification of popularity bias during GNN aggregation ( 11 ; 26 ; 77 ) . To address this issue in GNN-based CF, recent studies ( 26 ; 77 ) incorporate weighting mechanisms directly into aggregation, assigning lower weights to interactions involving popular items, similar to propensity-based adjustments, to mitigate their disproportionate influence during message passing. For example, APDA ( 77 ) estimates these weights from the evolving user and item embeddings during training. However, early-epoch parameters can be noisy and unreliable due to rapid changes in weights and gradients ( 17 ) . Since these noisy weights are applied during aggregation, they can distort representation learning by propagating erroneous signals into node representations in later epochs. NAVIP ( 26 ) weights aggregation using static interaction counts and ignores embedding-space popularity signals, limiting its ability to mitigate popularity amplification in learned representations. TSP ( 24 ) mitigates topology-induced bias after training to improve long-tail recommendations, but post-hoc correction cannot address how biased graph structure and repeated propagation of popularity signals shape representation learning. DAP ( 11 ) , a post-hoc GNN-based method, measures popularity using node degree information, without considering interaction-level popularity effects encoded in the node embeddings. We propose Debiasing Popularity Amplification in Aggregation (DPAA), a popularity debiasing framework for GNN-based CF that directly applies bias-correcting weights to user-item interactions during GNN aggregation. These weights downweight interactions during aggregation that are more likely to reflect popularity-induced interactions and upweight interactions involving niche items. We introduce an embedding-aware interaction-strength metric that quantifies popularity-induced alignment in the embedding space at interaction level and use it to assign weights during aggregation. To stabilize weight estimation in early training, the metric is initialized from a pre-trained model (e.g., the base recommendation model) and gradually transitions to the current model embeddings as they become reliable, yielding robust debiasing throughout training. To address popularity bias beyond interaction-level, we further introduce a layer-wise weighting mechanism in aggregation. Our main contributions are summarized as follows: • Direct bias correction. We propose DPAA, a unified popularity debiasing framework for GNN-based CF that directly mitigates popularity amplification during message passing. DPAA combines stabilized adaptive embedding-aware bias-correcting weights with layer-wise weights to address both interaction-level and layer-level sources of popularity within a single aggregation framework. • Theoretical characterization. We show theoretically that our method DPAA reduces popularity dominance. More specifically, interaction-level weighting lowers the relative contribution of popular items depending on the severity of popularity bias, while layer-wise weighting increases the role of higher-order collaborative signals beyond shallow popularity-driven interactions. • Novel semi-synthetic data generation process. Unlike prior studies that do not systematically evaluate debiasing methods under controlled popularity bias severity, we develop a semi-synthetic click data generation process

Read the complete text