Debiasing Message Passing to Mitigate Popularity Bias in GNN-based Collaborative Filtering
Md Aminul Islam, Ahmed Sayeed Faruk, Sourav Medya, Elena Zheleva · 2026
Read Debiasing Message Passing to Mitigate Popularity Bias in GNN-based Collaborative Filtering by Md Aminul Islam, Ahmed Sayeed Faruk, Sourav Medya, Elena Zheleva (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-11145.txt.
Introduction
Md Aminul Islam, Ahmed Sayeed Faruk, Sourav Medya, and Elena Zheleva debias message passing in graph-neural-network recommenders to fight popularity bias. Recommenders pass user-item signals over interaction graphs, but skewed distributions and repeated high-order message combining boost popular items while burying long-tail ones.
Existing re-weighting, penalty, causal, and post-processing debiasing falls short in graph settings because it never counters bias inside message combining. Recent in-combining weightings lean on static rules of thumb or unstable vectors. Their DPAA framework weaves adaptive interaction weights that respect encodings, plus layer-wise weights, straight into message passing. Weights come from a representation-based popularity signal steadied by a smooth shift from pretrained to shifting vectors. Recommender teams get debiasing that acts where bias actually spreads.
Catalog record
| CREATOR | Md Aminul Islam, Ahmed Sayeed Faruk, Sourav Medya, Elena Zheleva |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 74499 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.11145
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Debiasing Message Passing to Mitigate Popularity Bias in GNN-based Collaborative Filtering Conference: ACM Conference; May 2026; Washington, DC, USA Thanks: This is a preprint version. CCS: Information systems Recommender systems Md Aminul Islam, Ahmed Sayeed Faruk, Sourav Medya, Elena Zheleva Abstract . Collaborative filtering (CF) models based on graph neural networks (GNNs) achieve strong performance in recommender systems by propagating user-item signals over interaction graphs. However, they are highly susceptible to popularity bias, since skewed interaction distributions and repeated message passing across high-order neighborhoods amplify the influence of popular items while suppressing long-tail ones. Existing debiasing approaches, including re-weighting objectives, regularization, causal methods, and post-processing, are less effective in GNN-based settings because they do not directly counteract bias propagated through the aggregation process, and recent in-aggregation weighting methods often rely on static heuristics or unstable embedding estimates. We propose Debiasing Popularity Amplification in Aggregation (DPAA), a popularity debiasing framework for GNN-based CF that integrates adaptive, embedding-aware interaction weighting and layer-wise weighting directly into message passing. DPAA assigns interaction-level weights from a representation-aware popularity signal, stabilized by a smooth transition from pre-trained to evolving model embeddings during training. It further introduces a layer-wise weighting that amplifies higher-order neighborhoods, surfacing long-range interactions with diverse and underexposed items. Experiments on real-world and semi-synthetic datasets show that DPAA outperforms state-of-the-art popularity-bias correction methods for GNN-based CF. 1. Introduction Recommender systems have become a fundamental component of modern online platforms, enabling users to efficiently navigate large-scale information spaces and discover personalized content. These systems are deployed across diverse and increasingly complex digital ecosystems, including e-commerce platforms, social networks, video-sharing platforms, and lifestyle applications ( 12 ) . Collaborative filtering (CF) is a widely used recommendation paradigm that underpins many modern recommender systems. It infers user preferences directly from historical interaction data by leveraging patterns of similar user behavior ( 35 ) . In recent years, Graph Neural Networks (GNNs) have emerged as a powerful extension of traditional CF methods ( 22 ; 23 ; 33 ; 65 ) . By representing user-item interactions as a bipartite graph, GNN-based CF models learn expressive embeddings through iterative neighborhood aggregation, capturing high-order connectivity and collaborative signals. This graph-based formulation enables more accurate modeling of complex user-item interactions and has yielded state-of-the-art performance on recommendation tasks ( 18 ; 22 ; 65 ) . Recommender systems rely heavily on interaction data (e.g., clicks) to infer user preferences, but such data is often biased ( 3 ; 25 ) , especially toward popular items ( 77 ) . User interactions are not only driven by true preferences but are also influenced by exposure mechanisms, as users are more likely to interact with frequently displayed items ( 12 ) . Hence, observed interactions typically follow a long-tail distribution ( 68 ) , causing CF models trained on them to capture and reinforce popularity bias ( 8 ; 64 ) . Figure 1 shows the training data distributions for three real-world datasets. Popular items are the smallest set of items that accounts for 80\% of observed interactions, while the remaining items are treated as long-tail items. A small fraction of items receives 80% of interactions, highlighting the strong popularity skew in real-world data. Figure 1 . Training data distribution across real-world datasets. Popular items account for \bm{80\%} of interactions, while the remaining items form the long-tail group. The popularity bias problem is further amplified in GNN-based CF, where message passing repeatedly propagates signals from high-degree popular items across local and higher-order neighborhoods ( 77 ; 11 ) . Compared with sparsely connected niche items, popular items appear in many neighborhoods and exert disproportionate influence as their signals diffuse more broadly during message passing ( 10 ; 11 ) . This repeated aggregation pulls user embeddings toward popularity-dominated regions, making popular items appear close to many users, increasing their predicted scores ( 77 ) , and causing them to be recommended more frequently. Such dynamics create a “rich-get-richer” feedback loop ( 9 ) , where popular items get more exposure while relevant long-tail items remain underexposed, degrading recommendation quality and user experience. Existing popularity bias mitigation methods typically rely on IPW-based re-weighting ( 3 ; 20 ; 25 ) , regularization ( 6 ; 14 ; 31 ; 34 ; 51 ; 69 ) , causal modeling ( 5 ; 21 ; 41 ; 53 ; 59 ; 75 ) , or post-processing ( 2 ; 11 ; 24 ; 48 ; 78 ) techniques. However, they do not directly address the repeated propagation and amplification of popularity bias during GNN aggregation ( 11 ; 26 ; 77 ) . To address this issue in GNN-based CF, recent studies ( 26 ; 77 ) incorporate weighting mechanisms directly into aggregation, assigning lower weights to interactions involving popular items, similar to propensity-based adjustments, to mitigate their disproportionate influence during message passing. For example, APDA ( 77 ) estimates these weights from the evolving user and item embeddings during training. However, early-epoch parameters can be noisy and unreliable due to rapid changes in weights and gradients ( 17 ) . Since these noisy weights are applied during aggregation, they can distort representation learning by propagating erroneous signals into node representations in later epochs. NAVIP ( 26 ) weights aggregation using static interaction counts and ignores embedding-space popularity signals, limiting its ability to mitigate popularity amplification in learned representations. TSP ( 24 ) mitigates topology-induced bias after training to improve long-tail recommendations, but post-hoc correction cannot address how biased graph structure and repeated propagation of popularity signals shape representation learning. DAP ( 11 ) , a post-hoc GNN-based method, measures popularity using node degree information, without considering interaction-level popularity effects encoded in the node embeddings. We propose Debiasing Popularity Amplification in Aggregation (DPAA), a popularity debiasing framework for GNN-based CF that directly applies bias-correcting weights to user-item interactions during GNN aggregation. These weights downweight interactions during aggregation that are more likely to reflect popularity-induced interactions and upweight interactions involving niche items. We introduce an embedding-aware interaction-strength metric that quantifies popularity-induced alignment in the embedding space at interaction level and use it to assign weights during aggregation. To stabilize weight estimation in early training, the metric is initialized from a pre-trained model (e.g., the base recommendation model) and gradually transitions to the current model embeddings as they become reliable, yielding robust debiasing throughout training. To address popularity bias beyond interaction-level, we further introduce a layer-wise weighting mechanism in aggregation. Our main contributions are summarized as follows: • Direct bias correction. We propose DPAA, a unified popularity debiasing framework for GNN-based CF that directly mitigates popularity amplification during message passing. DPAA combines stabilized adaptive embedding-aware bias-correcting weights with layer-wise weights to address both interaction-level and layer-level sources of popularity within a single aggregation framework. • Theoretical characterization. We show theoretically that our method DPAA reduces popularity dominance. More specifically, interaction-level weighting lowers the relative contribution of popular items depending on the severity of popularity bias, while layer-wise weighting increases the role of higher-order collaborative signals beyond shallow popularity-driven interactions. • Novel semi-synthetic data generation process. Unlike prior studies that do not systematically evaluate debiasing methods under controlled popularity bias severity, we develop a semi-synthetic click data generation process