Distributionally Robust Graph Out-of-Distribution Recommendation via Diffusion Model

Chu Zhao, Enneng Yang, Yuliang Liang, Jianzhe Zhao, Guibing Guo, Xingwei Wang · 2025

Read Distributionally Robust Graph Out-of-Distribution Recommendation via Diffusion Model by Chu Zhao, Enneng Yang, Yuliang Liang, Jianzhe Zhao, Guibing Guo, Xingwei Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-15555.txt.

Introduction

Chu Zhao and five co-authors strengthen recommendation systems against shifting user tastes, in this 2025 paper. Recommenders trained on past clicks often falter when the data distribution changes. Robust training methods guard the worst case, but the team found a flaw: those methods give extra weight to noisy samples, so the model ends up learning junk.

Their model, DRGO, first cleans the data's inner code with a diffusion step that softens noise. An entropy term in the training goal then stops any sample from gaining extreme weight. The authors prove a bound on the model's error and show why the design blunts noise. Tests on four data sets and three kinds of distribution shift beat rivals, both when test data matched training and when it shifted. The work serves teams that deploy recommenders in changing markets.

Catalog record

CREATORChu Zhao, Enneng Yang, Yuliang Liang, Jianzhe Zhao, Guibing Guo, Xingwei Wang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE70 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-15555

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Distributionally Robust Graph Out-of-Distribution Recommendation via Diffusion Model Chu Zhao, Enneng Yang, Yuliang Liang, Jianzhe Zhao, Guibing Guo, Xingwei Wang Abstract . The distributionally robust optimization (DRO)-based graph neural network methods improve recommendation systems’ out-of-distribution (OOD) generalization by optimizing the model’s worst-case performance. However, these studies fail to consider the impact of noisy samples in the training data, which results in diminished generalization capabilities and lower accuracy. Through experimental and theoretical analysis, this paper reveals that current DRO-based graph recommendation methods assign greater weight to noise distribution, leading to model parameter learning being dominated by it. When the model overly focuses on fitting noise samples in the training data, it may learn irrelevant or meaningless features that cannot be generalized to OOD data. To address this challenge, we design a D istributionally R obust G raph model for O OD recommendation (DRGO). Specifically, our method first employs a simple and effective diffusion paradigm to alleviate the noisy effect in the latent space. Additionally, an entropy regularization term is introduced in the DRO objective function to avoid extreme sample weights in the worst-case distribution. Finally, we provide a theoretical proof of the generalization error bound of DRGO as well as a theoretical analysis of how our approach mitigates noisy sample effects, which helps to better understand the proposed framework from a theoretical perspective. We conduct extensive experiments on four datasets to evaluate the effectiveness of our framework against three typical distribution shifts, and the results demonstrate its superiority in both independently and identically distributed distributions (IID) and OOD. Our code is available at https://github.com/user683/DRGO . Conference: Proceedings of the ACM Web Conference 2025; April 28-May 2, 2025; Sydney, NSW, Australia Proceedings of the ACM Web Conference 2025 (WWW ’25), April 28-May 2, 2025, Sydney, NSW, Australia DOI: 10.1145/3696410.3714848 ISBN: 979-8-4007-1274-6/25/04 CCS: Information systems Recommender systems 1. Introduction Recently, Graph Neural Network (GNN)-based recommendation methods have gained extensive attention in various recommendation tasks and scenarios ( Li et al., 2023 ; Liu et al., 2019 ; Gao et al., 2023 ; Zhang et al., 2019 ; Zhu et al., 2019 ) . Generally, GNN-based methods learn embeddings of users or items by capturing high-order collaborative signals from the user-item interaction graph. Although these GNN-based methods have achieved state-of-the-art performance in the collaborative recommendation, some assume that the training and test sets follow an independent and identical distribution (IID). Unfortunately, this assumption may not hold when faced with out-of-distribution (OOD) data (i.e., distribution shift) in real-world recommendation scenarios. Such data distribution shifts may arise from various factors, such as changes in user consumption habits influenced by seasons, holidays, policies, etc. Additionally, various biases (e.g., popularity bias and exposure bias) in the recommendation system can lead to inconsistencies between training and test data distributions. Existing works have attempted to address the challenge of distribution shift using various techniques to enhance the generalization of recommendation models. For instance, some works ( Wang et al., 2022b ; He et al., 2022 ; Zhao et al., 2024b ) use causal learning and approximate inference methods to infer environment labels and further learn representations that are insensitive to the environment. Some works ( Wang et al., 2022a ; Zhang et al., 2024a ) achieve OOD generalization by directly decoupling user-variant and invariant representations. In addition, other works employ data augmentation or self-supervised learning ( Wu et al., 2021 ; Yu et al., 2022 ) methods to enhance the generalization performance of GNN-based methods on OOD data. However, the methods mentioned above also have some limitations in addressing distribution shifts: (1) The performance of these methods, such as ( Wang et al., 2022b ; He et al., 2022 ; Zhao et al., 2024b ) , relies on explicit environments as labels. If the environmental factors cannot be inferred, achieving satisfactory generalization will be difficult. And these methods ( Wang et al., 2022a ; Zhang et al., 2024a ) to disentangle variations from invariant preferences lack theoretical guarantees. (2) These methods ( Yu et al., 2022 ; Wu et al., 2021 ; Yu et al., 2022 ) target a specific type of bias, such as popularity bias, and cannot address scenarios with multiple complex data distribution shifts. Recently, to address the limitations of these methods, researchers are leveraging Distributionally Robust Optimization (DRO) ( Rahimian and Mehrotra, 2019 ) to enhance recommendation models’ ability to generalize beyond their training data ( Wang et al., 2024 ; Zhao et al., 2023 ; Yang et al., 2023 ) . DRO focuses on improving model robustness by considering a set of potential distributions and optimizing performance for the worst-case scenario among them. This approach helps ensure the model performs well even when facing distribution shifts or operating in new environments. Despite the success, our experimental and theoretical analyses suggest that existing DRO-based recommendation methods still face the following two challenges: • Challenge 1 : Existing DRO-based recommendation methods ( Wang et al., 2024 ; Zhao et al., 2023 ) assign greater weight to noise distribution when searching for the worst-case scenario. This causes model parameter learning to be dominated by noise, leading to overfitting on irrelevant features and further reducing generalization on OOD data. • Challenge 2 : Certain DRO methods based on the Kullback-Leibler (KL) divergence ( Yang et al., 2023 ; Wang et al., 2024 ) assume that there is an overlap between the distributions of prior interactions and the testing phase. However, due to the randomness and unpredictability of user behavior, the overlap between the test distribution and the training distribution may be minimal or even nonexistent, which makes this assumption limited. This situation hinders the effective computation of the KL divergence, thereby restricting the robustness and performance of the model. (a) Weight Visualization (b) Impact of Noisy Figure 1. (a) Divide the user-item interaction data in the Yelp2018 dataset into a major group (90%) and a minor group (10%) based on user activity levels. Inject an additional 10% of the data as a noise group. Compare the performance of DRO-LightGCN and our DRGO, observing the weight changes for each group across multiple iterations. (b) The model’s performance under different noise levels on the Yelp2018 dataset. For the first challenge, as illustrated in Figure 1 , we conduct experiments to verify how noise samples affect the generalization performance of the DRO model. Figure 1 (a) illustrates the weight changes across different groups after several training iterations, revealing that the performance of DRO-LightGCN ( Zhao et al., 2023 ; Wang et al., 2024 ) is affected by the noise distribution. Figure 1 (b) shows performance variations under different noise ratios, indicating that when the noisy ratio exceeds 20%, the performance of DRO-LightGCN falls behind that of LightGCN. Although DR-GNN is also affected by noisy data, its data augmentation component can alleviate the impact of noise to some extent. Section 3.1 provides a more detailed theoretical analysis of the challenges mentioned above. Considering the limitations and challenges of current solutions, we introduce a novel Distributionally Robust Graph framework, termed DRGO, aimed at improving the robustness and generalization of recommendation systems when dealing with OOD data. To address the first challenge, our DRGO utilizes a graph variational autoencoder to encode the feature structure of

Read the complete text