Causal Negative Sampling via Diffusion Model for Out-of-Distribution Recommendation DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Do Not Use This Code Generate
Chu Zhao, Enneng Yang, Yizhou Dang, Jianzhe Zhao, Guibing Guo, Xingwei Wang · 2025
Read Causal Negative Sampling via Diffusion Model for Out-of-Distribution Recommendation DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Do Not Use This Code Generate by Chu Zhao, Enneng Yang, Yizhou Dang, Jianzhe Zhao, Guibing Guo, Xingwei Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-07243.txt.
Introduction
Zhao and five co-authors propose a causal method for negative sampling in recommendation in a 2025 paper. Recommenders learn from negative examples, often picked from a fixed pool by simple rules. The authors show that hidden factors such as exposure and popularity bias can corrupt that pool.
Bad picks can act as false hard negatives and teach spurious links. Their method, CNSDiff, instead creates negatives in latent space with a conditional diffusion process. A causal regularization term further limits the effect of hidden factors. Tests under four kinds of distribution shift beat leading baselines across metrics. The authors frame the method as a route to robust out-of-distribution recommendation.
Catalog record
| CREATOR | Chu Zhao, Enneng Yang, Yizhou Dang, Jianzhe Zhao, Guibing Guo, Xingwei Wang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 68 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-07243
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Causal Negative Sampling via Diffusion Model for Out-of-Distribution Recommendation DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Do Not Use This Code Generate the Correct Terms for Your Paper CCS: Do Not Use This Code Generate the Correct Terms for Your Paper CCS: Do Not Use This Code Generate the Correct Terms for Your Paper CCS: Do Not Use This Code Generate the Correct Terms for Your Paper Chu Zhao, Enneng Yang, Yizhou Dang, Jianzhe Zhao, Guibing Guo, Xingwei Wang Abstract . Heuristic negative sampling enhances recommendation performance by selecting negative samples of varying hardness levels from predefined candidate pools to guide the model toward learning more accurate decision boundaries. However, our empirical and theoretical analyses reveal that unobserved environmental confounders (e.g., exposure or popularity biases) in candidate pools may cause heuristic sampling methods to introduce false hard negatives (FHNS). These misleading samples can encourage the model to learn spurious correlations induced by such confounders, ultimately compromising its generalization ability under distribution shifts. To address this issue, we propose a novel method named C ausal N egative S ampling via Diff usion (CNSDiff). By synthesizing negative samples in the latent space via a conditional diffusion process, CNSDiff avoids the bias introduced by predefined candidate pools and thus reduces the likelihood of generating FHNS. Moreover, it incorporates a causal regularization term to explicitly mitigate the influence of environmental confounders during the negative sampling process, leading to robust negatives that promote out-of-distribution (OOD) generalization. Comprehensive experiments under four representative distribution shift scenarios demonstrate that CNSDiff achieves an average improvement of 13.96% across all evaluation metrics compared to state-of-the-art baselines, verifying its effectiveness and robustness in OOD recommendation tasks. The code is available at https://github.com/user683/CNSDiff . 1. Introduction Random negative sampling ( Yang et al. 2024 ; Xu et al. 2022 ) selects negative examples randomly from the set of items that a user has not interacted with, which helps prevent model overfitting and refine the decision boundary. Therefore, it has been widely applied in recommendation systems ( Koren et al. 2009 ; Ma et al. 2024b ) . To further improve model performance, researchers have proposed various enhanced strategies over the past decade. For example, Predefined Negative Sampling ( Song et al. 2015 ; Zhang et al. 2024b ) fixes negative examples during data preprocessing, while Popularity-based Negative Sampling ( Yang et al. 2023 ; Wang et al. 2019 ) selects negative samples based on item popularity, where more popular items are more likely to be chosen. Although these methods improve the quality of negative samples, they typically rely on a fixed hardness level, making it difficult to adapt to the model’s varying discriminative ability at different training stages. Consequently, negative samples may be too challenging in the early stages, hindering convergence, or too simple in later stages, providing insufficient supervision signals, which limits the further improvement of model performance. To address this issue, recent studies have focused on Heuristic Negative Sampling ( Huang et al. 2021 ; Lai et al. 2024 ; Ma et al. 2023 ) , which dynamically selects negative samples of varying hardness during training from predefined candidate pools. This approach continuously provides training signals that match the model’s current capability, thereby accelerating convergence and improving recommendation performance. Although heuristic negative sampling methods have shown strong performance in improving recommendation accuracy, our theoretical and empirical analyses reveal that their reliance on predefined candidate pools makes them vulnerable to unobserved confounders within the pool, which can lead to the inclusion of false hard negatives (FHNS) and ultimately undermine the model’s generalization ability. Such samples force the model to learn spurious correlations induced by environmental factors, ultimately degrading its generalization performance under distribution shifts. Taking popularity as an example, low-exposure or niche items often fail to interact with users, but this does not imply that users are uninterested in them. Heuristic hard negative sampling, however, may mistakenly treat these potential positives as hard negatives that are highly similar to the user. For instance, a user may have a strong preference for an independent niche music brand, but due to its low popularity, it has never been recommended to them. Since the current embedding of such music brand is very close to this item, it is erroneously sampled as a hard negative. Compared to general false negatives, FHNS are more harmful: due to their high similarity to positive samples, the model is continuously “pushed away” from them during training, reinforcing incorrect decision boundaries. As a result, the model learns not the true preferences, but incorrectly associates “low-popularity, high-similarity items” with negative feedback. Such spurious correlations induced by popularity as a confounder severely undermine the causal robustness and out-of-distribution (OOD) generalization ability of the model. In Section 3.1, we establish a structural causal model and further illustrate our experimental findings in Figure 1 : the items are grouped into four buckets according to their popularity (from high to low), and we report the performance and the ratio of false negatives in each group. The results show that AHNS suffers from performance drops in certain popularity groups, even performing worse than random negative sampling; moreover, in high-popularity groups, heuristic negative sampling produces a significantly higher false hard negative ratio. This further verifies our hypothesis that environmental confounders induce FHNS, which in turn encourage the model to learn spurious correlations and harm its OOD generalization. In Figure 6 , we further illustrate the performance variations across different temporal groups and the FHNS ratio, reaching the same conclusion. (a) (b) Figure 1. Performance and false hard negative ratio Across different popularity groups. To address the above issue, we propose a novel negative sampling strategy named CNSDiff . Unlike traditional heuristic methods that rely on predefined candidate pools, CNSDiff takes the positive item embeddings as conditional input and leverages a diffusion model to progressively perturb them in the latent space, generating negative samples with varying hardness levels. The core intuition behind this strategy is that the initial diffusion steps preserve the semantic structure of the positive sample, while the subsequent noise injection and denoising process gradually move it away from the original distribution. This results in high-quality hard negatives that are close to but distinct from the positive items. We further provide the formal mathematical definition in Section 3.1. Furthermore, as illustrated in Figure 2 (a), we construct a structural causal model (SCM) to characterize the data generation mechanism and analyze how environmental confounders may introduce spurious hard negatives, thus impairing the model’s OOD generalization capability. Based on this, we design a causal regularization term that leverages the backdoor criterion to identify and block the causal path between environmental confounders and the target variable, thereby enforcing distributional consistency of the diffusion model across different environments. This design enables CNSDiff to effectively mitigate FHNS induced by confounding factors, resulting in more robust negative sample generation. The main contributions of this work are shown as follows: • We construct a structural causal model to reveal that environmental confounders can introduce FHNS during heuristic negative sampling, leading the model to learn spurious environment-dependent correlations and degrading its OOD generalization performance. • We propose