Fading to Grow: Growing Preference Ratios via Preference Fading Discrete Diffusion for Recommendation

Guoqing Hu An Zhang Shuchang Liu Wenyu Mao Jiancan Wu, Xun Yang Xiang Li Lantao Hu Han Li Kun Gai Xiang Wang · 2025

Read Fading to Grow: Growing Preference Ratios via Preference Fading Discrete Diffusion for Recommendation by Guoqing Hu An Zhang Shuchang Liu Wenyu Mao Jiancan Wu, Xun Yang Xiang Li Lantao Hu Han Li Kun Gai Xiang Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-26063.txt.

Introduction

Guoqing Hu and co-authors propose, in a 2025 paper, a recommender that grows user tastes instead of blurring them. Recommenders rank items by what a user seems to like, but taste data are thin. Diffusion-based rivals add smooth noise to fill the gaps, which clashes with the all-or-nothing nature of picking one item over another. Their system, PreferGrow, works in steps that match that discrete world.

It models ratios of liking between pairs of items, not raw scores. To disturb the data, it fades a taste: the liked item is swapped for a rival, much like negative sampling. Then it grows the taste back step by step, rebuilding the true ranking. The authors argue this fade-and-grow cycle fits how choices work, and should cope better with sparse records.

Catalog record

CREATORGuoqing Hu An Zhang Shuchang Liu Wenyu Mao Jiancan Wu, Xun Yang Xiang Li Lantao Hu Han Li Kun Gai Xiang Wang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE104 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-26063

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Fading to Grow: Growing Preference Ratios via Preference Fading Discrete Diffusion for Recommendation Guoqing Hu An Zhang Shuchang Liu Wenyu Mao Jiancan Wu, Xun Yang Xiang Li Lantao Hu Han Li Kun Gai Xiang Wang Abstract Recommenders aim to rank items from a discrete item corpus in line with user interests, yet suffer from extremely sparse user preference data. Recent advances in diffusion models have inspired diffusion-based recommenders, which alleviate sparsity by injecting noise during a forward process to prevent the collapse of perturbed preference distributions. However, current diffusion - based recommenders predominantly rely on continuous Gaussian noise, which is intrinsically mismatched with the discrete nature of user preference data in recommendation. In this paper, building upon recent advances in discrete diffusion, we propose PreferGrow , a discrete diffusion-based recommender system that models preference ratios by fading and growing user preferences over the discrete item corpus. PreferGrow differs from existing diffusion-based recommenders in three core aspects: (1) Discrete modeling of preference ratios: PreferGrow models relative preference ratios between item pairs, rather than operating in the item representation or raw score simplex. This formulation aligns naturally with the discrete and ranking-oriented nature of recommendation tasks. (2) Perturbing via preference fading: Instead of injecting continuous noise, PreferGrow fades user preferences by replacing the preferred item with alternatives—physically akin to negative sampling—thereby eliminating the need for any prior noise assumption. (3) Preference reconstruction via growing: PreferGrow reconstructs user preferences by iteratively growing the preference signals from the estimated ratios. PreferGrow offers a well-defined matrix-based formulation with theoretical guarantees on Markovianity and reversibility, and it demonstrates consistent performance gains over state-of-the-art diffusion-based recommenders across five benchmark datasets, highlighting both its theoretical soundness and empirical effectiveness. Our codes are available at https://github.com/Hugo-Chinn/PreferGrow . 1 Introduction Figure 1 : Comparison of diffusion-based recommenders in terms of modeling targets and perturbation strategies. Item-level diffusion recommenders (top) add Gaussian noise into dense item embeddings but overlook negative signals. Preference score-level diffusion recommenders (middle) perturb one-hot preference vectors under the constraints of probability simplex. PreferGrow (bottom) directly models discrete preference ratios via preference fading. Recommender systems aim to rank items from a discrete item set that align with user interests, where ones in the user-item interaction matrix denote observed interactions, and zeros indicate unobserved or missing entries. In real-world scenarios, this interaction matrix is often extremely sparse [ 1 , 2 ] , which poses a significant challenge for recommenders in accurately modeling user preferences [ 3 , 4 ] . Recent advances in diffusion models (DMs) offer a promising solution: by injecting noise during the forward process, DMs transform sparse data into smoother, denser distributions while preventing collapse into isotropic zero values [ 5 , 6 , 7 ] . Motivated by these properties, diffusion-based recommenders [ 8 , 9 , 10 , 11 , 12 , 13 , 14 , 15 , 16 , 17 , 18 , 19 , 20 , 21 , 22 , 23 , 24 , 25 , 26 , 27 , 28 , 29 , 30 , 31 , 32 , 33 , 34 , 35 , 36 ] have proliferated in recent studies, showing strong potential in addressing data sparsity and improving preference modeling. Current diffusion-based recommenders predominantly adopt continuous noise as the perturbation mechanism by adding noise into either dense item embeddings or one-hot preference score vectors. As shown in Figure 1 , item-level diffusion recommenders [ 8 , 9 , 10 , 11 , 12 , 13 , 14 , 15 , 16 , 17 , 18 , 19 , 20 , 21 , 22 , 23 , 24 , 25 , 26 ] apply Gaussian noise to user-interacted item embeddings during the forward process, and learn a score function—the gradient of the perturbed distribution’s log-likelihood—to recover item embeddings during the reverse process. However, these methods overlook the negative signals in recommendations, lacking mechanisms such as negative sampling to differentiate user preferences [ 8 , 26 ] . In contrast, preference score-level diffusion recommenders [ 27 , 28 , 29 , 30 , 31 , 32 , 33 , 34 , 35 , 36 ] model users’ preference scores among the full item corpus, i.e., user interacted one-hot vectors, by perturbing them within the probability simplex in the forward process. While the reverse process attempts to reconstruct the preference scores, the simplex constraints—non-negativity and normalization—introduce additional optimization difficulties [ 37 ] . Worse still, both diffusion-based recommenders assume a prior noise in the sampling process, e.g., Gaussian [ 8 ] or Bernoulli [ 28 ] , which may poorly reflect the inherently discrete and sparse nature of the user preference data in recommendation scenarios. Building on recent advances in discrete diffusion models [ 38 , 37 , 39 ] , we propose PreferGrow , a discrete diffusion-based recommender that models the preference ratios by fading and growing user preferences through forward and backward processes. Unlike existing continuous diffusion-based recommenders that model preference scores ( e.g., probabilities that users interacted with items), PreferGrow directly models relative preference ratios over a discrete item set. This formulation aligns more naturally with the discrete and ranking-oriented nature of recommendation tasks and avoids the strong constraints imposed by the probability simplex. In the forward perturbation, PreferGrow fades user preference by replacing the preferred item with alternatives, enabling explicit negative sampling and alleviating data sparsity without relying on predefined noise distribution. In the backward generation, PreferGrow reconstructs user preferences by iteratively growing the preference signal from the estimated ratios. We further provide theoretical analysis showing that these forward and backward processes preserve key properties of discrete diffusion models. PreferGrow offers a unified and theoretically grounded framework for discrete diffusion-based recommendation, characterized by a well-defined matrix-based formulation, flexible and interpretable preference ratio modeling aligned with diverse negative sampling strategies, and consistently superior empirical performance. • Theoretical foundation: At the core of the formulation for PreferGrow is an idempotent fading matrix used to replace preferred items during the forward perturbation process. We provide a closed-form solution of this preference fading matrix and theoretically prove that its idempotent property is critical for ensuring both the Markov property and reversibility of the diffusion process. • Flexible modeling: By parameterizing the preference fading matrix, PreferGrow flexibly supports point-wise, pair-wise, and hybrid preference ratios modeling. These variants correspond to distinct and physically interpretable negative sampling strategies, enabling the framework to adapt to diverse modeling targets in recommendation. • Empirical validation: Extensive experiments on five benchmark datasets demonstrate that PreferGrow consistently outperforms existing diffusion-based recommenders, validating the practical effectiveness of its theoretical foundations. 2 Preliminaries User preference data is represented as a pair (u,i) , where u denotes the user and i is the preferred item. The preference score p(i|u) indicates the probability that the user u interacts with item i . In sequential recommendation, u denotes the item sequence that the user has interacted with. Diffusion-based Recommenders generally consist of three major components: a forward noise-adding process for perturbation, a generative modeling target, and a backward denoising process for reconstruction. Specifically, item-level diffusion-based recommenders encode a preferred item i into its dense embedding \mathbf{x}_{0} , and instantiate three components as follows [ 40 ] : • forward perturbation : \mathbf{x}_{t}=\sqrt{\alpha_{t}}\mathbf{x}_{0}+\sqrt{1-\alpha_{t}}\epsilon_{t} ,

Read the complete text