Privacy Preserving Inference of Personalized Content for Out of Matrix Users DOI: 10.1145/1122445.1122456 Conference: RecSys ’21: 15th ACM Conference on Recommender Systems; Sep 27–Oct 1, 2021; Amsterdam, Netherlands RecSys ’21: 15th ACM Conference on Recommender Systems, Sep 27–Oct 1, 2021, Amsterd
Michael Sun, Tai Vu, Andrew Wang · 2025
Read Privacy Preserving Inference of Personalized Content for Out of Matrix Users DOI: 10.1145/1122445.1122456 Conference: RecSys ’21: 15th ACM Conference on Recommender Systems; Sep 27–Oct 1, 2021; Amsterdam, Netherlands RecSys ’21: 15th ACM Conference on Recommender Systems, Sep 27–Oct 1, 2021, Amsterd by Michael Sun, Tai Vu, Andrew Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-14905.txt.
Introduction
Michael Sun, Tai Vu, and Andrew Wang build a recommendation system that serves new users without mining their private data, in work from 2025. Small, fast-changing communities face sparse data and many guests. Standard methods fail when a user has no history at all.
Their network links users, items, and review text in one graph design. A content basket stands in for each user, built from items rather than a profile. A second part extends the method to users never seen in training. Tests used a new anime data set with ten thousand titles and thirteen thousand users. Scores matched or beat strong baselines, even for users outside the training set.
Catalog record
| CREATOR | Michael Sun, Tai Vu, Andrew Wang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-14905
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Privacy Preserving Inference of Personalized Content for Out of Matrix Users DOI: 10.1145/1122445.1122456 Conference: RecSys ’21: 15th ACM Conference on Recommender Systems; Sep 27–Oct 1, 2021; Amsterdam, Netherlands RecSys ’21: 15th ACM Conference on Recommender Systems, Sep 27–Oct 1, 2021, Amsterdam, Netherlands ISBN: 978-1-4503-XXXX-X/18/06 1021 CCS: Computing methodologies Neural networks CCS: Computing methodologies Information extraction Michael Sun, Tai Vu, Andrew Wang Abstract 1. Introduction Recommendation systems in practice often rely on difficult-to-collect large-scale datasets in order to obtain a “critical mass” of user preference and content information for high-quality recommendations. With smaller datasets, the shortcomings of traditional recommendation systems begin to appear: sparsity of user preference matrices and item content lead to ineffective recommendations in data-driven systems ( Ahmadian et al. 2019 ; Singh 2020 ) particularly for cold start users and items. A large tail of niche application settings, such as the scientific and anime enthusiast communities, need recommender models catered to the needs of smaller, dynamic communities while keeping the options of privacy or anonymity. Existing approaches fail to provide cold start recommendations while maintaining the important needs of such communities. Content-based cold start approaches ( Bernardi et al. 2015 ; Lika et al. 2014 ) rely on user content information, which is invasive on user personal data, and does not work effectively in the setting of new users, for whom no preferences are given. Likewise, collaborative filtering ( Su and Khoshgoftaar 2006 ; Chee et al. 2001 ; Hofmann 2004 ) , which provides recommendations based on preference-based similarity to other users or items, struggles with cold start users and items. While there are attempts to build more advanced recommendation engines using hybrid methods ( Wang and Blei 2011 ; Gopalan et al. 2013 ) and deep neural networks ( Van Den Oord et al. 2013 ; Wu et al. 2017 ; Wang et al. 2015 ) , research in alleviating cold start issues is still limited. We introduce DeepNaniNet , which uses a deep neural architecture to handle cold start with the option of learning rich content representations via a graph representation of the data, with edges linking users and items as well as edges linking items to items representing related show suggestions, enabling joint consideration of these data sources. We introduce neural language embeddings derived from BERT to represent both textual reviews, which constitute the edges between users and optionally item-item recommendations, which constitute the edges between items. The model is trained with WMF following previous successes ( Volkovs et al. 2017 ) ( Wang and Blei 2011 ) . Building on this framework, we introduce tools for generalization to new users that avoid profile mining: 1. a representation scheme of users by their “content basket”, a set of a user’s favorite items submitted to the service, with which to induce user representations, and 2. an autoencoder architecture to generalize to new users without requiring user metadata. To our knowledge, DeepNaniNet is the first deep NLP driven anime recommendation engine. We further present AnimeULike, a new dataset of anime reviews consisting of 10000 animes and 13000 users, on which the system achieves competitive user recall on both warm and cold start animes and demonstrates a learnt ability to generalize to new anime on a thematic basis. On the benchmark of CiteULike, the system achieves equivalent performance to DropoutNet’s SOTA cold start numbers and avoids any performance drop upon introduction of out-of-matrix users. In realistic real world settings where half or more users are either guests or have few suggestive interactions, DeepNaniNet proves to be the superior design. On AnimeULike Warm Start, DeepNaniNet demonstrates near 7x user recall@100 over WMF and 1.5x over DropoutNet, and further experiments indicate it is learning a rich user representation space in the process. DeepNaniNet enables high-quality recommendations in the key stress areas for niche-community recommender systems. First, it can make effective cold start recommendations for both new users and items. Second, it does so via a privacy-preserving user experience and algorithm, which is crucial for both maintaining user anonymity and effectively serving guest users. Third, it is able to jointly learn to encode diverse data sources during training for qualitatively improved recommendation quality. 2. Related Work 2.1. Traditional Methods The traditional class of solutions to building recommendation engines is collaborative filtering. Methods may model user representations via Bayesian inference of user preferences ( Su and Khoshgoftaar 2006 ) , unsupervised clustering of users with similar preferences ( Chee et al. 2001 ) or latent semantic analysis ( Hofmann 2004 ) . Dimensionality reduction via factorization of the preferences matrix has seen success in recommendation. Weighted Matrix Factorization (WMF) has been applied towards collaborative filtering ( Hu et al. 2008 ) , and neural matrix factorizations have also been applied to recommendation ( Xue et al. 2017 ) . Our method uses such factorization approaches to provide relevance scores to learn during training. Nonetheless, collaborative filtering approaches suffer from sparsity of user preference information. For example, user-user and item-item collaborative filtering has no remedy for cold start users and items respectively when no preferences are available. Hybrid approaches to the problem of cold start in recommendation systems integrate in both user preferences and item content. CTR ( Wang and Blei 2011 ) integrates latent embeddings for users and items with probabilistic topic modeling. CTPF ( Gopalan et al. 2013 ) identifies latent topics and to form cross-topic recommendations. However, such methods introduce highly complex objective functions to incorporate additional content and preference terms. In addition, these models only handle cold start items without paying attention to cold start users. 2.1.1. Deep Learning Methods Meanwhile, many works have applied deep learning to developing both content and collaborative filtering-based recommendation engines, such as DeepMusic ( Van Den Oord et al. 2013 ) and RNNs ( Wu et al. 2017 ) , and CDL ( Wang et al. 2015 ) , which introduce various neural architectures to jointly learn content and preferences. Nevertheless, there have been limited attempts to address the cold start problem directly in the training procedure. DropoutNet ( Volkovs et al. 2017 ) demonstrated the SOTA result in generalizing to cold start users and items by employing dropout at training time to reconstruct user-item relevance scores. However, its shortcoming is in their sharp performance decline in situations where user content is not available. The present work combines the cold start advantages of DropoutNet while avoiding existing problems of privacy invasion posed by existing user content-based approaches ( Bobadilla et al. 2013 ) ( Zhang et al. 2010 ) . 2.2. Inductive Graph Learning Recently, general-purpose graph representation learning methods have been proposed for recommendation tasks. Pixie ( Eksombatchai et al. 2018 ) uses biased random walks in the user-item interaction graph to generate recommendation scores, but does no learning, hence it cannot incorporate complex multimodal data end-to-end, and requires unwieldy hyperparameter tuning to design appropriate random walks for novel recommendation settings. PinSAGE ( Ying et al. 2018 ) combines Graph Convolutional Networks ( Kipf and Welling 2017 ) with efficient inference and curriculum training for web-scale recommendation. However, PinSAGE does not explicitly address the cold start problem, which we aim to do in the present work. STAR-GCN ( Zhang et al.