Ultra Fast Warm Start Solution for Graph Recommendations

Viacheslav Yusupov, Maxim Rakhuba, Evgeny Frolov · 2025

Read Ultra Fast Warm Start Solution for Graph Recommendations by Viacheslav Yusupov, Maxim Rakhuba, Evgeny Frolov (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-01549.txt.

Introduction

Recommender systems must refresh their suggestions as new data pour in and tastes shift, yet recomputing from scratch is slow. Viacheslav Yusupov, Maxim Rakhuba, and Evgeny Frolov present a fast warm start method for a scalable graph-based recommender called UltraGCN. Warm starting updates the old model instead of rebuilding it.

Their linear approach adapts a low-rank approximation, a compact stand-in for a large matrix, to the graph model. The method delivers fresh recommendations up to thirty times faster than conventional updates, with gains in recommendation quality rather than losses. Tests on large catalogue data sets show the approach scales well. Yusupov and the co-authors aim to keep recommendations relevant in systems where data volume and user preferences change constantly.

Catalog record

CREATORViacheslav Yusupov, Maxim Rakhuba, Evgeny Frolov
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE20 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-01549

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Ultra Fast Warm Start Solution for Graph Recommendations DOI: https://doi.org/10.1145/3746252.3760932 Conference: The 34th ACM International Conference on Information and Knowledge Management; November 10–14, 2025; Seoul, Korea ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Computing methodologies Machine learning algorithms CCS: Information systems Personalization CCS: Information systems Recommender systems Viacheslav Yusupov, Maxim Rakhuba, Evgeny Frolov Abstract . In this work, we present a fast and effective Linear approach for updating recommendations in a scalable graph-based recommender system UltraGCN. Solving this task is extremely important to maintain the relevance of the recommendations under the conditions of a large amount of new data and changing user preferences. To address this issue, we adapt the simple yet effective low-rank approximation approach to the graph-based model. Our method delivers instantaneous recommendations that are up to 30 30 times faster than conventional methods, with gains in recommendation quality, and demonstrates high scalability even on the large catalogue datasets. Figure 1. The image illustrates the warm-start scenarios, with warm users—those who have new interactions—marked in red, and others in blue. The scheme on the right presents the Folding-In approach for the UltraGCN Mao et al. 2021 graph-based recommender system. The user embedding matrix is denoted as U , and the item embedding matrix as V . In the solution, a_{u} is the vector of user u interactions, the element \beta_{u} and the diagonal matrix B_{I} contain information about the graph structure and V^{+} denotes a pseudo-inversed matrix. Trainable user embeddings ( e_{u} ) are shown in red, while frozen embeddings are shown in blue. 1. Introduction Recommender systems play a crucial role in modern digital life; however, they face significant challenges due to a high information overload. To maintain the relevance of recommendations, it is essential that recommendation models are regularly updated. As the complexity of these models and the number of users continue to grow, the traditional model retraining becomes an inadequate solution for instant recommendations updates. To address this issue, it is important to focus on updating recommendations only for those users who have interacted since the model was last trained or to tackle the warm start problem Gogna & Majumdar 2015 using the Folding-In approach. Users with new interactions are referred to as warm users (see Figure 1 ). In recommender systems, sequential-based models Kang & McAuley 2018 ; Mezentsev et al. 2024 ; Sun et al. 2019 and graph-based models Wang et al. 2019 ; He et al. 2020 ; Mao et al. 2021 have shown outstanding performance in various domains. Recent advances in sequential-based models Vaswani 2017 have established a new state-of-the-art result in the field of sequential recommendations Mezentsev et al. 2024 . These models are fast and effective, effectively addressing the warm start problem by naturally updating user embeddings based on their interaction history Kang & McAuley 2018 . However, sequential-based models may not yield significant benefits for certain datasets, particularly in cases where sequential patterns are absent Klenitskiy et al. 2024 . In contrast, graph-based recommender systems He et al. 2020 ; Mao et al. 2021 learn the global information about user-item interactions according to the interaction graph. These models demonstrate high recommendation quality, capturing the complex dependencies in the data. However, graph approaches suffer from high computational demands and the necessity of updating user representations to maintain the reliability of recommendations Gao et al. 2023 ; Zhang et al. 2024 . For this reason, it is crucial for graph-based models to develop Folding-In approaches to update user embeddings in the warm start scenario Jorge-Botana et al. 2010 . The existing Stochastic Gradient Descent-based Folding-In approaches Amari 1993 are universal but slow and computationally consuming. To overcome this problem, we developed a specialized Folding-In approach Linear for the simple and commonly used UltraGCN recommender system Mao et al. 2021 . Compared to previous fine-tuning Yang et al. 2024 and meta-learning Zhang et al. 2020 approaches, our method updates only one warm user embedding and could be applied on the fly with up to 30\times speed-up and better quality of recommendations compared to conventional SGD or fine-tuning approaches. In addition, to demonstrate the effectiveness and linear scalability Singh 2020 ; Roy & Dutta 2022 of our Linear method of updating recommendations, we tested it on datasets with large catalogues. Furthermore, our approach shows a higher diversity of recommendations due to the exact solution for updated embeddings, as well as the small impact on popularity bias Chen et al. 2023 . Overall, our contributions are as follows. • We developed a novel fast and efficient Folding-In approach Linear for graph-based recommender systems, achieving better quality than conventional SGD-based approaches with significantly 30\times faster inference with better quality of recommendations. • We theoretically and empirically study the scalability law of our Folding-In method. • We demonstrate the effectiveness of our approach to increase the coverage of item catalogue. The rest of the paper is organized as follows: Section 2 contains the related work, Section 3 provides an explanation of UltraGCN and SVD models, Section 4 details our approach, Sections 5 , 6 , and 7 contain our experimental setup, results, and conclusion, respectively. The code for reproducing our results is available 1 1 1 https://github.com/YusupovV-Lab/UltraFastFoldIn . 2. Related Work Graph-based recommender systems Wang et al. 2019 ; Mao et al. 2021 ; He et al. 2020 ; Gao et al. 2023 provide high-quality recommendations by leveraging the graph structure of the data and employing graph neural networks Wu et al. 2020 ; Kipf & Welling 2016 . Despite their effectiveness, training these systems often requires significant amounts of time and computational resources Zhang et al. 2024 . Consequently, retraining the model to capture new data becomes impractical in an online context. Some methods, such as conventional SGD-based approaches Amari 1993 , are general but do not fully utilize the graph structure inherent in the model. In contrast, techniques such as metalearning Zhang et al. 2020 and graph prompting Yang et al. 2024 ; Yi et al. 2023 ; Sun et al. 2022 update the entire model, which can be resource-intensive and time consuming. To address the limitations of these approaches, we have developed a fast and effective Folding-In approach for the UltraGCN model Mao et al. 2021 , which allows real-time updates of recommendations during inference and updates only several embeddings of users with a changed history of interactions. 3. Preliminaries In this section, we provide some preliminaries of our approach and discuss the methods utilized in this work. In the following sections N denotes the number of items in the catalogue, M the number of users, and d is the size of the embeddings. 3.1. Folding-In for SVD First, we start with a traditional matrix factorization approach Furnas et al. 1988 , which solves the following problem: (1) \min_{B:\text{ }rank(B)\leq d}\|A_{0}-B\|_{F}^{2}=\|A_{0}-U\Sigma V^{T}\|_{F}^{2} where A_{0}\in\mathbb{R}^{M\times N} is the binary user-item interaction matrix and U\in\mathbb{R}^{M\times d} , \Sigma\in\mathbb{R}^{d\times d} and V\in\mathbb{R}^{N\times d} are the components of the SVD decomposition of A_{0} . The matrix U has the meaning of user embeddings and V\Sigma is an item embedding matrix. When A_{0} changes rapidly through new interactions, model retraining is infeasible due to its computational cost. To overcome this problem, we can update only the embeddings of warm users who

Read the complete text