Weighted Tensor Decompositions for Context-aware Collaborative Filtering
Joey De Pauw, Bart Goethals · 2025
Read Weighted Tensor Decompositions for Context-aware Collaborative Filtering by Joey De Pauw, Bart Goethals (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-08393.txt.
Introduction
Joey De Pauw and Bart Goethals wrote a 2025 paper surveying weighted tensor methods for context-aware recommendation. What a user wants shifts with time of day, weather, and mood. Recommenders that ignore context miss the moment. A popular fix stacks context as extra dimensions on the user-item matrix, making a tensor, then factorizes it to fill the gaps.
Unlike matrices, tensors can be decomposed many ways, mixing vector, matrix, and tensor products. The authors study the most successful weighted-loss decompositions and sort them by structure and regularization style. They fill in missing combinations, extending the family. Properties like complexity, scalability, and modeling capacity are compared against measured performance. The result is a map for choosing a decomposition that fits a given context problem.
Catalog record
| CREATOR | Joey De Pauw, Bart Goethals |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-08393
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Weighted Tensor Decompositions for Context-aware Collaborative Filtering Joey De Pauw, Bart Goethals Abstract . Over recent years it has become well accepted that user interest is not static or immutable. There are a variety of contextual factors, such as time of day, the weather or the user’s mood, that influence the current interests of the user. Modelling approaches need to take these factors into account if they want to succeed at finding the most relevant content to recommend given the situation. A popular method for context-aware recommendation is to encode context attributes as extra dimensions of the classic user-item interaction matrix, effectively turning it into a tensor, followed by applying the appropriate tensor decomposition methods to learn missing values. However, unlike with matrix factorization, where all decompositions are essentially a product of matrices, there exist many more options for decomposing tensors by combining vector, matrix and tensor products. We study the most successful decomposition methods that use weighted square loss and categorize them based on their tensor structure and regularization strategy. Additionally, we further extend the pool of methods by filling in the missing combinations. In this paper we provide an overview of the properties of the different decomposition methods, such as their complexity, scalability, and modelling capacity. These benefits are then contrasted with the performances achieved in offline experiments to gain more insight into which method to choose depending on a specific situation and constraints. Conference: Workshop on Context-Aware Recommender Systems; September 18, 2023; Singapore 1. Introduction Collaborative filtering techniques are currently the most used and most studied approaches for top-k recommendation with implicit feedback. In collaborative filtering, a user’s recommendations are based on the history of items they consumed and how similar they are to other users. This approach has its limitations, as often much more data is available to learn from, such as personal information of the user, metadata of the item, or contextual information about the interactions. Especially the usage of contexts is found to be indispensable to model the dynamic nature of user behaviour and to make sure the recommender system can adapt to the current needs of the user ( Pagano et al., 2016 ; Adomavicius and Tuzhilin, 2010 ) . Implicit feedback data is often represented as a user-by-item binary interaction matrix where each interaction (view/click/…) is represented by a one and everything else as zero . As the item catalogue grows, this matrix naturally becomes increasingly sparse since every user typically only observes a limited amount of items. This problem is exacerbated further as context dimensions are added, because each dimension exponentially increases the sparsity of the tensor. Learning from sparse, positive-only data is one of the key challenges in recommendation and requires specialised learning methods such as negative sampling or importance weighting ( Hu et al., 2008 ; Pan et al., 2008 ) to prevent models from overfitting to the missing data ( Pan et al., 2008 ; He et al., 2016 ) . Both approaches have their pros and cons: while negative sampling has more efficient training steps, convergence may be slow and highly dependent on the learning rate. Importance weighting on the other hand can use the whole data and is hence more costly, but it is often found to be more effective ( Chen et al., 2020 ; He et al., 2016 ) . In this paper, we focus on whole-data models with weighted square loss. Weighted Matrix Factorization (WMF), also called iALS ( Hu et al., 2008 ; Pan et al., 2008 ) , pioneered this class of models and is still known to achieve competitive results while having highly scalable learning and prediction routines ( Rendle et al., 2022 ) . After its introduction, many extensions were proposed, among which three variants for context-aware recommender systems (CARS) ( Hidasi and Tikk, 2012 ; Hidasi, 2014 ; Chou et al., 2018 ) , where each variant uses a different tensor decomposition method. Table 1 classifies the WMF-based CARS models in terms of decomposition method , tensor structure and regularization strategy . First, for tensor structure, we distinguish between models that support arbitrary dimensions and models that are limited to three dimensions. In the latter case, if there are multiple context features, they have to be stacked in one dimension. Then, the standard regularization strategy ‘zero’ uses the same \ell^{2} -norm for all factors, pulling them all towards the origin. Our new strategy ‘one’ regularizes the context factors towards the mathematical identity which benefits learning as per our experimental results. Finally, we consider the three most practical tensor decomposition methods: CANDECOMP/PARAFAC (CP) ( Hitchcock, 1927 ) where each interaction is modelled by a product of vectors, Pairwise Interaction Tensor Factorization (PITF) ( Rendle and Schmidt-Thieme, 2010 ) where the sum of pairwise products of vectors is used, and Tensor Train Factorization (TTF) ( Oseledets, 2011 ) where user and item factors are vectors and contexts are modelled as matrices. The Tucker decomposition ( Hitchcock, 1927 ; Tucker, 1966 ) is not included because no WMF-based CARS algorithm with this decomposition has been published yet ( Frolov and Oseledets, 2017 ) , likely because the precomputation step that leads to the efficiency of WMF, is not possible due to the use of a core tensor. Six spaces in this table are already filled by previously proposed methods and we fill in four of the missing combinations that are indicated with an asterisk. Note that iTALSx and FTF are classified both under zero and one regularization for PITF as ‘zero’ already is the mathematical identity for the factors and it hence coincides with the ‘one’ variant. Also worth mentioning is the General Factorization Framework ( Hidasi and Tikk, 2016 ) which studies combinations of CP and PITF, and as such would fit somewhere between these rows of the table. Only two entries are left for multidimensional TTF, which is out of the scope of this paper and remains open for future research. This paper has three main contributions: (1) Introducing Weighted Tensor Factorization (WTF), a novel WMF-based model for CARS with the TTF structure. (2) Exploring a new regularization method for context factors that aligns more with the recommendation task. (3) Experimental evaluation and comparison of the listed models on three publicly available datasets. Table 1 . Overview of the studied CARS models. Methods marked with asterisk (*) are our contributions. Tensor Structure: Up to 3D / Stacked to 3D Multidimensional Regularization: zero one zero one CP ( Hitchcock, 1927 ) iTALSs ( Hidasi and Tikk, 2012 ) iTALSs one * iTALS ( Hidasi and Tikk, 2012 ) iTALS one * PITF ( Rendle and Schmidt-Thieme, 2010 ) iTALSx ( Hidasi, 2014 ) iTALSx ( Hidasi, 2014 ) FTF ( Chou et al., 2018 ) FTF ( Chou et al., 2018 ) TTF ( Oseledets, 2011 ) WTF * WTF one * – – 2. Models Let X\in\{0,1\}^{m\times n\times l_{1}\times\cdots\times l_{d}} be the binary interaction tensor and \hat{X}\in\mathbb{R}^{m\times n\times l_{1}\times\cdots\times l_{d}} be the reconstructed values given a tensor decomposition method. Then the class of models we study all share the following loss function: (1) \mathcal{L}=\left\lVert\sqrt{W}\odot\left(X-\hat{X}\right)\right\rVert_{F}^{2}+\mathcal{R}\qquad\textrm{with }W=1+\alpha X Where \odot denotes the elementwise product and \left\lVert\cdot\right\rVert_{F} the Frobenius norm. W are