Discrete-event Tensor Factorization: Learning a Smooth Embedding for Continuous Domains

Joey De Pauw, Bart Goethals · 2025

Read Discrete-event Tensor Factorization: Learning a Smooth Embedding for Continuous Domains by Joey De Pauw, Bart Goethals (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-04221.txt.

Introduction

Joey De Pauw and Bart Goethals study how to model time in recommender systems in a 2025 arXiv paper. Most systems learn from past clicks and purchases to predict what a user will want next. Recent actions usually say more about future taste than old ones. Many methods drop old data or weigh it less, but few model time itself.

The authors add absolute time as a feature in tensor factorization models. They compare simple time bins with a fully continuous encoding. The continuous method uses a polynomial fit inside the loss, so no bins are needed. Tests on three datasets show clear time signals. A simple popularity fix after training often worked best for future data.

Catalog record

CREATORJoey De Pauw, Bart Goethals
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-04221

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Discrete-event Tensor Factorization: Learning a Smooth Embedding for Continuous Domains Joey De Pauw, Bart Goethals Abstract . Recommender systems learn from past user behavior to predict future user preferences. Intuitively, it has been established that the most recent interactions are more indicative of future preferences than older interactions. Many recommendation algorithms use this notion to either drop older interactions or to assign them a lower weight, so the model can focus on the more informative, recent information. However, very few approaches model the flow of time explicitly. This paper analyzes how time can be encoded in factorization-style recommendation models. By including absolute time as a feature, our models can learn varying user preferences and changing item perception over time. In addition to simple binning approaches, we also propose a novel, fully continuous time encoding mechanism. Through the use of a polynomial fit inside the loss function, our models completely avoid the need for discretization, and they are able to capture the time dimension in arbitrary resolution. We perform a comparative study on three real-world datasets that span multiple years, where long user histories are present, and items stay relevant for a longer time. Empirical results show that, by explicitly modeling time, our models are very effective at capturing temporal signals, such as varying item popularities over time. Despite this however, our experiments also indicate that a simple post-hoc popularity adjustment is often sufficient to achieve the best performance on the unseen test set. This teaches us that, for the recommendation task, predicting the future is more important than capturing past trends. As such, we argue that specialized mechanisms are needed for extrapolation to future data. 1. Introduction Dealing with time is a crucial aspect of recommender systems ( Rabiu et al. 2020 ; Rana and Jain 2015 ) . A user’s taste can change as they grow older or pick up new interests ( Lo et al. 2018 ) . Similarly, an item’s popularity may vary over time as it grows outdated or the majority of users have seen it ( Sun and Dong 2017 ) . Furthermore, in the context of collaborative filtering, the time when a user interacts with an item provides valuable information about the user’s preferences and the item’s relevance. For example, watching a blockbuster movie when it is released may indicate a different interest than watching it years later ( Koren 2009 ) . Incorporating this ever-changing nature of the recommendation task is far from trivial. With the end-goal of retrieving the most relevant content at the current time in mind, most approaches take a passive approach to including time ( Rabiu et al. 2020 ) . Among such techniques are: 1) forgetting mechanisms ( Matuszyk et al. 2015 ) , that incrementally update existing models to adapt them to current trends. 2) weighting ( Ding and Li 2005 ) , where a higher contribution is given to recent data, and 3) window-based approaches ( Steck 2019a ; Verachtert et al. 2022 ) , where dynamic cutoffs ensure that only timely information is used. However, with datasets spanning multiple years and long user histories being available (see Figure 3 ), we argue for an active approach to modeling time. Indeed, where the previous approaches all adapt the model to the current trends, they fail to capture the intricacy of when interactions occur and precisely how this influences what can be learned from them. The blockbuster example above shows the value of an absolute notion of time, that can capture popularity trends. Furthermore, relative time between interactions can also be considered, such as when two items are consumed close together, this implies a stronger similarity between the two ( Garg et al. 2019 ; Choi et al. 2021 ) . In this paper, we study different ways to encode absolute time in factorization-style recommendation models. By explicitly modeling time as a factor, we can represent the flow of time in the learned weights, as demonstrated in Figure 2 . With time being one of the most important contexts of an interaction ( Pagano et al. 2016 ) , we demonstrate that models that account for temporal dynamics, can better capture some intricate dependencies and improve top-k recommendations. Consider the classic user-item interaction matrix X\in\{0,1\}^{m\times n} with m users and n items. X_{ui}=1 denotes an interaction of user u with item i . Matrix factorization algorithms decompose this large and sparse matrix into the product of low-rank user and item matrices P\in\mathbb{R}^{m\times k} and Q\in\mathbb{R}^{n\times k} ( Hu et al. 2008 ; Pan et al. 2008 ) . They represent the latent factors or embeddings of the users and items respectively. Due to the model being an approximation of rank k , it can predict missing entries in the matrix, which correspond to the items that a user has not yet interacted with. To incorporate time as a feature, most approaches first discretize the time axis with a binning strategy ( Hidasi and Tikk 2012 ; Hidasi 2014 ; Hidasi and Tikk 2014 ; Pauw and Goethals 2025 ) . This way, a discrete 3D-tensor X\in\mathbb{R}^{m\times n\times l} can be constructed, where l is the number of bins. For example, all interactions can be grouped into bins that span one day, to effectively get an interaction matrix per day, all stacked together into the tensor. From this input format, tensor decomposition methods can be used to learn the user and item embeddings, as well as time factors, one for each bin. The binning however is a crude approximation and it leads to some drawbacks and assumptions. First, having too many bins results in more sparse data, because there are fewer interactions per bin. Secondly, the bins are typically independent of each other, meaning the arbitrary lengths and cutoff points can have a large and inconsistent impact on predictions. Thirdly, the computational cost and model size often depend on the amount of bins. Hence binning imposes a trade-off between, supporting a fine granularity by taking small intervals, and preserving enough data in each bin to be able to learn the model, by taking large enough intervals ( Koren 2009 ) . Our decomposition approach however, works directly on the continuous time axis and completely bypasses the discretization step and all of its drawbacks. The key insight is that the learned time factors are not independent of each other ( Pagano et al. 2016 ; Hidasi and Tikk 2014 ) . Indeed, because user tastes and item perception change smoothly over time, we can assume that time factors close together should be similar. This allows us to introduce a polynomial fit of the time factors, directly into the decomposition. With this fit we effectively learn continuous weights for the time factor and circumvent the sparsity issue, as the coefficients of the fit are learned based on all timestamps, and no binning is needed. Section 2 describes the theoretical background and our contributions in detail. In Section 3 we compare all approaches on three real-world datasets. Finally, Section 4 lists the related work and we conclude in Section 5 . 2. Models In this paper we consider the most intuitive ways to include time-awareness and time modeling in factorization models.

Read the complete text