RoTE: Coarse-to-Fine Multi-Level Rotary Time Embedding for Sequential Recommendation Conference: Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 20–24, 2026; Melbourne, VIC, Australia. Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’26), July 20–24, 2026, Melbourne, VIC, Australia ISBN: 979-8-4007-2599-9/2026/07 DOI: 10.1145/3805712.3809892 CCS: Information systems Recommender systems
Haolin Zhang, Longtao Xiao, Guohao Cai, Ruixuan Li, Xiu Li · 2026
Read RoTE: Coarse-to-Fine Multi-Level Rotary Time Embedding for Sequential Recommendation Conference: Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 20–24, 2026; Melbourne, VIC, Australia. Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’26), July 20–24, 2026, Melbourne, VIC, Australia ISBN: 979-8-4007-2599-9/2026/07 DOI: 10.1145/3805712.3809892 CCS: Information systems Recommender systems by Haolin Zhang, Longtao Xiao, Guohao Cai, Ruixuan Li, Xiu Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-13389.txt.
Introduction
Haolin Zhang and four colleagues propose RoTE, a plug-in time embedding for sequential recommendation. Existing models sort interactions by time stamp but ignore the actual gaps between them, blurring how tastes shift over short and long spans. RoTE splits each time stamp into coarse and fine parts and adds those time parts to item codes, letting models sense time gaps with no backbone change. Applied to several Transformer recommenders on three benchmarks, it improves NDCG at five by up to about 20 percent.
Catalog record
| CREATOR | Haolin Zhang, Longtao Xiao, Guohao Cai, Ruixuan Li, Xiu Li |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 22476 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.13389
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
RoTE: Coarse-to-Fine Multi-Level Rotary Time Embedding for Sequential Recommendation Conference: Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 20–24, 2026; Melbourne, VIC, Australia. Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’26), July 20–24, 2026, Melbourne, VIC, Australia ISBN: 979-8-4007-2599-9/2026/07 DOI: 10.1145/3805712.3809892 CCS: Information systems Recommender systems Haolin Zhang, Longtao Xiao, Guohao Cai, Ruixuan Li, Xiu Li Abstract . Sequential recommendation models have been widely adopted for modeling user behavior. Existing approaches typically construct user interaction sequences by sorting items according to timestamps and then model user preferences from historical behaviors. While effective, such a process only considers the order of temporal information but overlooks the actual time spans between interactions, resulting in a coarse representation of users’ temporal dynamics and limiting the model’s ability to capture long-term and short-term interest evolution. To address this limitation, we propose RoTE , a novel multi-level temporal embedding module that explicitly models time span information in sequential recommendation. RoTE decomposes each interaction timestamp into multiple temporal granularities, ranging from coarse to fine, and incorporates the resulting temporal representations into item embeddings. This design enables models to capture heterogeneous temporal patterns and better perceive temporal distances among user interactions during sequence modeling. RoTE is a lightweight, plug-and-play module that can be seamlessly integrated into existing Transformer-based sequential recommendation models without modifying their backbone architectures. We apply RoTE to several representative models and conduct extensive experiments on three public benchmarks. Experimental results demonstrate that RoTE consistently enhances the corresponding backbone models, achieving up to a 20.11% improvement in NDCG@5, which confirms the effectiveness and generality of the proposed approach. Our code is available at https://github.com/XiaoLongtaoo/RoTE. † † cc-license: by 1. Introduction Sequential recommendation ( 13 ; 17 ; 26 ) is a fundamental problem in recommender systems, which aims to predict the next item a user will interact with based on their historical behavior sequences. Sequential recommender models ( 21 ; 2 ; 22 ; 4 ) capture dynamic user preferences by modeling interaction sequences, constructed by chronologically ordering previously interacted items. Existing methods can be broadly categorized into traditional (discriminative) approaches ( 1 ) and generative approaches ( 27 ) . Traditional sequential recommendation ( 5 ; 25 ; 12 ; 24 ) formulate the recommendation task as a candidate matching task, in which the model learns user preferences from historical interaction sequences and derives latent user interest representations, which are subsequently utilized to calculate the relevance of candidate items, thus guiding the ranking and selection of items. Generative sequential recommendation ( 9 ; 6 ) treats recommendation as a sequence generation problem, modeling user behavior in an autoregressive or sequence-to-sequence manner and often leveraging large language models ( 10 ; 18 ) or sequence generation frameworks ( 20 ; 28 ) to achieve more flexible and unified representation learning. Despite the strong empirical performance of traditional and generative sequential recommendation models, a key limitation ( 16 ) persists in how they handle temporal information. Most existing traditional and generative methods typically sort interaction sequences by timestamp and then rely on positional embeddings to capture temporal information. Such positional encoding ( 14 ) can be viewed as the most simplified form of temporal modeling, as it primarily preserves relative order while treating time as uniformly spaced and ignoring heterogeneous time intervals between interactions. As a result, rich temporal signals at different time scales are either entangled or discarded, leading to an oversimplified representation of temporal dynamics and limiting the model’s ability to capture nuanced patterns such as multi-scale preference evolution and drift over irregular time gaps. In real-world scenarios, interaction time is commonly recorded in the form of Unix timestamps ( 3 ) , providing a precise and continuous measure of when user actions occur. However, such representations do not align well with how users perceive and organize time in daily life. Instead of reasoning in terms of absolute numerical values, users naturally interpret time in a hierarchical and semantic manner ( 19 ) , where long-term interests evolve across years, medium-term behaviors are shaped by seasonal or monthly patterns, and short-term intents are driven by daily interactions. This mismatch between the raw timestamp representation and human time perception introduces a bias in temporal modeling, as heterogeneous temporal signals at different scales are compressed into a single continuous value. To address these challenges, we propose Ro tary T ime E mbedding (RoTE), a lightweight and plug-and-play multi-level temporal modeling module for sequential recommendation. RoTE explicitly captures coarse-to-fine temporal information and encodes them into item embeddings in the self-attention module. Specifically, RoTE decomposes interaction timestamps into year, month, and day, and integrates them into item representations through a unified rotary embedding mechanism. For each temporal level, RoTE injects time-aware signals directly into the item embedding space, enabling temporal information to be tightly coupled with sequence modeling rather than treated as auxiliary features. The resulting time-enhanced representations are then aggregated to form the final item embeddings used by the model. By seamlessly integrating multi-level temporal signals into the self-attention process without modifying backbone architectures, RoTE allows existing Transformer-based sequential recommendation models to better perceive heterogeneous temporal distances among user interactions without introducing significant computational overhead. The key contributions of our work are as follows: • We propose RoTE, a novel plug-and-play temporal embedding module that explicitly models time-span information for sequential recommendation. • We introduce a coarse-to-fine temporal encoding strategy that enables Transformer-based sequential recommendation models to capture multi-level temporal patterns. • We demonstrate that RoTE consistently improves recommendation performance through extensive experiments on multiple benchmark datasets and representative models, showcasing its advantages in performance and generality. 2. Methodology 2.1. Problem Definition Let \mathcal{U} and \mathcal{I} denote the sets of users and items, respectively. Each user u\in\mathcal{U} is associated with an interaction sequence (1) \mathcal{S}_{u}=\{(i_{0},t_{0}),(i_{1},t_{1}),\dots,(i_{L_{u}-1},t_{L_{u}-1})\}, where i_{k}\in\mathcal{I} denotes the k -th interacted item and t_{k} is the corresponding interaction timestamp, satisfying t_{0}<t_{1}<\dots<t_{L_{u}-1} . The sequence length L_{u} may vary across users, and the time intervals between consecutive interactions are generally irregular. Given a user’s historical interaction sequence \mathcal{S}_{u} , the goal of sequential recommendation is to model the dependency between past interactions and future behaviors, and predict the next item i_{L_{u}} conditioned on the observed sequence. Formally, the task can be defined as learning a conditional distribution (2) p(i_{L_{u}}\mid\mathcal{S}_{u}), which can be instantiated either as a ranking-based scoring function or as a generative model that directly produces the next item token. In this work, we focus on enhancing sequential recommendation models by more effectively modeling the temporal information embedded in interaction timestamps, as shown in Figure 1 . Specifically, we aim to capture heterogeneous time intervals and multi-scale temporal dynamics in a unified manner that is compatible with Transformer-based generative and discriminative sequential recommendation architectures. 2.2. Temporal Feature Construction In real-world scenarios, interaction time is typically recorded as a Unix timestamp. To obtain a structured temporal representation, we decompose each timestamp t_{k} into a hierarchical triplet (3) t_{k}\rightarrow(y_{k},m_{k},d_{k}), where y_{k} , m_{k} , and d_{k} denote the cumulative number of years, months, and days elapsed since January 1, 1970, respectively. For example, January 1, 1970 corresponds to (0,0,0) , while