Not Just What, But When: Integrating Irregular Intervals to LLM for Sequential Recommendation Conference: Proceedings of the Nineteenth ACM Conference on Recommender Systems; September 22–26, 2025; Prague, Czech Republic Proceedings of the Nineteenth ACM Conference on Recommender Systems (RecSys ’25

Wei-Wei Du, Takuma Udagawa, Kei Tateno · 2025

Read Not Just What, But When: Integrating Irregular Intervals to LLM for Sequential Recommendation Conference: Proceedings of the Nineteenth ACM Conference on Recommender Systems; September 22–26, 2025; Prague, Czech Republic Proceedings of the Nineteenth ACM Conference on Recommender Systems (RecSys ’25 by Wei-Wei Du, Takuma Udagawa, Kei Tateno (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-23209.txt.

Introduction

Du, Udagawa, and Tateno taught recommender models to mind the clock in this paper from twenty twenty-five. Most systems read the order of past purchases but ignore the gaps between them. Yet a weekly buyer and a yearly buyer with identical histories are different people. Their model, IntervalLLM, feeds those gaps into a language model alongside the items.

A special attention scheme weighs items and intervals jointly. The authors also judge cold-start performance from the interval angle, a new viewpoint. Across three benchmarks, scores rose by about four percent on average. The model led in both warm and cold scenarios. Interval-based cold starts, they note, hurt every method most, marking a research frontier.

Catalog record

CREATORWei-Wei Du, Takuma Udagawa, Kei Tateno
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-23209

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Not Just What, But When: Integrating Irregular Intervals to LLM for Sequential Recommendation Conference: Proceedings of the Nineteenth ACM Conference on Recommender Systems; September 22–26, 2025; Prague, Czech Republic Proceedings of the Nineteenth ACM Conference on Recommender Systems (RecSys ’25), September 22–26, 2025, Prague, Czech Republic DOI: 10.1145/3705328.3748013 ISBN: 979-8-4007-1364-4/2025/09 Wei-Wei Du, Takuma Udagawa, Kei Tateno Abstract . Time intervals between purchasing items are a crucial factor in sequential recommendation tasks, whereas existing approaches focus on item sequences and often overlook by assuming the intervals between items are static. However, dynamic intervals serve as a dimension that describes user profiling on not only the history within a user but also different users with the same item history. In this work, we propose IntervalLLM , a novel framework that integrates interval information into LLM and incorporates the novel interval-infused attention to jointly consider information of items and intervals. Furthermore, unlike prior studies that address the cold-start scenario only from the perspectives of users and items, we introduce a new viewpoint: the interval perspective to serve as an additional metric for evaluating recommendation methods on the warm and cold scenarios. Extensive experiments on 3 benchmarks with both traditional- and LLM-based baselines demonstrate that our IntervalLLM achieves not only 4.4% improvements in average but also the best-performing warm and cold scenarios across all users, items, and the proposed interval perspectives. In addition, we observe that the cold scenario from the interval perspective experiences the most significant performance drop among all recommendation methods. This finding underscores the necessity of further research on interval-based cold challenges and our integration of interval information in the realm of sequential recommendation tasks. Our code is available here: https://github.com/sony/ds-research-code/tree/master/recsys25-IntervalLLM. † † cc-license: by 1. Introduction In sequential recommendation, next-item prediction aims to forecast the next item a user is likely to select based on the past behavior. Recent state-of-the-art models have increasingly adopted LLM-based approaches ( Liao et al. 2024 ; Lin et al. 2023 ) , which not only enhance textual understanding but also leverage reasoning ability and world knowledge. Prior to the emergence of LLMs, several sequential recommendation models ( Li et al. 2020 ; Dang et al. 2023 ; Seol et al. 2022 ) incorporated interval information to capture the temporal dynamics of user behavior. With the advent of powerful LLMs, some studies ( Jin et al. 2024 ; Zhou et al. 2023 ; Chang et al. 2025 ) integrated timestamps into LLM-based methods for time-series tasks, but none of these studies specifically focus on sequential recommendation. Figure 1 . Examples of purchase histories for two users. As shown in Figure 1 , existing models often consider the purchase item history as a sequence for sequential recommendation. They neglect the influence of temporal intervals in shaping user behavior, as depicted by the red squares. Even with identical item sequences, varying intervals (highlighted in blue for User A and User B) reveal differing item influences. In this work, we take the first step toward integrating interval information into LLM-based recommender systems, bridging the gap between sequential recommendation and the interval modeling capabilities of LLMs. Figure 2 . The proposed IntervalLLM. All LLM parameters except for those in LoRA are frozen. Furthermore, as the number of users and items increases, user-item interaction data becomes increasingly sparse, making it challenging to model user and item behaviors with limited interactions. This issue, commonly referred to as the cold-start problem, is frequently discussed in recommendation system research ( Yuan and Hernandez 2023 ; Zhang et al. 2025 ) . However, in real-world recommendation systems, where interaction data accumulate over long periods, the cold-start problem from a time-interval perspective, which refers to users whose interactions are characterized by relatively long time gaps, is another critical yet often overlooked issue. User preferences evolve over time, and item trends change dynamically. The temporal aspect of item sequences plays a significant role in distinguishing recent purchasing behaviors from historical ones. To address this gap, we aim to benchmark existing sequential recommendation methods not only for cold-start users and items but also from an interval cold-start perspective. Furthermore, we explore how leveraging LLM knowledge and interval-based information can enhance performance in scenarios where traditional methods struggle. Our contributions are summarized as follows: • To the best of our knowledge, IntervalLLM is the first work to integrate time intervals into LLMs for sequential recommendation, enabling the model to capture user behavior based on the intervals between consecutive items. • Beyond separately incorporating item and interval embeddings, we propose Interval-Infused Attention to capture the temporal relevance between items and intervals. • We introduce a novel perspective on the cold-start problem by considering time intervals and reveal that existing methods suffer from significant performance drops in interval cold-start scenarios. Experiments demonstrate that IntervalLLM achieves the best performance in overall, warm, and even cold-start scenarios. 2. Preliminaries 2.1. Related Work Recent advancements in LLMs have demonstrated their remarkable effectiveness due to their extensive world knowledge and strong generalization capabilities. In the context of sequential recommendation tasks, two primary strategies have emerged for leveraging LLMs. The first treats LLMs as feature extractors, using their embeddings to initialize existing recommendation models ( Wu et al. 2021 ; Harte et al. 2023 ) . The second involves directly fine-tuning LLMs as recommenders, leveraging their vast pre-trained knowledge and advanced reasoning abilities ( Harte et al. 2023 ; Chen 2023 ; Bao et al. 2023a ; Bao et al. 2023b ) . To further enrich recommendation representations, models such as MoRec ( Yuan et al. 2023 ) , A-LLMRec ( Kim et al. 2024 ) , and LLM-SRec ( Kim et al. 2025 ) incorporate user embeddings extracted from pre-trained collaborative filtering models. However, these approaches exclude timestamp or interval information, thereby neglecting the temporal dimension inherent in sequential data. To address this gap, we introduce a novel cold-start benchmark from the interval perspective and investigate effective strategies for integrating interval information into LLMs to enhance sequential recommendation performance. 2.2. Sequential Recommendation Task In the context of sequential recommendation, a user interacts chronologically with a sequence of n item names [ i_{1} , i_{2} , …, i_{n} ] and corresponding intervals [ t_{1} , t_{2} , …, t_{n-1} ], where each t_{k} represents the time difference between consecutive items. To align with the generative capabilities of LLMs, a set of candidate items [ c_{1} , c_{2} , …, c_{j} ] is randomly sampled from the item pool for each user. The goal of the sequential recommendation task can be formulated as: (1) \begin{split}i_{n+1}=f([i_{1},i_{2},\dots,i_{n}],[t_{1},t_{2},\dots,t_{n-1}],[c_{1},c_{2},\dots,c_{j}])\end{split} where i_{n+1} denotes the next item to be recommended at the (n+1) -th timestamp, and f represents the recommendation algorithm. Notably, the number of items in the sequence exceeds the number of time intervals by one, as each t_{k} captures the temporal gap between consecutive items i_{k} and i_{k+1} . 3. Methodology Optionalized Next Item Recommendation Prompt Input: This user has purchased: i_{1} [ITEM] \hat{x}_{1} [/ITEM] , and after t_{1} [INTERVAL] z_{1} [/INTERVAL] days purchased i_{2} [ITEM] \hat{x}_{2} [/ITEM] , and after t_{2} [INTERVAL] z_{2} [/INTERVAL] days purchased i_{3} [ITEM] \hat{x}_{3} [/ITEM] … . Based on this history, recommend the next product that the user is most likely to purchase from

Read the complete text