Dynamic Time-aware Continual User Representation Learning Conference: Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 13–18, 2025; Padua, Italy Proceedings of the 48th International ACM SIGIR Conference on Research and Development

Seungyoon Choi, Sein Kim, Hongseok Kang, Wonjoong Kim, Chanyoung Park · 2025

Read Dynamic Time-aware Continual User Representation Learning Conference: Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 13–18, 2025; Padua, Italy Proceedings of the 48th International ACM SIGIR Conference on Research and Development by Seungyoon Choi, Sein Kim, Hongseok Kang, Wonjoong Kim, Chanyoung Park (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-16501.txt.

Introduction

Seungyoon Choi and four co-authors rebuild user profiles that must keep learning as shops and feeds change over time. One universal model for many tasks is the goal of continual user representation learning. Older tests froze time, so new items never disturbed earlier tasks, which real platforms never promise. The authors define a time-aware evaluation that lets item pools drift as tasks arrive.

Their DITTO framework fights the forgetting that drift causes while letting old knowledge bend to new stock. Experiments under the realistic setup put DITTO ahead of the leading rivals. Code is public for replication.

Catalog record

CREATORSeungyoon Choi, Sein Kim, Hongseok Kang, Wonjoong Kim, Chanyoung Park
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE68 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-16501

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Dynamic Time-aware Continual User Representation Learning Conference: Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 13–18, 2025; Padua, Italy Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’25), July 13–18, 2025, Padua, Italy DOI: 10.1145/3726302.3729959 ISBN: 979-8-4007-1592-1/2025/07 CCS: Information systems Data stream mining Seungyoon Choi, Sein Kim, Hongseok Kang, Wonjoong Kim, Chanyoung Park Abstract . Traditional user modeling (UM) approaches have primarily focused on designing models for a single specific task, but they face limitations in generalization and adaptability across various tasks. Recognizing these challenges, recent studies have shifted towards continual learning (CL)-based universal user representation learning aiming to develop a single model capable of handling multiple tasks. Despite advancements, existing methods are in fact evaluated under an unrealistic scenario that does not consider the passage of time as tasks progress, which overlooks newly emerged items that may change the item distribution of previous tasks. In this paper, we introduce a practical evaluation scenario on which CL-based universal user representation learning approaches should be evaluated, which takes into account the passage of time as tasks progress. Then, we propose a novel framework D ynam I c T ime-aware con T inual user representati O n learner, named DITTO , designed to alleviate catastrophic forgetting despite continuous shifts in item distribution, while also allowing the knowledge acquired from previous tasks to adapt to the current shifted item distribution. Through our extensive experiments, we demonstrate the superiority of DITTO over state-of-the-art methods under a practical evaluation scenario. Our source code is available at https://github.com/seungyoon-Choi/DITTO_official . † † cc-license: by-nc-sa 1. Introduction Recent research emphasizes the importance of user modeling (UM) in delivering personalized services to individual customers ( Li et al. 2015 ; Koren et al. 2009 ; Hidasi et al. 2015 ; Kang and McAuley 2018 ; Yuan et al. 2019 ; Kim et al. 2023a ) . By learning reliable user representations, UM enables the provision of tailored recommendations and accurate predictions of user behavior. Understanding customer interests and preferences not only enhances service quality but also fosters the creation of products and services that better resonate with users. Most existing studies on UM focus on designing models for a single specific task ( Guo et al. 2017 ; Yuan et al. 2019 ; Zhou et al. 2019 ) , e.g., a model for click prediction and another model for user profiling. However, since enterprises offer multiple services to users, maintaining an independent model for each service entails the cost for maintaining and updating the model, and this becomes especially impractical as new services are continuously launched. To this end, research on universal user representation learning has recently garnered attention ( Yuan et al. 2020 ; Yuan et al. 2021 ; Ni et al. 2018a ; Gu et al. 2021 ) . Universal user representation refers to a user representation that can be generally applied to multiple tasks, representing a user in a universal manner. The core of universal user representation learning lies in training a single user model applicable across various tasks. Prior studies have employed multi-task learning (MTL) ( Crawshaw 2020 ; Ruder 2017 ) to learn universal user representation, whose key idea is to simultaneously train multiple tasks aiming to maximize/minimize positive/negative transfer between tasks by understanding the relationship between tasks, thereby enhancing the performance of all tasks ( Ni et al. 2018b ; Ma et al. 2018 ) . However, MTL is impractical as it requires all user data to be simultaneously available for all tasks at once. To address these issues, transfer learning (TL) has been introduced, utilizing knowledge learned from models pre-trained on source tasks to tackle a target task ( Yuan et al. 2020 ; Zhao et al. 2013 ; Yang et al. 2021 ) . However, TL always transfers knowledge between a pair of tasks, i.e., from a source task to a target task, and thus is not suitable for the essence of universal user representation learning, which aims to learn a universal model that can be adapted to a more diverse range of tasks. For this reason, recent studies mainly focus on continual learning (CL), whose key idea is to sequentially train various tasks with a single model, while preventing catastrophic forgetting of the knowledge acquired from earlier tasks ( Kumari et al. 2022 ; Zhou and Cao 2021 ; Yoon et al. 2017 ) . Table 1. The number of new items emerged over a time horizon. Tmall Dataset Num. items The number of new items emerged given on 8/11 8/11 ~ 8/26 8/26 ~ 9/11 9/11 ~ 9/26 9/26 ~ 10/11 10/11 ~ 10/26 10/26~ 11/12 Click 570.6K 65.0K 79.0K 61.0K 58.9K 77.0K 171.3K Cart 6.2K 1.1K 1.9K 1.7K 1.9K 3.2K 27.1K Purchase 153.3K 16.8K 26.5K 19.2K 18.4K 21.3K 117.3K Favorite 195.2K 27.2K 34.4K 28.1K 28.2K 39.1K 93.1K Although existing CL-based universal user representation learning approaches have achieved promising results, we argue that their evaluation scenario is unrealistic: it overlooks the passage of time as tasks progress . In other words, while Task 2 is being trained, Task 1 is assumed to remain static, ignoring the potential introduction of new items to Task 1 (please refer Fig. 2 ). However, as shown in Table 1 , new items continuously emerge over a time horizon. For example, for the click prediction task, the number of items given on 8/11 is 570.6K, while 65K new items emerged within the next two weeks (i.e., 8/11 ~ 8/26). This implies that tasks are likely to encounter a continuous shift in the item distribution as time passes, and we argue that this should not be overlooked when evaluating the CL-based universal user representation approaches. On the other hand, as the existing state-of-the-art approach, TERACON ( Kim et al. 2023b ) , is originally designed considering the unrealistic evaluation scenario described above, we observe that the performance of TERACON when new items emerge as tasks progress (i.e., Dynamic scenario) is significantly inferior to that when new items do not emerge (i.e., Static scenario) in Figure 1 . We attribute this to two reasons: (1) The retention module of TERACON induces negative transfer. TERACON retains the knowledge learned from the previous task through a knowledge retention module that transfers the knowledge of the current model regarding the previous task to help train the current model itself. This is done by generating pseudo-labels of the previous task for the given user behavior sequences in the current task. However, for the user behavior sequence in the current task that interacts with items not seen during the previous task training, reliable pseudo-labels cannot be generated, and retaining such unreliable knowledge results in negative transfer. (2) The previous task cannot adapt to the changed item distribution in the current task. While successful knowledge retention in (1) is important, it is equally critical to adapt to shifted distribution. In dynamic scenarios, simply retaining knowledge from the previous task is insufficient; the retained knowledge must also be capable of adapting to the shifted distribution in the current task. Since TERACON (as well as all the existing CL-based universal user representation learning approaches ( Yuan et al.

Read the complete text