Tail-Aware Data Augmentation for Long-Tail Sequential Recommendation DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation emai; June 03–05, 2018; Woodstock, NY Woodstock ’18: ACM Symposium on Neural Gaze Detection, June 03–05, 2018, Woodstock
Yizhou Dang, Zhifu Wei, Minhan Huang, Lianbo Ma, Jianzhe Zhao, Guibing Guo, Xingwei Wang · 2026
Read Tail-Aware Data Augmentation for Long-Tail Sequential Recommendation DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation emai; June 03–05, 2018; Woodstock, NY Woodstock ’18: ACM Symposium on Neural Gaze Detection, June 03–05, 2018, Woodstock by Yizhou Dang, Zhifu Wei, Minhan Huang, Lianbo Ma, Jianzhe Zhao, Guibing Guo, Xingwei Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-10933.txt.
Introduction
Yizhou Dang and co-authors tackle the long-tail problem in sequential recommendation. Sequential systems learn from each user's history of clicks and buys. Most users touch only a handful of items, while most items are rarely consumed. That imbalance starves the model of signal for both quiet users and niche items. Their fix is tail-aware data augmentation.
Augmentation creates extra training examples where data are thin. Tail-aware design adds them where the tail needs them most, not uniformly. The aim is recommendations that serve niche tastes, not just blockbuster items. The work serves platforms whose catalogs are vast but whose per-user histories are short and sparse.
Catalog record
| CREATOR | Yizhou Dang, Zhifu Wei, Minhan Huang, Lianbo Ma, Jianzhe Zhao, Guibing Guo, Xingwei Wang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 74 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-10933
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Tail-Aware Data Augmentation for Long-Tail Sequential Recommendation DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation emai; June 03–05, 2018; Woodstock, NY Woodstock ’18: ACM Symposium on Neural Gaze Detection, June 03–05, 2018, Woodstock, NY ISBN: 978-1-4503-XXXX-X/18/06 CCS: Information systems Recommender systems Yizhou Dang, Zhifu Wei, Minhan Huang, Lianbo Ma, Jianzhe Zhao, Guibing Guo, Xingwei Wang Abstract . Sequential recommendation (SR) learns user preferences based on their historical interaction sequences and provides personalized suggestions. In real-world scenarios, most users can only interact with a handful of items, while the majority of items are seldom consumed. This pervasive long-tail challenge limits the model’s ability to learn user preferences. Despite previous efforts to enrich tail items/users with knowledge from head parts or improve tail learning through additional contextual information, they still face the following issues: 1) They struggle to improve the situation where interactions of tail users/items are scarce, leading to incomplete preferences learning for the tail parts. 2) Existing methods often degrade overall or head parts performance when improving accuracy for tail users/items, thereby harming the user experience. In this work, we propose T ail- A ware D ata A ugmentation (TADA) for long-tail sequential recommendation, which enhances the interaction frequency for tail items/users while maintaining head performance, thereby promoting the model’s learning capabilities for the tail. Specifically, we first capture the co-occurrence and correlation among low-popularity items by a linear model. Building upon this, we design two tail-aware augmentation operators, T-Substitute and T-Insert. The former replaces the head item with a relevant item, while the latter utilizes co-occurrence relationships to extend the original sequence by incorporating both head and tail items. The augmented and original sequences are mixed at the representation level to preserve preference knowledge. We further extend the mix operation across different tail-user sequences and augmented sequences to generate richer augmented samples, thereby improving tail performance. Comprehensive experiments demonstrate the superiority of our method. The codes are provided at https://github.com/KingGugu/TADA . 1. Introduction As an indispensable component of web services, sequential recommendation has garnered widespread attention due to its high degree of consistency with real-world scenarios ( Kang and McAuley 2018 ; Zhai et al. 2025b ; Di et al. 2025c ; Di et al. 2025a ) . It models user preferences based on user-item interaction sequences and recommends items that users are likely to interact with next. Numerous SR models based on various architectures have been proposed, achieving significant advancements ( Hidasi et al. 2015 ; He and McAuley 2016 ; Kang and McAuley 2018 ; Zhou et al. 2022 ) . Despite their effectiveness, the widespread long-tail problem limits the practicality of the model ( Jang et al. 2020 ; Liu et al. 2024b ) . Specifically, due to users’ limited purchasing power and interaction capacity, most users can only interact with a tiny portion of items on the platform ( Dang et al. 2024b ) . This results in short historical sequences for these users (i.e., long-tail users), making it difficult for models to learn accurate user behavior patterns from them ( Kim et al. 2023 ) . From the perspective of items, only a handful of popular items are viewed or purchased frequently by users, while most items are rarely consumed (i.e., long-tail items), making it challenging for models to learn accurate item representations ( Liu et al. 2024b ) . As shown in Figure 1 (a), the real-world Beauty dataset demonstrates a high proportion of both long-tail users and items. To address the long-tail problem, the primary solution in existing research is knowledge transfer ( Jang et al. 2020 ; Kim et al. 2023 ; Yang et al. 2023 ) . The representative methods, CITIES ( Jang et al. 2020 ) , leveraged representations learned from popular items to enrich representations of tail items, thereby compensating for the poor convergence of embeddings caused by limited interactions. On the other hand, some efforts attempted to incorporate additional interactions for long-tail users, enhancing the model’s ability to learn and reason about their preferences ( Jiang et al. 2021 ; Liu et al. 2023a ) . For example, ASReP ( Jiang et al. 2021 ) employs a reversely pre-trained transformer to generate pseudo-prior items for short sequences. Then, fine-tune the pre-trained transformer to predict the following item. (a) Visualization of long-tail users (left) and items (right) in Beauty dataset. Existing knowledge transfer-based methods fail to effectively increase the number of interactions for the tail. (b) Existing works may result in overall and head performance damage (i.e. seesaw effect) while improving tail performance. Figure 1 . The (a) long tail issue and (b) seesaw effect. Despite the progress, we two unresolved issues remain: (1) Interaction Sparsity: Existing methods struggle to increase interaction frequency for long-tail users and items fundamentally. Sparse interactions constrain the model’s ability to learn user preferences. Mainstream SR models treat item representations as the primary learnable parameters, while user representations are usually modeled implicitly and embedded in the model’s output representation of the interaction sequence ( Kang and McAuley 2018 ) . Consequently, the number of item interactions directly determines the convergence of item embeddings during training, thereby affecting prediction accuracy. Although representations from head items can partially refine tail item embeddings, interaction sparsity significantly constrains the model’s learning capacity. It is worth emphasizing that items added by ASReP are mostly head items, thereby cannot improve the sparseness of tail items ( Liu et al. 2024b ) . (2) Seesaw Phenomenon: While improving performance for tail-end users and items, existing methods may result in overall performance degradation and loss of top-tier performance (i.e., the seesaw problem), thereby compromising the overall user experience. As shown in Figure 1 (b), although LOAM ( Yang et al. 2023 ) improves the recommendation accuracy for tail users and items, it reduces performance of other parts. To tackle the above challenges, in this work, we propose T ail- A ware D ata A ugmentation (TADA) for long-tail sequential recommendation. Our core idea is to leverage crafted augmentation modules to increase interactions of tail items and users, which enhances long-tail performance while avoiding the loss of head and overall performance caused by knowledge transfer. Specifically, we first constructed a linear item-item Similarity model ( Choi et al. 2025 ) , utilizing ridge regression to model co-occurrence relationships between items (particularly long-tail unpopular items). Based on this correlation, we designed two tail-aware data augmentation operators, T-Substitute and T-Insert. The T-Substitute prioritizes replacing head items in sequences with relevant long-tail items. T-Insert prioritizes inserting relevant head items before tail items to boost the model’s prediction for those tail items. Subsequently, we mix the replaced sequences with their original sequences at the representation level, while mixing the inserted sequences with their extended original sequences, thereby generating novel yet semantically relevant samples ( Dang et al. 2025b ) . Subsequently, we extended the mixing operation within the cross-sequence augmentation module to encompass different long-tail sequences and their augmented counterparts. It enables the model to optimize representations from diverse augment samples for both head and tail sequences in a differentiated manner, thereby achieving a consistent improvement in overall performance. Extensive experiments on various datasets and backbones to validate the