Pay Attention to Sequence Split: Uncovering the Impacts of Sub-Sequence Splitting on Sequential Recommendation Models DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation emai; June 03–05, 2018; Woodstock, NY Woodstock ’18: ACM Symposium on Neural Gaze Detection, June 03–05, 2018, Woodstock, NY ISBN: 978-1-4503-XXXX-X/18/06 CCS: Information systems Recommender systems
Yizhou Dang, Yifan Wu, Minhan Huang, Chuang Zhao, Lianbo Ma, Guibing Guo, Xingwei Wang, Zhu Sun · 2026
Read Pay Attention to Sequence Split: Uncovering the Impacts of Sub-Sequence Splitting on Sequential Recommendation Models DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation emai; June 03–05, 2018; Woodstock, NY Woodstock ’18: ACM Symposium on Neural Gaze Detection, June 03–05, 2018, Woodstock, NY ISBN: 978-1-4503-XXXX-X/18/06 CCS: Information systems Recommender systems by Yizhou Dang, Yifan Wu, Minhan Huang, Chuang Zhao, Lianbo Ma, Guibing Guo, Xingwei Wang, Zhu Sun (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-05309.txt.
Introduction
Dang and seven colleagues warn that a popular data trick in sequential recommendation may be flattering the field's progress. The trick splits each user's history into shorter sub-histories, and many recent leading models apply it silently while reading data. Stripping it out drops their scores below older classical models. It only shines when a particular split method, target choice, and loss function line up, because it evens out training data and spreads target items more widely.
Catalog record
| CREATOR | Yizhou Dang, Yifan Wu, Minhan Huang, Chuang Zhao, Lianbo Ma, Guibing Guo, Xingwei Wang, Zhu Sun |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62709 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.05309
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Pay Attention to Sequence Split: Uncovering the Impacts of Sub-Sequence Splitting on Sequential Recommendation Models DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation emai; June 03–05, 2018; Woodstock, NY Woodstock ’18: ACM Symposium on Neural Gaze Detection, June 03–05, 2018, Woodstock, NY ISBN: 978-1-4503-XXXX-X/18/06 CCS: Information systems Recommender systems Yizhou Dang, Yifan Wu, Minhan Huang, Chuang Zhao, Lianbo Ma, Guibing Guo, Xingwei Wang, Zhu Sun Abstract . Sub-sequence splitting (SSS) has been demonstrated as an effective approach to mitigate data sparsity in sequential recommendation (SR) by splitting a raw user interaction sequence into multiple sub-sequences. Previous studies have demonstrated its ability to enhance the performance of SR models significantly. However, in this work, we discover that (i). SSS may interfere with the evaluation of the model’s actual performance. We observed that many recent state-of-the-art SR models employ SSS during the data reading stage (not mentioned in the papers). When we removed this operation, performance significantly declined, even falling below that of earlier classical SR models. The varying improvements achieved by SSS and different splitting methods across different models prompt us to analyze further when SSS proves effective. We find that (ii). SSS demonstrates strong capabilities only when specific splitting methods, target strategies, and loss functions are used together. Inappropriate combinations may even harm performance. Furthermore, we analyze why sub-sequence splitting yields such remarkable performance gains and find that (iii). it evens out the distribution of training data while increasing the likelihood that different items are targeted. Finally, we provide suggestions for overcoming SSS interference, along with a discussion on data augmentation methods and future directions. We hope this work will prompt the broader community to re-examine the impact of data splitting on SR and promote fairer, more rigorous model evaluation. All analysis code and data will be made available upon acceptance. We provide a simple, anonymous implementation at https://github.com/KingGugu/SSS4SR . 1. Introduction Sequential recommendation learns user preferences from their historical interaction sequences and generates personalized suggestions ( 26 ; 32 ; 23 ; 9 ) . Over the past several years, numerous SR models based on different architectures have been proposed, achieving remarkable progress ( 90 ; 9 ; 80 ; 16 ) . However, most users tend to interact with only a small number of items on the platform, while most items receive very few interactions ( 77 ; 13 ; 15 ) . Consequently, the widespread data sparsity limits the models’ performance. To tackle this, researchers proposed many effective data augmentation (DA) methods to generate additional training data ( 41 ; 47 ; 11 ; 40 ) . Figure 1 . An example of SSS interferes with model evaluation. Data augmentation alleviates data sparsity by perturbing original data or directly generating new samples ( 59 ; 60 ) . Research in this area can be broadly categorized into two types: the first involves heuristic operations based on rules and human prior knowledge, such as sub-sequence splitting (also known as sliding windows) ( 62 ; 33 ) , which split one original sequence into many sub-sequences (e.g., [1,2,3,4]\rightarrow\{[1,2],[1,2,3],[1,2,3,4]\} ), dropout ( 61 ) , cropping ( 70 ) , masking ( 70 ) , and insert ( 46 ) . The second category comprises methods that leverage learnable augmentation modules, such as extending short sequences with bidirectional transformers ( 47 ; 25 ) , replacing items by counterfactual thinking ( 66 ) , and directly generating new sequences with diffusion models ( 41 ; 67 ) . Although DA methods are intended to better facilitate model learning of user preferences and improve recommendation accuracy, we find that sub-sequence splitting, one of the earliest proposed and proven-effective DA methods ( 91 ) , may not have been applied appropriately in many recent SR models. This problem has led to widespread issues, including misjudged performance and unfair evaluations. (i). SSS Interferes with Model Evaluation. (Section 3 ) Through an empirical study conducted on many SR models recently published in top-tier venues, we reveal that Sub-sequence splitting may interfere with our evaluation of the SR models’ actual performance. As shown in Figure 1 , we find that many recently proposed representative SR models employed SSS during data reading without acknowledging it in their papers. When we removed their SSS operations, the models’ performance significantly deteriorated. Among the ten models we investigated, seven experienced performance drops exceeding 40%. Some models even underperformed the classic model SASRec without any data augmentation ( 26 ) . This result indicates that SSS interfered with researchers’ accurate and rigorous evaluation of model performance. The additional performance gains it introduced led to an unfair comparison. Through investigation, we discover that this phenomenon likely stems from an earlier representative SR model that incorporated SSS into its code pipeline without mentioning it ( 90 ) . Subsequently, many researchers implemented their own models on this pipeline. Only a handful of researchers detected the SSS and removed it. (ii). When is SSS Effective? (Section 4 ) Furthermore, we observed that SSS yields varying degrees of improvement across different models. Given differences in loss functions (cross-entropy and binary cross-entropy), target strategies (single-target and multi-target), and splitting methods (prefix splitting, suffix splitting, and sliding window) across these models, we further explored the conditions under which SSS achieves its maximum effectiveness. Through experiments on the four most representative and influential SR models with real-world datasets, we find that SSS demonstrates strong capabilities only when specific splitting methods, target strategies, and loss functions are used together. Performance differences under the same model with different settings are significant. We also find that when employing appropriate settings, the early classical SR model, SASRec, can achieve performance comparable to recently proposed SR models. This observation further validates the findings in (i), namely that SSS interferes with our evaluation of the actual performance of the SR model. (iii). Why is SSS Effective? (Section 5 ) Inspired by previous research on data augmentation ( 6 ; 33 ) , we analyze why sub-sequence splitting yields such remarkable performance gains and find that it evens out the distribution of training data while increasing the likelihood that different items are targeted. After adopting the sub-sequence splitting approach, both the absolute frequency and probability of low-frequency and less popular items being included in training increased. This enables the model to learn more accurate and comprehensive item representations. Discussions. (Section 6 ) Based on the above analysis, we provide practical suggestions for overcoming SSS interference. When implementing and evaluating SR models, we should ensure that data splitting is applied consistently across all models. We can also choose to comprehensively evaluate the model across different settings. Additionally, we provide discussions for developing more effective DA methods, the impacts of this work beyond SR, and future directions. All analysis code and data will be made available upon acceptance. We provide a simple, anonymous implementation at https://anonymous.4open.science/r/SSS_Review-45C3 . 2. Preliminaries 2.1. Problem Formulation Suppose we have user set \mathcal{U} and item set \mathcal{V} . Each user u\in\mathcal{U} is associated with a sequence of interacted items in chronological order s_{u}=[v_{1},\ldots,v_{j},\ldots,v_{\left|s_{u}\right|}] , where v_{j}\in\mathcal{V} indicate the item that user u has interacted with at time step j and \left|s_{u}\right| is the sequence