eSASRec: Enhancing Transformer-based Recommendations in a Modular Fashion Conference: Proceedings of the Nineteenth ACM Conference on Recommender Systems; September 22–26, 2025; Prague, Czech Republic Proceedings of the Nineteenth ACM Conference on Recommender Systems (RecSys ’25), September 22–26,
Daria Tikhonovich, Nikita Zelinskiy, Aleksandr V. Petrov, Mayya Spirina, Andrei Semenov, Andrey V. Savchenko, Sergei Kuliev · 2025
Read eSASRec: Enhancing Transformer-based Recommendations in a Modular Fashion Conference: Proceedings of the Nineteenth ACM Conference on Recommender Systems; September 22–26, 2025; Prague, Czech Republic Proceedings of the Nineteenth ACM Conference on Recommender Systems (RecSys ’25), September 22–26, by Daria Tikhonovich, Nikita Zelinskiy, Aleksandr V. Petrov, Mayya Spirina, Andrei Semenov, Andrey V. Savchenko, Sergei Kuliev (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-06450.txt.
Introduction
Daria Tikhonovich, Nikita Zelinskiy, and five peers ask which known boosts to shift-based pick tools add up in truth. The work came out in 2025. Tools like SASRec call the next pick from a user's past picks. Past work boosted them bit by bit. Some tweaked tiers. Some set new goals. Some set new loss rules.
No one had checked if those split boosts stack or clash. The team tests the mixes in a set, step-by-step way. One mix stands out from the rest. It joins the train goal of SASRec, a new tier build called LiGR, and a picked softmax loss. They name the mix eSASRec. The tests stress real, plant-like terms. They shun terms made to flatter score boards. The find is of use in real work. It gives teams a strong set build, ready off the shelf.
Catalog record
| CREATOR | Daria Tikhonovich, Nikita Zelinskiy, Aleksandr V. Petrov, Mayya Spirina, Andrei Semenov, Andrey V. Savchenko, Sergei Kuliev |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 27 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-06450
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
eSASRec: Enhancing Transformer-based Recommendations in a Modular Fashion Conference: Proceedings of the Nineteenth ACM Conference on Recommender Systems; September 22–26, 2025; Prague, Czech Republic Proceedings of the Nineteenth ACM Conference on Recommender Systems (RecSys ’25), September 22–26, 2025, Prague, Czech Republic DOI: 10.1145/3705328.3759317 ISBN: 979-8-4007-1364-4/2025/09 CCS: Information systems Recommender systems Daria Tikhonovich, Nikita Zelinskiy, Aleksandr V. Petrov, Mayya Spirina, Andrei Semenov, Andrey V. Savchenko, Sergei Kuliev Abstract . Since their introduction, Transformer-based models, such as SASRec and BERT4Rec, have become common baselines for sequential recommendations, surpassing earlier neural and non-neural methods. A number of following publications have shown that the effectiveness of these models can be improved by, for example, slightly updating the architecture of the Transformer layers, using better training objectives, and employing improved loss functions. However, the additivity of these modular improvements has not been systematically benchmarked - this is the gap we aim to close in this paper. Through our experiments, we identify a very strong model that uses SASRec’s training objective, LiGR Transformer layers, and Sampled Softmax Loss. We call this combination eSASRec (Enhanced SASRec). While we primarily focus on realistic, production-like evaluation, in our preliminarily study we find that common academic benchmarks show eSASRec to be 23% more effective compared to the most recent state-of-the-art models, such as ActionPiece. In our main production-like benchmark, eSASRec resides on the Pareto frontier in terms of the accuracy–coverage tradeoff (alongside the recent industrial models HSTU and FuXi- α \alpha ). As the modifications compared to the original SASRec are relatively straightforward and no extra features are needed (such as timestamps in HSTU), we believe that eSASRec can be easily integrated into existing recommendation pipelines and can can serve as a strong yet very simple baseline for emerging complicated algorithms. To facilitate this, we provide the open-source implementations for our models and benchmarks in repository https://github.com/blondered/transformer_benchmark 1. Introduction and Preliminary Study Figure 1. The results of our preliminary study on the Amazon Beauty benchmark. Reported metrics are taken from the original papers: S3Rec ( Zhou et al. 2020b ) , LSAN ( Li et al. 2021 ) , DuoRec ( Qiu et al. 2021 ) , CL4SRec ( Xie et al. 2022 ) , TIGER ( Rajput et al. 2023 ) , ActionPiece ( Hou et al. 2025 ) , ELMRec ( Wang et al. 2024 ) . HSTU ( Zhai et al. 2024 ) and SASRec ( Kang and McAuley 2018 ) are taken from ( Hou et al. 2025 ) . Sequential recommender systems model the ordered sequence of user-item interactions to predict the next item a user will engage with. Since the introduction of SASRec ( Kang and McAuley 2018 ) in 2018 and BERT4Rec ( Sun et al. 2019 ) in 2019, these models became very popular in both academic and industrial settings for sequential recommendation. Indeed, these models are routinely used as the baselines in research ( Petrov and Macdonald 2022 ) and their variants are used in production ( Koneru et al. 2024a ) . Despite their popularity, it has been shown that “vanilla” versions (i.e. models trained exactly as described in their respective papers) yield sub-optimal effectiveness, which can be improved by employing better training objectives, loss functions and negative sampling strategies ( Klenitskiy and Vasilev 2023 ; Petrov and Macdonald 2023 ; Pancha et al. 2022 ; Petrov and Macdonald 2024 ) . Unfortunately, the additive effect of these modular enhancements has not been systematically studied. In the absence of clear guidance on which combinations to use, most researchers default to standard model configurations ( Zhou et al. 2020b ; Hou et al. 2025 ; Rajput et al. 2023 ; Wang et al. 2024 ) . Consequently, improvements over these baselines are often reported as state-of-the-art-claims that, we argue, are frequently overstated. To demonstrate this, we conducted a preliminary study comparing enhanced versions of SASRec ( Kang and McAuley 2018 ) on the Amazon reviews and MovieLens datasets using the evaluation setup from ( Zhou et al. 2020b ) . This setup - while not following best practices such as global temporal splitting ( Hidasi and Czapp 2023 ) and thus not used in our main experiments - serves as one of the most common academic benchmarks, enabling direct comparison with previously reported results 1 1 1 For details of the setup, we refer to the original paper ( Zhou et al. 2020b ) . . Figure 1 presents a subset of our preliminary study results (see Appendix for complete results on five common datasets). The figure compares the reported effectiveness (measured by NDCG@10 and Recall@10) of several recent models with two enhanced versions of SASRec: SASRec+SS (SASRec with Sampled Softmax loss ( Petrov and Macdonald 2023 ) ) and our proposed eSASRec (SASRec with both Sampled Softmax loss and LiGR ( Borisyuk et al. 2025 ) Transformer layers). Both variants outperform most recent models on this dataset. For instance, eSASRec improves NDCG@10 by 23% over ActionPiece (0.0523 vs. 0.0424). They also substantially outperform vanilla SASRec, confirming the impact of proposed modular improvements. Our preliminary study motivates us to evaluate the effectiveness of various modular enhancements to Transformer-based recommender models in production-like scenario with time-based validation strategy and beyond-accuracy (BAc) metrics taken into account. Through a systematic evaluation of multiple possible modifications (including loss functions, training objectives, Transformer layer configurations and negative sampling strategies), we find eSASRec to perform competitively with advanced production models such as HSTU ( Zhai et al. 2024 ) and FuXi- \alpha ( Ye et al. 2025 ) . As eSASRec’s combination of enhancements has been shown to work on a broad range of datasets, we recommend to use it as a baseline instead of (or alongside with) vanilla versions of Transformer-based models. In summary, our main contributions are twofold: • We present a realistic evaluation of multiple enhancements for Transformer-based models, including those that have never been tested on public data (e.g. Dense All Action training objective ( Pancha et al. 2022 ) , LiGR Transformer layers ( Borisyuk et al. 2025 ) ). • We demonstrate that eSASRec, which enhances original SASRec architecture with LiGR layers and Sampled Softmax loss, is a strong baseline for Transformer-based recommendations. 2. Related Work Transformer-based Models. Two main models in sequential recommendation, widely used as standard baselines in the literature, are SASRec ( Kang and McAuley 2018 ) that applies a causal self-attentive Transformer decoder with binary cross-entropy (BCE) loss, and BERT4Rec ( Sun et al. 2019 ; Petrov and Macdonald 2022 ) , which uses a bidirectional Transformer encoder with masking-based training objectives. Recent papers demonstrate various enhancements to classical transformer-based recommendation models ( Xie et al. 2022 ; Zhou et al. 2020b ; Rajput et al. 2023 ; Hou et al. 2025 ; Li et al. 2021 ) . In particular, ( Klenitskiy and Vasilev 2023 ; Zhai et al. 2023 ; Ye et al. 2025 ; Wu et al. 2024 ) replace softmax cross-entropy over the full item catalog, as used in original BERT4Rec ( Sun et al. 2019 ) , with SS loss. ( Petrov and Macdonald 2023 ) introduces a generalized binary cross-entropy (gBCE) loss in place of the BCE loss from SASRec (