Accelerating Generative Recommendation via Simple Categorical User Sequence Compression Conference: Proceedings of the Nineteenth ACM International Conference on Web Search and Data Mining; February 22–26, 2026; Boise, ID, USA Proceedings of the Nineteenth ACM International Conference on Web Search

Qijiong Liu, Lu Fan, Zhongzhou Liu, Xiaoyu Dong, Yuankai Luo, Guoyuan An, Nuo Chen, Wei Guo, Yong Liu, Xiao-Ming Wu · 2026

Read Accelerating Generative Recommendation via Simple Categorical User Sequence Compression Conference: Proceedings of the Nineteenth ACM International Conference on Web Search and Data Mining; February 22–26, 2026; Boise, ID, USA Proceedings of the Nineteenth ACM International Conference on Web Search by Qijiong Liu, Lu Fan, Zhongzhou Liu, Xiaoyu Dong, Yuankai Luo, Guoyuan An, Nuo Chen, Wei Guo, Yong Liu, Xiao-Ming Wu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-19158.txt.

Introduction

Qijiong Liu and ten co-authors squeeze user histories so generative recommenders can run in real time. Such recommenders get better as they read longer histories of what a user did. But reading long histories live is costly, which blocks their use in fast feeds.

Their fix compresses each user's sequence into a simple categorical form before the model reads it. A shorter input that keeps the key signals cuts cost while holding quality. Tricks of this kind decide whether lab grade recommenders can survive the speed demands of real products.

Catalog record

CREATORQijiong Liu, Lu Fan, Zhongzhou Liu, Xiaoyu Dong, Yuankai Luo, Guoyuan An, Nuo Chen, Wei Guo, Yong Liu, Xiao-Ming Wu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-19158

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Accelerating Generative Recommendation via Simple Categorical User Sequence Compression Conference: Proceedings of the Nineteenth ACM International Conference on Web Search and Data Mining; February 22–26, 2026; Boise, ID, USA Proceedings of the Nineteenth ACM International Conference on Web Search and Data Mining (WSDM ’26), February 22–26, 2026, Boise, ID, USA DOI: 10.1145/3773966.3779399 ISBN: 979-8-4007-2292-9/2026/02 CCS: Information systems Recommender systems CCS: Theory of computation Data compression Qijiong Liu, Lu Fan, Zhongzhou Liu, Xiaoyu Dong, Yuankai Luo, Guoyuan An, Nuo Chen, Wei Guo, Yong Liu, Xiao-Ming Wu Abstract . Although generative recommenders demonstrate improved performance with longer sequences, their real-time deployment is hindered by substantial computational costs. To address this challenge, we propose a simple yet effective method for compressing long-term user histories by leveraging inherent item categorical features, thereby preserving user interests while enhancing efficiency. Experiments on two large-scale datasets demonstrate that, compared to the influential HSTU model, our approach achieves up to a 6× reduction in computational cost and up to 39% higher accuracy at comparable cost (i.e., similar sequence length). The source code will be available at https://github.com/Genemmender/CAUSE . † † cc-license: by 1. Introduction Generative recommendation (GR) ( 14 ; 21 ; 18 ; 16 ; 19 ; 6 ; 11 ; 22 ) is an emerging paradigm for sequential recommendation ( 5 ; 2 ) , which directly generate recommendation items rather than using conventional multi-stage recommendation pipeline. Driven by the scaling laws uncovered in large language models ( 8 ; 1 ) , GR models have recently seen a wave of innovations guided by these principles. Specifically, recent advances have explored how GR performance scales with data volume ( 20 ) , sequence length ( 3 ) , network depth ( 18 ) and hidden dimension ( 17 ) . While these findings highlight the potential of scaling as a pathway to stronger recommendation performance, practical deployment in real-world systems presents unique challenges. As shown in Figure 1 , although longer sequences can improve recommendation accuracy, they also substantially increase training and inference time as well as GPU memory consumption, making it impractical to model long user histories without efficiency-oriented solutions. Although some industrial efforts have explored these issues ( 4 ; 7 ) , existing approaches often involve complex designs or focus primarily on optimizing network architectures rather than addressing the efficiency of user sequence modeling (see a detailed discussion in Sec. 2 ). In this paper, we propose a simple categorical user sequence compression framework ( CAUSE ) that partitions user interactions into a recent sequence and a distant historical sequence. By condensing the long-term history into a compact set of history tokens , CAUSE effectively incorporates richer sequential information while substantially alleviating the computational burden of training and inference on ultra-long sequences. Based on Figure 1 , CAUSE achieves substantial improvements in recommendation performance while maintaining comparable training cost. Our extensive evaluation on two large-scale real-world datasets shows that, compared to the influential HSTU model, our method can achieve up to a sixfold reduction in computational cost. Additionally, it can deliver up to 39% higher accuracy at a similar computational expense (i.e., equivalent sequence length). 0.5 1 1.5 2 2.5 3 \cdot 10^{5} 1.75 1.8 1.85 \cdot 10^{-2} Training Time (ms) Performance (nDCG@10) HSTU ours Length 1 1 64 1 1 512 1 1,024 1 2,048 Figure 1 . Training efficiency and recommendation performance of HSTU compared with our proposed CAUSE . Scaling trends are highlighted with fitted lines for both methods. 2. Preliminaries and Related Work Figure 2 . Illustration of the proposed user sequence compression framework. The observed user sequence \mathbf{s}_{u}^{\leq t} is divided into a long-term history \mathbf{h}_{u} (in red background) and a recent sequence \mathbf{r}_{u}^{\leq t} (in blue background). The history is substantially compressed based on item categorical features, while the recent sequence, which reflects the user’s current interests, is used to train both next-item prediction and action prediction tasks. 2.1. Generative Recommendation Problem Statement. Let \mathcal{U} , \mathcal{I} , and \mathcal{A} denote the sets of users, items, and action types (e.g., click, buy, dislike), respectively, with |\mathcal{U}|=M , |\mathcal{I}|=N , and |\mathcal{A}|=T . Each training sample corresponds to a user u\in\mathcal{U} and consists of user observed sequence \mathbf{s}_{u}=[(i_{1},a_{1}),\ldots,(i_{L},a_{L})] of length L , where i_{t}\in\mathcal{I} , a_{t}\in\mathcal{A} . The generative recommendation task aims to model the conditional probability of the next interaction based on the observed sequence \mathbf{s}_{u}^{\leq t} : (1) P(i_{t+1},a_{t+1}\mid\mathbf{s}_{u}^{\leq t},u). Training Tasks. Two distinct training objectives are employed. Next-item prediction. A contrastive InfoNCE loss with negative sampling is utilized for next-item prediction. For the t -th position embedding \mathbf{e}^{\prime}_{t}\in\mathbb{R}^{d} , the ground-truth next-item embedding \mathbf{e}^{(i)}_{\text{pos}} , and K sampled negatives \{\mathbf{e}^{(i)}_{k}\}_{k=1}^{K} , the probability of predicting the correct item is (2) P(i_{\text{pos}}|\mathbf{e}^{\prime}_{t})=\frac{\exp(\mathbf{e}_{t}^{\prime\top}\mathbf{e}^{(i)}_{\text{pos}}/\tau)}{\exp(\mathbf{e}_{t}^{\prime\top}\mathbf{e}^{(i)}_{\text{pos}}/\tau)+\sum_{k=1}^{K}\exp(\mathbf{e}_{t}^{\prime\top}\mathbf{e}^{(i)}_{k}/\tau)}, with temperature \tau>0 . The loss is the negative log-likelihood: \mathcal{L}_{\text{item}}=-\log P(i_{\text{pos}}|\mathbf{e}^{\prime}_{t}). Action prediction (optional). Given \mathbf{e}^{\prime}_{t} and an action vocabulary \mathcal{A} , a softmax classifier is used for action prediction: \hat{\mathbf{y}}^{(a)}_{t}=\mathrm{softmax}(\mathbf{W}_{a}\mathbf{e}^{\prime}_{t}+\mathbf{b}_{a}), where \mathbf{W}_{a}\in\mathbb{R}^{|\mathcal{A}|\times d} , \mathbf{b}_{a}\in\mathbb{R}^{|\mathcal{A}|} . With ground-truth label a_{t}\in\mathcal{A} , the cross-entropy loss is \mathcal{L}_{\text{action}}=-\log\hat{\mathbf{y}}^{(a)}_{t}[a_{t}]. Opportunities : Recent studies show that scaling laws hold w.r.t. user sequence length ( 3 ) and model parameter size ( 20 ) . 2.2. Efficiency Challenge Despite the promise of generative approaches and scaling laws, recommender systems pose unique challenges in real-time responsiveness and computational cost ( 10 ; 13 ; 12 ) . The stringent latency requirements in online scenarios place practical limitations on how large or deep generative models can scale. Consider a decoder-only causal Transformer with depth H , sequence length L , hidden dimension D , and feed-forward network (FFN) expansion r . Ignoring constant factors, the computational cost per layer is \mathcal{O}(L^{2}D)+\mathcal{O}(LD^{2}r) , corresponding to the self-attention and FFN components, respectively. For H layers, the total cost is \mathcal{O}(HL^{2}D)+\mathcal{O}(HLD^{2}r). In recommendation settings, the embedding dimension D is typically small (e.g., 64 ), while the user sequence length L can be large, resulting in the attention term becoming the primary computational bottleneck \text{Cost}\approx\mathcal{O}(HL^{2}D). Challenges : Increasing user sequence length leads to quadratic growth in both training and inference costs. Several studies have highlighted the efficiency bottlenecks of long-sequence modeling in industrial settings. For example, in click-through rate prediction, TwinV2 ( 15 ) from Kuaishou employs hierarchical clustering to generate sequence representatives, while LONGER ( 3 ) from ByteDance introduces a token mixer to fuse neighboring items. In the context of generative recommendation, GenRank ( 7 ) from Xiaohongshu reduces sequence length in HSTU by aggregating each item with its corresponding action rather than compressing user behaviors. More recently, OneRec ( 4 ) from Kuaishou adopted a multi-stage pipeline that combines clustering (as in TwinV2) with Q-Former for historical sequence compression. However, the complexity of this approach, coupled with the absence of open-source implementation, poses significant challenges for reproducibility, comprehensive evaluation, and further development. In this work, we propose a simple yet effective method for user sequence compression that leverages inherent item categorical features. Our approach offers a practical solution for significantly accelerating generative recommender systems. Further, our open-source codebase facilitates reproducibility and enables the research community to easily build upon and extend our work. Table 1 . Main Results. “iLen” and “sLen” represent user item sequence length, and input sequence length

Read the complete text