Closing the Performance Gap in Generative Recommenders with Collaborative Tokenization and Efficient Modeling CCS: Computing methodologies Artificial intelligence CCS: Information systems Recommender systems
Simon Lepage, Jeremie Mary, David Picard · 2025
Read Closing the Performance Gap in Generative Recommenders with Collaborative Tokenization and Efficient Modeling CCS: Computing methodologies Artificial intelligence CCS: Information systems Recommender systems by Simon Lepage, Jeremie Mary, David Picard (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-14910.txt.
Introduction
Lepage, Mary, and Picard ask why generative recommender systems, which phrase suggestions as generation over item tokens, still trail classic ID-based models. They blame two weak points. First, tokens standing for items carry no signal about which items people enjoy together. Second, the standard encoder-decoder design is wasteful. Their fixes are COSETTE, a tokenization method baking shared taste patterns into the item codes, and MARIUS, a leaner generative model. MARIUS borrows from audio work and separates timeline modeling from item decoding.
On standard sequential recommendation benchmarks, the pair closes most of the gap with strong ID-based baselines; it sometimes erases it. Inference gets cheaper under the new architecture. The authors frame the result as evidence generative recommenders were held back by fixable design choices, not by the idea. For platform teams, the paper offers upgrades that keep the flexibility of generation.
Catalog record
| CREATOR | Simon Lepage, Jeremie Mary, David Picard |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-14910
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Closing the Performance Gap in Generative Recommenders with Collaborative Tokenization and Efficient Modeling CCS: Computing methodologies Artificial intelligence CCS: Information systems Recommender systems Simon Lepage, Jeremie Mary, David Picard Abstract . Recent work has explored generative recommender systems as an alternative to traditional ID-based models, reframing item recommendation as a sequence generation task over discrete item tokens. While promising, such methods often underperform in practice compared to well-tuned ID-based baselines like SASRec. In this paper, we identify two key limitations holding back generative approaches: the lack of collaborative signal in item tokenization, and inefficiencies in the commonly used encoder-decoder architecture. To address these issues, we introduce COSETTE, a contrastive tokenization method that integrates collaborative information directly into the learned item representations, jointly optimizing for both content reconstruction and recommendation relevance. Additionally, we propose MARIUS, a lightweight, audio-inspired generative model that decouples timeline modeling from item decoding. MARIUS reduces inference cost while improving recommendation accuracy. Experiments on standard sequential recommendation benchmarks show that our approach narrows, or even eliminates, the performance gap between generative and modern ID-based models, while retaining the benefits of the generative paradigm. 1. Introduction Generative recommender systems have recently emerged as a promising alternative to traditional ID-based methods for sequential recommendation. Rather than ranking items based on similarity scores, generative approaches reframe item retrieval as a sequence generation task ( rajput2023recommender ) . In this paradigm, each item is tokenized into a semantic identifier, typically a tuple of discrete tokens, and the model autoregressively generates the identifier of the next item in the sequence. This formulation offers several advantages: it enables token-level alignment between user history and candidate items, leads to better generalization thanks to the Semantic IDs ( singh24better ) , removes the reliance on non-differentiable approximate nearest neighbor (ANN) modules, and eliminates large embedding tables that increasingly hinder the scalability of traditional systems ( liu2024embedding ; zhai2024Action ) . However, practical experience in industry suggests that well-tuned ID-based methods like SASRec ( kang2018self ) with simple modifications ( TIGERReviews ) can significantly outperform the results typically reported in the literature. We identify two key limitations that contribute to the performance gap: (1) the lack of collaborative signal during the item tokenization process, and (2) inefficiencies in the architecture of current generative models. The first issue arises because generative recommenders typically rely on residual vector quantization ( zeghidour2021soundstream ) trained to reconstruct frozen item embeddings derived from content (e.g., textual metadata) ( rajput2023recommender ; zhai2025multimodal ; zheng2024adapting ) . However, this objective is misaligned with the downstream goal of recommendation, which requires distinguishing between items based on collaborative signals rather than reconstructing their content. While some work explores contrastive objectives ( zhu2024cost ) , they often remain anchored to fixed, non-collaborative embeddings. Others incorporate collaborative information by leveraging pretrained SASRec embeddings ( wang2024learnable ) , but this introduces an additional pre-training phase. To address this, we propose COSETTE ( CO llaborative and SE mantic T okenization of T ext E mbeddings), a novel tokenization approach that directly integrates collaborative signals into the quantization process via a latent contrastive loss. The second limitation lies in the architecture of current generative models. Many recent systems adopt an encoder-decoder structure inspired by TIGER ( rajput2023recommender ) , where the semantic identifiers are concatenated before being fed to a bidirectional encoder, and decoded autoregressively ( wang2024learnable ; zhai2025multimodal ; zhu2024cost ) . This design suffers from significant inefficiencies such as long input sequences and the absence of causal structure in the encoder preventing KV-Caching. It also suffers from high computational cost in the decoder due to cross-attention over the entire input, a limitation that is particularly costly during top- K generation, where the decoder must be queried repeatedly to generate new items. We address these bottlenecks with MARIUS ( M ulti-scale A ttention as R ecommendation I ndex with f US ion), an architecture inspired by the RQ-Transformer ( lee2022autoregressive ) used in audio modeling ( yang2023uniaudio ; kyutai2024moshi ; zhu2024generative ) . MARIUS separates temporal and local modeling into dedicated components, enabling efficient item generation while improving recommendation accuracy. This decoupled design facilitates caching, reduces inference latency, and improves scalability. The goal of this paper is to close the gap between generative and ID-based recommender systems. We are able to achieve such a goal with the following contributions: • We introduce and evaluate a modernized SASRec variant on standard benchmarks, to establish a very strong baseline. • We present COSETTE, a contrastive tokenization method that embeds collaborative signals directly into discrete semantic representations. • We take inspiration from the audio modeling community and propose MARIUS, which decouples temporal modeling and item decoding for improved efficiency and accuracy. 2. Related Work Sequential Recommendation. Recommender systems are fundamental components of online platforms, designed to provide personalized content to individual users. Sequential recommendation, in particular, aims to model a user’s evolving preferences by leveraging their historical interaction data to predict the next item of interest ( He2023Survey ; deldjoo2024review ) . Early approaches in this domain relied on Markov chains and matrix factorization techniques to capture user behavior ( He2016Fast ) . With the advent of deep learning, more sophisticated models have emerged, utilizing architectures such as Convolutional Neural Networks ( Tang2018Personalized ) , Graph Neural Networks ( wu2019session ) , and Recurrent Neural Networks ( hidasi2015session ) . Among these, Transformer-based models ( vaswani2017attention ) have demonstrated notable performance gains, employing either causal ( kang2018self ) or masked ( Sun2019BERT4REC ) sequence modeling strategies. The majority of these methods adopt a retrieve-then-rank paradigm, wherein each item is represented by a learned embedding, enabling efficient Approximate Nearest Neighbor (ANN) search during inference (e.g., using FAISS ( johnson2019billion ) or a vector Database). The deployment of sequential recommendation systems on real-world data necessitates their scalability to large item catalogs, motivating their study through the lens of scaling laws ( kaplan2020scaling ) . Recent studies, such as ( shen2024optimizing ) and ( zhang2024scaling ) , report promising results for attention-based architectures akin to SASRec. However, scaling these models introduces significant computational challenges, as the embedding table grows linearly with the number of items, adversely affecting both training and inference efficiency. Addressing this limitation through techniques such as sharding strategies, architectural innovations, and specialized optimizers remains an active and critical area of research ( liu2024embedding ; shen2024optimizing ; zhai2024Action ) . Generative Recommender Systems. Generative retrieval ( Tay2022Transformer ) has emerged as a promising paradigm for information retrieval, wherein models are trained end-to-end to directly generate item identifiers. This approach eliminates the need for large item embedding tables and non-differentiable ANN systems, enabling the modeling of more complex similarity functions beyond the limitations of dot-product-based retrieval. In the context of recommendation, two main approaches have been explored. The first leverages pre-trained Large Language Models (LLMs), capitalizing on their general knowledge, multitasking capabilities, and ability to engage in natural language interactions ( Zhao2024Recommender ; Wu2024Survey ) . A central challenge in this setting is extending the LLM’s vocabulary to include item identifiers without compromising its core capabilities, typically addressed through multi-task prompt-based fine-tuning ( Geng2022Recommendation ; zheng2024adapting ) . The second approach involves training dedicated sequence-to-sequence models. For instance, TIGER ( rajput2023recommender ) demonstrates strong performance