A Simple Contrastive Framework Of Item Tokenization For Generative Recommendation
Penglong Zhai 1∗ , Yifang Yuan 1∗ , Fanyi Di 1∗ , Jie Li 1, Yue Liu 1 , Chen Li 1 , Jie Huang 1 , Sicong Wang 1 , Yao Xu 1 , Xin Li 1† · 2025
Read A Simple Contrastive Framework Of Item Tokenization For Generative Recommendation by Penglong Zhai 1∗ , Yifang Yuan 1∗ , Fanyi Di 1∗ , Jie Li 1, Yue Liu 1 , Chen Li 1 , Jie Huang 1 , Sicong Wang 1 , Yao Xu 1 , Xin Li 1† (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-16683.txt.
Introduction
Penglong Zhai and co-authors present SimCIT, a contrastive way to tokenize items for generative recommendation in two thousand twenty-five. New recommender systems generate the code of the next item directly, rather than ranking a list. Raw ID codes are vast and redundant at scale, so items are often squeezed into semantic tokens.
Older squeezers rebuild each item's embedding as exactly as they can, one by one. That goal clashes with telling items apart, which is what retrieval needs. Items also carry rich side data, such as text, images, and place. SimCIT learns its tokens by contrast alone, pulling matched views together and pushing others apart, with no rebuild step.
Catalog record
| CREATOR | Penglong Zhai 1∗ , Yifang Yuan 1∗ , Fanyi Di 1∗ , Jie Li 1, Yue Liu 1 , Chen Li 1 , Jie Huang 1 , Sicong Wang 1 , Yao Xu 1 , Xin Li 1† |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-16683
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Simple Contrastive Framework Of Item Tokenization For Generative Recommendation Penglong Zhai 1∗ , Yifang Yuan 1∗ , Fanyi Di 1∗ , Jie Li 1, Yue Liu 1 , Chen Li 1 , Jie Huang 1 , Sicong Wang 1 , Yao Xu 1 , Xin Li 1† Abstract Generative retrieval-based recommendation has emerged as a promising paradigm aiming at directly generating the identifiers of the target candidates. However, in large-scale recommendation systems, this approach becomes increasingly cumbersome due to the redundancy and sheer scale of the token space. To overcome these limitations, recent research has explored the use of semantic tokens as an alternative to ID tokens, which typically leveraged reconstruction-based strategies, like RQ-VAE, to quantize content embeddings and significantly reduce the embedding size. However, reconstructive quantization aims for the precise reconstruction of each item embedding independently, which conflicts with the goal of generative retrieval tasks focusing more on differentiating among items. Moreover, multi-modal side information of items, such as descriptive text and images, geographical knowledge in location-based recommendation services, has been shown to be effective in improving recommendations by providing richer contexts for interactions. Nevertheless, effectively integrating such complementary knowledge into existing generative recommendation frameworks remains challenging. To overcome these challenges, we propose a novel unsupervised deep quantization exclusively based on contrastive learning, named SimCIT (a Simple Contrastive Item Tokenization framework). Specifically, different from existing reconstruction-based strategies, SimCIT propose to use a learnable residual quantization module to align with the signals from different modalities of the items, which combines multi-modal knowledge alignment and semantic tokenization in a mutually beneficial contrastive learning framework. Extensive experiments across public datasets and a large-scale industrial dataset from various domains demonstrate SimCIT’s effectiveness in LLM-based generative recommendation. † † ————————- † † ∗ Equal contribution. † † † Corresponding author. I Introduction In the rapidly evolving landscape of digital services, recommendation systems have become pivotal in shaping content consumption habits [ 1 , 2 ] . With the recent success of generative AI techniques, generative retrieval has emerged as a new retrieval paradigm for recommendation, redefining item retrieval as a sequence generation problem [ 3 , 4 , 5 , 6 , 7 ] . TIGER [ 7 ] was the first to exemplify this approach with its two-stage model: semantic tokenization and autoregressive generation. As illustrated in Fig. 1 , in the tokenization, the model maps each item to a sequence of discrete semantic tokens or IDs, aiming to capture item multi-modal content semantics within these tokens. This ensures that semantically similar items are assigned similar tokens. In the generation stage, an sequence-to-sequence architecture is usually employed to encode historical token sequences and decode target item tokens autoregressively. During inference, the model leverages beam search coupled with token-to-item mapping to directly output top- k candidate item IDs. This capability enables generative recommendation frameworks to achieve granular token-level user-item alignment while bypassing conventional non-differentiable ANN retrieval modules. Fig. 1: Illustration of the proposed SimCIT. We translate items from different domains and modalities into a new unified semantic ID, which can then serve as a bridge for transferring retrieval knowledge. In this process, item tokenization [ 8 , 9 , 7 , 10 , 11 ] acts as a key first step for training generative recommendation models. It simplifies the task by shrinking the vocabulary from millions of item IDs to just thousands of tokens, allowing faster decoding without requiring ANN search. To obtain high-quality semantic tokens, existing approaches typically utilize item textual descriptions paired with pretrained language models to generate semantic embeddings. These embeddings are then discretized into tokens through techniques like vector quantization [ 9 , 7 , 8 ] or hierarchical k-means clustering [ 10 , 12 , 11 ] , corresponding to specific codes or clusters. Among these techniques, RQ-VAE emerges as the predominant method for semantic tokenization, with its initially established through TIGER. These VAE-based methods [ 7 , 13 , 14 ] usually employ a residual quantization-based autoencoder to encode item’s textual embeddings into hierarchical code sequences as identifiers, optimized through a reconstruction loss. Reconstructive quantization aims for the precise reconstruction of each item embedding independently, which fundamentally conflicts with the nature of generative retrieval tasks aimed to identify the target items from the vocabulary. This can lead to a suboptimal distribution of the learned semantic token space when applied to generative retrieval models. One example is that the common long-tail distribution observed in real-world item populations. Within high-frequency clusters, representation collapse leads the model to generate ambiguous token sequences for items with semantic proximity. This phenomenon highlights the need to capture latent topological relationships between items – an essential capability for maintaining recommendation systems’ differentiation efficacy. On the other hand, with the recent popularity of multimedia-centric scenarios like social media and micro-video websites, multi-modal recommendation systems are gaining widespread attention and adoption. The information from different modalities characterizes diverse relationships among items. These modalities play a vital role in modeling item-item relationships and enhancing recommendation performance, especially for cold-start items. For example, in POI (Point-of-Interest) recommendation tasks, spatial relationships and geographical knowledge have widely been proven critical for capturing intrinsic patterns of user mobility [ 15 , 16 ] . These spatial dependencies, including proximity relationships and mobility patterns, are essential for accurate prediction but are often underutilized or oversimplified in previous methods of item tokenization. Contemporary fusion paradigms employing primitive integration mechanisms (e.g. input-layer concatenation or prediction-stage score aggregation) fundamentally fail to capture the intricate interplay between multi-modal signals and their hierarchical semantic dependencies required for effective discriminative embedding learning. Such deficiencies critically impede industrial deployment where strict engineering constraints – particularly the competing demands of latency optimization, memory efficiency, and throughput maximization – exert measurable impacts on contractual service benchmarks and core business objectives. To overcome the above limitations, we’ve introduced SimCIT, a scalable simple contrastive item tokenization framework that significantly boosts generative recommendation performance through the use of generated item identifier tokens which achieved by leveraging multi-modal information and contrastive learning. Unlike conventional VAE-based methods, SimCIT’s framework eliminates the need for reconstruction loss, relying solely on contrastive learning. This approach not only preserves items’ multi-modal features, such as text and image information, but also enhances the discrimination between different item tokens. Specifically, SimCIT employs a novel contrastive learning framework, treating multi-modal content of items (e.g. visual images and textual descriptions) as different “views”. It then applies a series of contrastive losses upon a soft residual quantization with these views to facilitate the fusion and alignment of identifiers. In this way, SimCIT implicitly aligns multi-modal features indirectly with an identifier. In other words, the identifier acts as a “bridge” between modalities. In summary, our contributions are highlighted as follows: • We propose, for the first time, a fully contrastive learning-based item tokenization framework for generative recommendation, named SimCIT, which is novel, simple, and scalable. Compared to previous reconstruction-based techniques, the proposed method achieves significant improvements in terms of discriminative capability and alleviating collision. • Building upon this scalable framework, we introduce a hierarchical identifier learning paradigm that systematically integrates heterogeneous item-side data modalities—spanning textual/image descriptions, collaborative filtering signals, and spatial graph (in POI recommendation tasks)—thereby extending the empirically validated feature integration strategies of conventional recommender