SIDE: Semantic ID Embedding for effective learning from sequences Conference: AdKDD 2025; August 04; 2025 10
Dinesh Ramasamy, Shakti Kumar, Chris Cadonic, Jiaxin Yang, Sohini Roychowdhury, Esam Abdel Rhman, Srihari Reddy · 2025
Read SIDE: Semantic ID Embedding for effective learning from sequences Conference: AdKDD 2025; August 04; 2025 10 by Dinesh Ramasamy, Shakti Kumar, Chris Cadonic, Jiaxin Yang, Sohini Roychowdhury, Esam Abdel Rhman, Srihari Reddy (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-16698.txt.
Introduction
Dinesh Ramasamy and co-authors present, in a 2025 industry paper, a compact way to feed user history into ad recommendation models that must answer in real time. Such models read thousands of past events per user, and storing a rich vector for each event is too costly at that scale. Their fix compresses each item into a short semantic code.
Three new parts drive the gain. A multi-task coder fuses several content vectors and class guesses into one code. A parameter-free step turns codes back into vectors at fine grain. A new rounding method sharpens the codes further. On a large live ads system, quality gains more than doubled while the data footprint fell threefold.
Catalog record
| CREATOR | Dinesh Ramasamy, Shakti Kumar, Chris Cadonic, Jiaxin Yang, Sohini Roychowdhury, Esam Abdel Rhman, Srihari Reddy |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-16698
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SIDE: Semantic ID Embedding for effective learning from sequences Conference: AdKDD 2025; August 04; 2025 10 Dinesh Ramasamy, Shakti Kumar, Chris Cadonic, Jiaxin Yang, Sohini Roychowdhury, Esam Abdel Rhman, Srihari Reddy Abstract . Sequence-based recommendations models are driving the state-of-the-art for industrial ad-recommendation systems. Such systems typically deal with user histories or sequence lengths ranging in the order of O( 10 3 10^{3} ) to O( 10 4 10^{4} ) events. While adding embeddings at this scale is manageable in pre-trained models, incorporating them into real-time prediction models is challenging due to both storage and inference costs. To address this scaling challenge, we propose a novel approach that leverages vector quantization (VQ) to inject a compact Semantic ID (SID) as input to the recommendation models instead of a collection of embeddings. Our method builds on recent works of SIDs by introducing three key innovations: (i) a multi-task VQ-VAE framework, called VQ fusion that fuses multiple content embeddings and categorical predictions into a single Semantic ID; (ii) a parameter-free, highly granular SID-to-embedding conversion technique, called SIDE , that is validated with two content embedding collections, thereby eliminating the need for a large parameterized lookup table; and (iii) a novel quantization method called Discrete-PCA (DPCA) which generalizes and enhances residual quantization techniques. The proposed enhancements when applied to a large-scale industrial ads-recommendation system achieves 2.4 × 2.4\times improvement in normalized entropy (NE) gain and 3 × 3\times reduction in data footprint compared to traditional SID methods. 1. Introduction Industrial ads-ranking systems incorporate diverse signals from multiple sources to accurately predict user-engagement towards specific content. Traditionally, these systems have relied on aggregation based signals, which summarize user behavior and ad-attributes into coarse grained features. However, this approach has limitations, as it fails to capture the nuances of user interactions over time. Recent works such as in ( Hou et al. 2024 ) - ( Pi et al. 2020 ) demonstrate the importance of long sequence user behavior for improvement in click-through-rate (CTR) prediction by leveraging O( 10^{3} ) to O( 10^{4} ) events. In such systems, there is a need to enrich user-engagement signals / events for improved prediction using content engagement signals, which typically are in the form of embeddings. In this work, we address two major challenges while using quantized SIDs to enhance user-ad engagement predictions: (1) How can we perform VQ efficiently when we have a plethora of content signals (embeddings and categorical predictions) as is the case in industrial ads-ranking systems, and (2) How can we structure VQ outputs to utilize them efficiently along with improved ranking performance of downstream models? To address these questions, we propose a novel multi-input vector-quantized variational auto-encoder (VQ-VAE) (called VQ fusion ), as shown in Figure 1 , which addresses the gap in existing SID approaches that require large volumes of data to relearn embeddings for different SID n -grams or tokens . The proposed VQ fusion method consists of an encoder-network that takes different content signals as input and produces a shared latent representation that is quantized and passed through a pseudo-symmetric decoder network; thereby enabling reconstruction of the different content signals. Thus, the proposed structured code-books avoid relearning the ID-to-codeword mappings and significantly reduce the number of parameters and memory required in ads-ranking. Figure 1. The proposed fusion VQ-VAE setup (encoder portion). An unmixing decoder architecture (symmetric to mixing) is used to train the encoder. This paper makes three major contributions. First, we propose a novel vector quantization method based on Residual Quantization called Discrete PCA (DPCA). Second, we detail a method for fusing multiple embedding and categorical signals into a single Semantic ID which we call VQ-fusion, thus drastically reducing the data storage cost. Third, we introduce a new usage of Finite Scalar Quantization (FSQ ( Mentzer et al. 2023 ) ) and the newly proposed DPCA methods to improve ranking outcomes using the so-called SIDE property, which stands for the ability to convert SIDs to latent embeddings in an embedding table free fashion. We demonstrate significant gains in ranking metrics (at least 2.4\times gain in normalized entropy) and the total return on investment (at least 7.4\times RoI) compared to existing approaches in an industrial ads-ranking setting. 2. Related Work Scalar quantization ( Mentzer et al. 2023 ) traditionally involves quantizing each dimension of a vector independently using a scalar codebook, which can be static (examples are int4 and float16 quantization which use 4 and 16 bits per dimension, respectively). A class of compression techniques involves finding a mapping to a lower dimensional subspace so that “most” of the information content in the embedding is preserved and the PCA method identifies the optimal linear mapping when the loss is euclidean. Vector quantization (VQ) started off with the now ubiquitous k-means clustering algorithm that can be extended in two orthogonal ways: (i) Residual k-means clustering which involves clustering the residuals to create a hierarchy of codewords and (ii) Product Quantization ( Jégou et al. 2011 ) , which involves using parallel k-means algorithms on a subset of dimensions and is considered as a hybrid between scalar and vector quantization algorithms. Another clustering technique is called Iterative-Quantization (ITQ, ( Gong et al. 2013 ) ). This involves using a linear transformation to map embeddings into the latent space where they are quantized using a binary \{-1,1\} codebook. Since the transformations are done in parallel (matrix multiplication), we classify this as a form of product quantization clubbed with auto-encoder methods. A similar auto-encoder with scalar (binary) quantization setup called Lookup-Free Quantizer (LFQ, ( et. al. 2024b ) ) was used recently for video generation. Others have proposed Finite Scalar Quantization (FSQ, ( Mentzer et al. 2023 ) ) which extends LFQ by allowing for more buckets per dimension. One can combine VQ based methods (e.g., k-means) with auto-encoder setup as presented in the paper on RQ-VAE ( Lee et al. 2022 ) that improves RQ’s ability to learn hierarchical structure by adding structured quantizer dropout, as is shown in the proposed work. Recently there has been lot of interest in extreme scalar quantization for LLMs like 1.58-bit LLM ( Ma et al. 2024 ) . We draw inspiration from this work and use a ternary \{-1,0,1\} scalar codebok as a universal codebook for our proposed DPCA method. In terms of applications of VQ-techniques to ad-ranking systems like those presented in ( et. al. 2019 ) , the recent work on using RQ for defining SIDs ( et. al. 2024a ) and the work on generative retrieval ( Rajput et al. 2023 ) stand out. Both these papers use n -grams of RQ codewords as SIDs and utilize these SIDs as categorical features, thereby relying largely on embedding tables. We use this approach and more traditional k -means as baselines in our experiments. 3. Vector Quantization Method In this section, we define our proposed method Discrete-PCA , and expand on the techniques to combine multiple embeddings and categorical signals into one-feature via our proposed VQ-fusion method. Next, we demonstrate our embedding table-free technique called SIDE to convert codewords to embeddings in ads-ranking models. The base concept of residual quantization (RQ) ( et. al. 2024a ) involves the use of D independent codebooks that are