End-to-End Semantic ID Generation for Generative Advertisement Recommendation DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Information systems Recommender systems Jie Jiang 1∗ , Xinxun Zhang 2∗ , Enming Zhang 1∗ , Yuling Xiong 1∗ , Jun Zhang 1 , Jingwen Wang 1 , Huan Yu 1 , Yuxiang Wang 2 , Hao Wang 2 , Xiao Yan 2 , Jiawei Jiang 2† Abstract . Generative Recommendation (GR) has excelled by framing recommendation as next-token prediction. This paradigm relies on Semantic IDs (SIDs) to tokenize large-scale items into discrete sequences. Existing GR approaches predominantly generate SIDs via Residual Quantization (RQ), where items are encoded into embeddings and then quantized to discrete SIDs. However, this paradigm suffers from inherent limitations: 1) Objective misalignment and semantic degradation stemming from the two-stage compression; 2) Error accumulation inherent in the structure of RQ. To address these limitations, we propose UniSID, a Uni fied SID generation framework for generative advertisement recommendation. Specifically, we jointly optimize embeddings and SIDs in an end-to-end manner from raw advertising data, enabling semantic information to flow directly into the SID space and thus addressing the inherent limitations of the two-stage cascading compression paradigm. To capture fine-grained semantics, a multi-granularity contrastive learning strategy is introduced to align distinct items across SID levels. Finally, a summary-based ad reconstruction mechanism is proposed to encourage SIDs to capture high-level semantic information that is not explicitly present in advertising contexts. Experiments demonstrate that UniSID consistently outperforms state-of-the-art SID generation methods, yielding up to a 4.62% improvement in Hit Rate metrics across downstream advertising scenarios compared to the strongest baseline. * * footnotetext: These authors contributed equally to this work $\dagger$ $\dagger$ footnotetext: Corresponding author 1. Introduction Driven by the huge success of large language models (LLMs) across diverse domains ( 1 ; 23 ; 37 ) , recommender systems have increasingly shifted toward generative modeling ( 14 ; 30 ) . In contrast to conventional deep learning-based recommenders that rely on multi-stage cascades or funnel-style pipelines, generative recommendation (GR) casts recommendation as next-token prediction and directly generates the next item a user is likely to interact with ( 31 ; 35 ; 5 ) . This formulation has demonstrated strong empirical performance in real-world applications, including e-commerce recommendation ( 29 ) , search recommendation ( 26 ) , advertising ( 31 ) , and video recommendation ( 36 ) , thereby providing a unified and scalable approach to sequential user modeling. Semantic IDs (SIDs) are a key enabler of GR, mapping billions of items into compact sequences of discrete tokens ( 8 ) . By compressing the item space while preserving compatibility with next-token prediction, SIDs substantially improve the efficiency and scalability of GR ( 20 ; 13 ) . As shown in Figure 1 (a), most existing SID generation methods adopt a two-stage paradigm built upon Residual Quantization (RQ): items are first encoded into dense embeddings and subsequently discretized into token sequences ( 20 ; 35 ; 31 ; 28 ; 9 ) . For instance, OneRec ( 35 ) leverages RQ-Kmeans ( 16 ) to unify video GR modeling, whereas GPR ( 31 ) utilizes RQ-Kmeans+ for end-to-end optimization in advertising GR. Nevertheless, these approaches still hinge on the two-stage RQ pipeline, in which SID construction is conditioned on pre-trained embeddings rather than being learned end-to-end from raw item features. Consequently, this two-stage cascading compression design ultimately constrains the modeling capacity of GR for three reasons. Figure 1. Two-stage cascaded compression of current methods and unified generation of SID of our method. We highlight three limitations of the prevailing paradigm: ❶ Objective misalignment. Decoupled training objectives across stages induce an inherent optimization mismatch: the embedding-learning stage is trained to produce semantically rich item embeddings, whereas the subsequent SID generation stage is optimized to emit discrete tokens amenable to next-token prediction. This inconsistency precludes end-to-end co-optimization toward a unified objective, yielding suboptimal SID representations. ❷ Semantic degradation. The cascaded pipeline generates SIDs solely from pre-trained embeddings, thus the SID stage cannot directly utilize raw item features (e.g., multimodal/attribute signals) or adapt representations to the discrete code space. This bottleneck can discard critical semantics and degrade SID fidelity. ❸ Error accumulation. RQ-based SID generation hierarchically quantizes item embeddings to approximate fine-grained semantics. However, this hierarchy introduces compounding errors. Quantization noise accumulates across levels, and each level observes only the residual from the previous stage, thereby rendering the available information progressively sparser toward deeper layers. Therefore, SID at later levels tends to be noisier and less reliable. The cumulative effect of these limitations hinders the effectiveness of existing two-stage compression approaches for high-quality SID generation in GR. This naturally raises the following question: Can we design a unified end-to-end SID generation framework that breaks away from the two-stage cascading compression paradigm? Our Solution. Motivated by these observations, we propose UniSID, a Uni fied SID generation framework for generative advertisement recommendation. To address objective misalignment, UniSID replaces the decoupled two-stage pipeline with a single end-to-end training objective that jointly learns SIDs and embeddings directly from raw advertising data. To address semantic degradation, we introduce an advertisement-enhanced input schema that linearizes heterogeneous advertisement signals (e.g., task instructions, images, text, and structured attributes) into a unified token sequence, and then appends learnable SID tokens together with an embedding token. By directly injecting raw multimodal and attribute semantics into the SID space, this design bypasses the pre-trained embedding bottleneck and mitigates semantic loss induced by cascaded compression. To address Error accumulation in hierarchical RQ, UniSID further avoids layer-wise residual compression. Instead, each SID layer is predicted from the same full contextual advertisement, ensuring that all layers access complete advertising information and alleviating progressive information sparsification. Building on this unified pipeline, we introduce two semantics-preserving objectives that further curb semantic degradation and error accumulation while remaining compatible with end-to-end optimization. First, a multi-granularity contrastive learning strategy enforces granularity-specific semantic consistency by constructing SID-level positive pairs, explicitly regularizing each SID layer to be semantically faithful. Second, a summary-based advertisement reconstruction mechanism distills advertisement attributes into high-level semantics and reconstructs them from SIDs, encouraging SIDs to preserve key information that may be implicit in raw advertising contexts and providing an auxiliary supervision signal complementary to the unified objective. We conduct a comprehensive evaluation of UniSID across diverse tasks, including SID quality, next-advertisement prediction, and advertisement retrieval in industrial advertising scenarios, alongside next-item prediction on public benchmarks. Experimental results demonstrate that UniSID consistently outperforms SOTA baselines, achieving maximum improvements of 2.14% on SID quality, 4.01% on next-advertisement prediction, 45.46% on advertisement retrieval, and 11.83% on next-item prediction. Furthermore, ablation studies validate the effectiveness of each proposed component, while the case study highlights UniSID’s capability to capture rich and high-level semantic information within the generated SIDs. The main contributions of this work are as follows: • We identify the limitations of the prevailing two-stage cascading compression paradigm for SID generation, including objective misalignment, semantic degradation, and error accumulation. • We propose UniSID to resolve the above three limitations via three novel designs: end-to-end joint SID-embedding optimization, an advertisement-enhanced input schema, and full-context multi-layer SID prediction, respectively. • We design multi-granularity contrastive learning and a summary-based reconstruction to empower SIDs with different granularities and high-level semantic information. Figure 2. The framework of UniSID 2. Preliminaries Generative Recommendation. GR reformulates the recommendation as a sequence generation problem, where the model directly generates items conditioned on user behavior history, rather than ranking items from a candidate set. Let u denote a user, c denote contextual information, and \mathbf{i}_{1:T}=(i_{1},i_{2},\dots,i_{T}) denote the historical interaction sequence, where i_{t}\in\mathcal{I} is an item from the item space \mathcal{I} . GR models the generative process of user behavior autoregressively: p_{\theta}(\mathbf{i}_{1:T}\mid u,c)=\prod_{t=1}^{T}p_{\theta}(i_{t}\mid\mathbf{i}_{