Efficient Generative Retrieval for E-commerce Search with Semantic Cluster IDs and Expert-Guided RL DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Information systems Information retrieval CCS: Information systems Retrieval models and ranking

Jianbo Zhu, Xing Fang, Jing Wang, Mingmin Jin, Bokang Wang, Guangxin Song, Zhenyu Xie, Junjie Bai · 2026

Read Efficient Generative Retrieval for E-commerce Search with Semantic Cluster IDs and Expert-Guided RL DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Information systems Information retrieval CCS: Information systems Retrieval models and ranking by Jianbo Zhu, Xing Fang, Jing Wang, Mingmin Jin, Bokang Wang, Guangxin Song, Zhenyu Xie, Junjie Bai (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-14434.txt.

Introduction

In 2026, Zhu and colleagues propose generative retrieval for e-commerce search as a recall-stage supplement, not an end-to-end replacement. Their CQ-SID method encodes items into hierarchical semantic cluster identifiers, cutting beam search complexity. EG-GRPO, an expert-guided method, aligns generative recall with downstream ranking under sparse rewards. Offline TmallAPP tests show semantic click hitrate gains up to 26.76 percent over baselines, while halving beam search size. Online tests confirm merchandise-value and conversion gains. The channel now drives most exposures and nearly three quarters of purchases.

Catalog record

CREATORJianbo Zhu, Xing Fang, Jing Wang, Mingmin Jin, Bokang Wang, Guangxin Song, Zhenyu Xie, Junjie Bai
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35479
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.14434

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Efficient Generative Retrieval for E-commerce Search with Semantic Cluster IDs and Expert-Guided RL DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Information systems Information retrieval CCS: Information systems Retrieval models and ranking Jianbo Zhu, Xing Fang, Jing Wang, Mingmin Jin, Bokang Wang, Guangxin Song, Zhenyu Xie, Junjie Bai Abstract . Generative retrieval has emerged as a promising paradigm that unifies the traditionally fragmented multi-stage retrieval process into a single end-to-end neural model. Despite its theoretical appeal, practical deployment in industrial e-commerce search remains challenging due to massive and frequently updated item corpora, stringent latency constraints, and the necessity of aligning retrieval outputs with downstream ranking objectives. In this work, we propose a retrieval framework tailored for real-world recall scenarios, positioning generative retrieval as a recall-stage supplement rather than an end-to-end replacement. Our approach, CQ-SID (Category-and-Query constrained Semantic ID), builds upon Residual Quantized Variational Autoencoders (RQ-VAE) to encode items into hierarchical semantic clusters instead of unique discrete identifiers, substantially reducing the computational burden of beam search. To effectively map user queries to these semantic IDs, we introduce a progressive training strategy that systematically refines the translation from natural language queries to structured SID representations through four stages: item-to-SID, query-to-SID, personalized user-query-to-SID, and ranking-aligned refinement. Furthermore, we develop EG-GRPO (Expert-Guided Group Relative Policy Optimization), a reinforcement learning method that aligns generative recall with downstream ranking signals under sparse reward conditions. By injecting ground-truth samples into the policy gradient group, EG-GRPO stabilizes learning and prevents the click-exposure trade-off collapse observed in standard GRPO. Offline experiments on real search logs from a mobile e-commerce TmallAPP platform demonstrate that CQ-SID achieves up to 26.76%/11.11% relative improvement in semantic/personalized click hitrate over the standard RQ-VAE baseline, while reducing beam search size by more than half without compromising recall quality. EG-GRPO further enhances performance across both click and exposure metrics in multi-objective optimization. Online A/B tests confirm significant gains in key business indicators, including GMV (+1.15%) and UCTCVR (+0.40%). Moreover, the proposed generative recall channel has become a critical contributor in the production environment, accounting for 50.25% of all exposures, 58.96% of all clicks, and 72.63% of all purchases. This work offers practical insights and a viable path toward bridging the gap between generative retrieval research and real-world, large-scale e-commerce applications. 1. Introduction The architecture of modern e-commerce search engines typically follows a multi-stage funnel paradigm, comprising query understanding, recall, coarse ranking, fine ranking, and re-ranking stages. In this pipeline, the recall stage is responsible for efficiently retrieving a candidate set of potentially relevant items from a corpus of hundreds of millions of products. Traditional recall methods rely on sparse retrieval (e.g., BM25, inverted indices) and dense retrieval (e.g., approximate nearest neighbor search over embedding spaces), which achieve considerable success yet suffer from inherent limitations: sparse methods struggle with semantic matching, while dense methods require expensive index maintenance and suffer from the embedding gap between training and inference distributions. Recently, generative retrieval has attracted significant attention as a new paradigm that replaces traditional index-then-retrieve architectures with a single differentiable model ( 17 ; 19 ; 1 ) . In this paradigm, a sequence-to-sequence model directly generates document or item identifiers given a query, effectively collapsing indexing and retrieval into a unified generative process. The seminal work by Tay et al. ( 17 ) introduced the Differentiable Search Index (DSI), which demonstrated that transformer models could memorize and retrieve document identifiers with surprising efficacy. Subsequent works such as NCI ( 19 ) , SEAL ( 1 ) , and TIGER ( 13 ) have extended this paradigm to various domains and identifier designs. Despite academic progress, deploying generative retrieval in industrial e-commerce search entails unique challenges that remain under-explored: Challenge 1: End-to-end feasibility at scale. Prior industrial approaches such as the Kuaishou OneModel series ( 5 ; 2 ) advocate end-to-end generation that bypasses the multi-stage funnel entirely. While this is viable in recommendation scenarios where exploration and diversity are inherently valued, search demands high precision and relevance. Generating directly from a corpus of hundreds of millions of items raises serious concerns about coverage, latency, and the “Matthew effect” (over-concentration on popular items). Challenge 2: Semantic ID design trade-offs. Existing methods typically pursue a one-item-one-ID mapping to minimize collision rates ( 17 ; 13 ) . Yet in industrial settings, overly fine-grained identifiers require substantially more training data and longer convergence times. During inference, achieving sufficient recall breadth necessitates large beam sizes, creating latency and resource bottlenecks that are incompatible with production constraints. Challenge 3: Alignment with downstream ranking. Recall models have traditionally been trained to optimize click-through signals via maximum likelihood estimation. However, a good recall model should not only retrieve clicked items but also expose high-quality items that downstream ranking can leverage. Bridging the optimization gap between recall and ranking remains an open problem. To address these challenges, we position generative retrieval as a recall-stage supplement rather than an end-to-end replacement. Our key contributions are: • We propose CQ-SID , a Category-and-Query constrained Semantic ID constructed via RQ-VAE with category-aware residual quantization and Query-Item contrastive learning. Unlike prior work that pursues unique IDs, CQ-SID treats each ID as a semantic cluster identifier, balancing discriminability with aggregation. • We design a progressive training pipeline that gradually builds query-to-SID mapping capabilities through supervised fine-tuning on item titles, query-item associations, and user personalization features, using a lightweight Qwen2.5-0.5B backbone. • We introduce EG-GRPO , an Expert-Guided Group Relative Policy Optimization method that aligns generative recall with downstream ranking signals. By injecting ground-truth samples into the policy gradient group, EG-GRPO stabilizes learning in sparse-reward environments and improves both hitrate and pvr. • We present extensive offline experiments and large-scale online A/B tests on a major mobile e-commerce platform, demonstrating that the proposed framework achieves superior recall quality with reduced computational cost and significant business metric improvements. 2. Related Work 2.1. Generative Retrieval The field of generative information retrieval has evolved rapidly since the introduction of DSI by Tay et al. ( 17 ) , which proposed to train a single transformer model to map queries directly to document identifiers, effectively replacing the traditional indexing-retrieval pipeline. Sun et al. ( 16 ) investigated learned tokenization schemes for generative retrieval, while Li et al. ( 8 ) and Kuo et al. ( 7 ) provided comprehensive surveys of the rapidly expanding GenIR landscape. Recent work has also explored the relationship between generative retrieval and multi-vector dense retrieval ( 21 ) , revealing theoretical connections between these seemingly disparate paradigms. The application of generative retrieval to e-commerce search and recommendation has gained substantial industrial interest. Kuaishou’s OneModel frameworks ( 5 ; 2 ) represent ambitious attempts to unify the entire search and recommendation pipeline under a single generative model. Beyond end-to-end unification, recent work has also examined the integration of generative retrieval with structured taxonomies in e-commerce. Yang et al. ( 23 ) proposed GSID, a generative semantic indexing framework that leverages product attribute hierarchies to guide identifier learning for e-commerce product understanding. Meanwhile, Liu et al. ( 9 ) introduced CAT-ID 2 , which explicitly encodes category trees into document identifiers to improve semantic structure and

Read the complete text