Mitigating Collaborative Semantic ID Staleness in Generative Retrieval Conference: Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 20–24, 2026; Melbourne, VIC, Australia. Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’26), July 20–24, 2026, Melbourne, VIC, Australia ISBN: 979-8-4007-2599-9/2026/07 DOI: 10.1145/3805712.3809877 CCS: Information systems Recommender systems CCS: Information systems Retrieval models and ranking

Vladimir Baikalov, Iskander Bagautdinov, Sergey Muravyov · 2026

Read Mitigating Collaborative Semantic ID Staleness in Generative Retrieval Conference: Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 20–24, 2026; Melbourne, VIC, Australia. Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’26), July 20–24, 2026, Melbourne, VIC, Australia ISBN: 979-8-4007-2599-9/2026/07 DOI: 10.1145/3805712.3809877 CCS: Information systems Recommender systems CCS: Information systems Retrieval models and ranking by Vladimir Baikalov, Iskander Bagautdinov, Sergey Muravyov (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-13273.txt.

Introduction

Baikalov, Bagautdinov, and Muravyov tackle semantic ID staleness in generative search, where usage-based identifiers drift from recent user behavior. Prior work either freezes the ID vocabulary or rebuilds it entirely with retraining, but time drift is rarely studied. Their lightweight model-free matching update maps new identifiers onto the existing set, keeping the checkpoint usable for warm-start tuning. Across three tests it lifts recall and ranking at high ranks over naive tuning with stale IDs. It cuts training compute by about 8 to 9 times over full rebuilds.

Catalog record

CREATORVladimir Baikalov, Iskander Bagautdinov, Sergey Muravyov
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28586
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.13273

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Mitigating Collaborative Semantic ID Staleness in Generative Retrieval Conference: Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 20–24, 2026; Melbourne, VIC, Australia. Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’26), July 20–24, 2026, Melbourne, VIC, Australia ISBN: 979-8-4007-2599-9/2026/07 DOI: 10.1145/3805712.3809877 CCS: Information systems Recommender systems CCS: Information systems Retrieval models and ranking Vladimir Baikalov, Iskander Bagautdinov, Sergey Muravyov Abstract . Generative retrieval with Semantic IDs (SIDs) assigns each item a discrete identifier and treats retrieval as a sequence generation problem rather than a nearest-neighbor search. While content-only SIDs are stable, they do not take into account user-item interaction patterns, so recent systems construct interaction-informed SIDs. However, as interaction patterns drift over time, these identifiers become stale, i.e., their collaborative semantics no longer match recent logs. Prior work typically assumes a fixed SID vocabulary during fine-tuning, or treats SID refresh as a full rebuild that requires retraining. However, SID staleness under temporal drift is rarely analyzed explicitly. To bridge this gap, we study SID staleness under strict chronological evaluation and propose a lightweight, model-agnostic SID alignment update. Given refreshed SIDs derived from recent logs, we align them to the existing SID vocabulary so the retriever checkpoint remains compatible, enabling standard warm-start fine-tuning without a full rebuild-and-retrain pipeline. Across three public benchmarks, our update consistently improves Recall@K and nDCG@K at high cutoffs over naive fine-tuning with stale SIDs and reduces retriever-training compute by approximately 8–9 times compared to full retraining. † † cc-license: by 1. Introduction Large-scale recommender and search systems rely on retrieval to select a small candidate set from massive catalogs ( 3 ; 2 ; 1 ) . Generative retrieval with Semantic IDs (SIDs) offers an alternative to embedding-based retrieval. Instead of retrieving items via vector similarity, each item is assigned a short token sequence, which the model generates from the user context ( 18 ) . A key design choice is how to construct SIDs. Content-only SIDs (derived from metadata or multimodal features) are stable and effective in cold-start scenarios ( 20 ) , but can miss behavioral structure captured in interaction logs ( 26 ) . Recent systems therefore build interaction-informed SIDs, often improving retrieval quality ( 7 ; 5 ) . In practical settings, collaborative patterns are non-stationary: user interests, item popularity, and logging policies evolve over time, motivating periodic SID refreshes to capture the latest collaborative structure. Yet refreshing SIDs introduces a challenge: new token assignments may become incompatible with the retriever’s previously learned output space. Despite its practical relevance, this issue has received limited attention in prior works. As a result, practitioners typically face a trade-off: (i) keep SIDs fixed and finetune on new logs, accumulating SID–behavior mismatch, or (ii) refresh SIDs and retrain from scratch at high compute cost ( 7 ; 5 ) . However, SID staleness under temporal drift has not been systematically quantified. To bridge this gap, we quantify interaction-informed SID staleness under strict chronological evaluation and propose a lightweight, model-agnostic alignment update that keeps refreshed identifiers checkpoint-compatible. Our contributions are: • We quantify the degradation caused by stale interaction-informed SIDs under temporal drift. • We propose a lightweight, model-agnostic SID alignment update that enables warm-start finetuning with refreshed identifiers. • On three public temporal benchmarks, we show that alignment improves over stale-SID finetuning and is competitive with full retraining while reducing retriever training compute by up to 8–9 times. 2. Related Work Generative Retrieval. Generative retrieval frames candidate generation as sequence modeling, where a model directly decodes item identifiers ( 4 ; 24 ; 12 ) . A prominent line of work trains generative retrievers to autoregressively generate item IDs from user context ( 22 ; 29 ; 21 ; 28 ) , while subsequent work focuses on scaling and production-oriented training and inference recipes ( 17 ) . Semantic IDs and item tokenization. A central component of generative retrieval is item tokenization , which maps each item to a short sequence of discrete tokens (Semantic ID) for generation. TIGER ( 18 ) popularized learned Semantic IDs via residual quantization (e.g., RQ-VAE ( 10 ) ) over item content embeddings. Subsequent works focus on improving SID quality ( 26 ; 27 ; 23 ; 25 ; 19 ; 30 ) and show that SID construction is often decisive for downstream retrieval performance. In particular, LETTER ( 26 ) introduces interaction-informed tokenization by adding collaborative regularization to the quantizer training objective. However, existing tokenization methods typically assume a static SID vocabulary and do not explicitly address how to preserve compatibility when SIDs are refreshed over time. In contrast, we focus on the SID update step under temporal drift: refreshing interaction-informed SIDs while reusing an existing retriever checkpoint. Industry applications of Semantic IDs. Several industrial systems report applying Semantic IDs at scale ( 32 ; 11 ; 31 ) , combining SID tokenization with large generative backbones and production constraints (e.g., constrained decoding and efficient serving). Representative examples include PLUM ( 7 ) and OneRec ( 5 ; 33 ; 34 ) , and Spotify’s work on unified generative search and recommendation ( 14 ) . While these works demonstrate practical value at scale, they largely focus on SID construction and training/serving recipes, leaving checkpoint-compatible SID refresh and continual adaptation under temporal drift underexplored. 3. Proposed Approach We study how to refresh Semantic IDs (SIDs) in generative retrieval for sequential recommendation while preserving compatibility with an existing checkpoint. In real-world deployment scenarios, SID-based retrievers are often finetuned on fresh logs while keeping SIDs fixed, which can make interaction-informed identifiers stale as collaborative patterns drift over time ( 7 ; 5 ) . Our goal is to incorporate fresh interaction signals into SIDs while keeping the deployed retriever warm-startable, avoiding a full rebuild-and-retrain pipeline. 3.1. Problem Setup We consider the retrieval (candidate generation) stage in sequential recommendation. Let \mathcal{U} and \mathcal{I} denote the sets of users and items. Each user u\in\mathcal{U} is represented by a time-ordered interaction sequence S_{u}=(i_{u,1},\dots,i_{u,|S_{u}|}) . Given S_{u} , retrieval returns a candidate set of items (typically hundreds to thousands), deferring fine-grained ordering to a downstream ranker. We focus on a SID-based generative retriever, where each item i\in\mathcal{I} is assigned a SID represented as a token sequence of length L, (1) \mathbf{z}_{i}=(z_{i,1},\dots,z_{i,L}),\quad z_{i,\ell}\in\mathcal{V}_{\ell}, where \mathcal{V}_{\ell} is the vocabulary of the \ell -th codebook. Conditioned on user context, the retriever generates SID tokens and retrieves candidate items via a SID-to-item mapping. Crucially, the retriever is tied to the SID space via token embeddings and distributions over \{\mathcal{V}_{\ell}\}_{\ell=1}^{L} . Thus, rebuilding SIDs reassigns tokens and makes checkpoint reuse non-trivial. Without special handling, warm-start finetuning can be unstable and is often avoided in favor of retraining from scratch. Conversely, keeping SIDs fixed while finetuning on fresh interactions can lead to stale identifiers that no longer reflect the latest collaborative structure. Accordingly, we focus on SID update procedures that inject fresh signals from new logs while preserving the original token space, so the retriever can be warm-started rather than fully retrained. 3.2. Semantic-ID Alignment Update We assume two SID assignments over a largely shared item space: (i) an old SID token assignment produced previously, and

Read the complete text