FLUID: From Ephemeral IDs to Multimodal Semantic Codes for Industrial-Scale Livestreaming Recommendation DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Information systems Recommender systems CCS: Information systems Learning to rank CCS: Computing methodologies Neural networks CCS: Information systems Multimedia streaming
Xinhang Yuan, Zexi Huang, Anjia Cao, Xudong Lu, Zikai Wang, Penghao Zhou, Chang Liu, Wentao Guo, Qinglei Wang · 2026
Read FLUID: From Ephemeral IDs to Multimodal Semantic Codes for Industrial-Scale Livestreaming Recommendation DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Information systems Recommender systems CCS: Information systems Learning to rank CCS: Computing methodologies Neural networks CCS: Information systems Multimedia streaming by Xinhang Yuan, Zexi Huang, Anjia Cao, Xudong Lu, Zikai Wang, Penghao Zhou, Chang Liu, Wentao Guo, Qinglei Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-21832.txt.
Introduction
Xinhang Yuan and co-authors present FLUID, the first to retire the item ID from a livestreaming ranker. Live rooms air briefly, leaving item IDs unlearned in a cold start that defeats ID-centric ranking. FLUID's multimodal encoder produces hierarchical semantic codes called LUCID. A warmup adds slice-level LUCID beside the ID embedding, then replaces the ID with room-level LUCID. Deployed widely, it gains zero point five five, two point zero five, and zero point zero five percent in watch duration, cold-start room views, and active hours.
Catalog record
| CREATOR | Xinhang Yuan, Zexi Huang, Anjia Cao, Xudong Lu, Zikai Wang, Penghao Zhou, Chang Liu, Wentao Guo, Qinglei Wang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37429 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.21832
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
FLUID: From Ephemeral IDs to Multimodal Semantic Codes for Industrial-Scale Livestreaming Recommendation DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Information systems Recommender systems CCS: Information systems Learning to rank CCS: Computing methodologies Neural networks CCS: Information systems Multimedia streaming Xinhang Yuan, Zexi Huang, Anjia Cao, Xudong Lu, Zikai Wang, Penghao Zhou, Chang Liu, Wentao Guo, Qinglei Wang Abstract . Modern recommender systems rely heavily on ID-based collaborative filtering: each item is represented by a unique ID embedding that accumulates collaborative signals from user interactions. Livestreaming recommendation, however, faces a unique challenge in this paradigm: a live room typically broadcasts for only tens of minutes, so its item ID remains poorly learned in a persistent cold-start state and ID-centric ranking models fail to generalize. We present FLUID, the first framework to fully retire the candidate-side item ID from a production-scale livestreaming ranker. FLUID introduces a cross-domain multimodal encoder, jointly trained on short videos and livestreams, to produce discrete hierarchical semantic codes, called LUCID, for content-based item characterization. To adapt the ranker to LUCID, FLUID further employs a staged warmup scheme: it first incorporates cold, slice-level LUCID as an independent token alongside the ID embedding, and then replaces the ID embedding with warm, room-level LUCID before online incremental training. Deployed on our industrial livestreaming recommenders with a cross-platform combined user base of over one billion globally, FLUID delivers significant online gains of +0.55% Quality Watch Duration, +2.05% Cold-Start Room Views, and +0.05% Active Hours. 1. Introduction Livestreaming has emerged as one of the fastest-growing online content ecosystems ( 44 ; 19 ; 35 ) , where creators broadcast in real time and users interact through viewing, commenting, and gifting. Unlike videos (typical item lifetime measured in days to months) and e-commerce (months to years), livestreams are only relevant when on air. On our leading livestreaming platforms with a combined user base of over one billion, a live room typically broadcasts for tens of minutes (median {\sim}40 min). This poses a fundamental challenge for ID-centric recommender systems, which rely on accumulating collaborative signals on item ID embeddings to power personalization. As shown in Figure 1 , the embedding norm fails to converge within the median 40-minute room lifetime. Most items therefore spend their entire lifetime with undertrained embeddings. Meanwhile, modern large recommendation models (LRMs) ( 39 ; 42 ; 9 ; 44 ) still place most of their capacity in the ID embedding tables, which only memorize short-lived exposure signals and struggle to generalize in the livestreaming setting. Figure 1 . Item ID embedding \ell_{2} norm vs. live-room age, aggregated over one day of production traffic. The norm fails to converge within the median {\sim}40 -minute room lifetime. A promising solution to reduce ranker reliance on memorization-based ID embeddings is to leverage content-derived signals. One line of work appends frozen multimodal embeddings to items as auxiliary features ( 28 ; 20 ) . Another aligns or discretizes multimodal representations into compact semantic codes with learnable embedding tables similar to ID features ( 25 ; 18 ; 20 ; 36 ; 7 ; 47 ; 48 ) . Further, end-to-end multimodal recommenders ( 19 ; 43 ; 35 ) train the multimodal encoder jointly with downstream ranking tasks. Despite their diverse forms, all these systems treat multimodal features as complementary signals alongside the dominant item IDs, including those specifically designed for livestreaming ( 19 ) . Yet, two livestreaming-specific challenges remain unsolved. First, producing high-quality semantic representations for livestreaming is nontrivial. Live content is inherently multimodal and fast-changing, with visuals, speech, on-screen text, streamer metadata, and audience signal all evolve within minutes ( 19 ; 35 ) . Content representations must capture both transient dynamics and persistent room characteristics. In addition, unlike videos and e-commerce where contents are themed and user feedback signals are dense, which majority of multimodal encoders are designed for ( 20 ; 7 ; 28 ; 25 ) , livestreaming can be more challenging to clearly characterize with less supervised signals for encoders to train on. Second, incorporating semantic representations into ID-centric rankers is difficult. When adding multimodal features on top of ID-based signals, rankers often take the “shortcut” of ID-embeddings and underutilize the multimodal input, usually requiring explicit alignment, optimization rebalancing, or contrastive regularization to strengthen multimodal contribution ( 20 ; 7 ; 47 ) . This ID-dominant effect is especially critical to livestreaming as item IDs are ephemeral and do not carry as much collaborative information as in other content recommendation scenarios. To address these two challenges, we propose FLUID ( F ramework for L ive U niversal ID -free Recommendation, Figure 2 ), the first framework to fully replace item ID with content-based semantic codes in industrial-scale livestreaming rankers. Specifically, FLUID first introduces a cross-domain multimodal encoder jointly trained on short videos and livestreams to leverage clean and dense supervision signals from the short-video domain, producing discrete semantic codes we call LUCID ( L ive U niversal C ontent ID entifier). Second, a staged warmup training scheme adapts the ranker to LUCID by first leveraging the ranker backbone for a late fusion of cold, slice-level LUCID embedding and the existing item ID embedding and then replacing the item ID embedding with warm, room-level LUCID embedding before the final online incremental training. Figure 2 . Overview of FLUID. Top: a cross-domain multimodal encoder (SigLIP2 ViT + Qwen3-Embedding) jointly trained on livestreams and short videos produces a 128-d slice embedding z , which RQ-KMeans discretizes into a 4-level codeword tuple— LUCID —with room-level LUCID obtained by per-level majority voting over slices in a session. Bottom: slice-level and room-level LUCID enter the token-based ranker backbone as independent tokens (late fusion) via prefix n-gram embeddings, replacing the item id embedding with a staged warmup scheme. In summary, our contributions are as follows: • Problem framing. We argue that when the item ID is ephemeral, the ID-dominance effect becomes a fundamental bottleneck rather than a tolerable nuisance, motivating full retirement of the item ID for optimized ranking performance. • Cross-domain semantic representations. A multimodal encoder jointly trained on short-video and livestream supervision produces discrete hierarchical codes that converts to embeddings via the prefix-n-gram scheme. • Late-fusion ID-free ranker. We deploy the first production-scale livestreaming ranker without item IDs thanks to our staged warmup scheme, which adds LUCID and replaces the item ID with a late fusion strategy. Deployed on our industrial livestreaming recommenders with a combined user base of over one billion globally, FLUID delivers significant online gains of +0.55\% Quality Watch Duration, +2.05\% Cold-Start Room Views, +2.87\% Niche Room Views, +1.63\% Unique Watched Tags, and +0.05\% Active Hours. 2. Related Work 2.1. Multimodal Embedding Multimodal embedding learning aligns heterogeneous data—such as images, text, and videos—into a unified semantic space ( 24 ; 12 ) , enabling diverse downstream applications including industrial recommendation ( 19 ; 20 ) . Early work pioneered by CLIP ( 24 ) adopts a dual-tower paradigm with independent unimodal encoders aligned via contrastive learning, and has been extensively refined in specific aspects such as training objectives, architecture and applications ( 17 ; 37 ; 40 ; 32 ; 41 ;