SynerGen: Contextualized Generative Recommender for Unified Search and Recommendation

Vianne R. Gao, Chen Xue Marc Versage Xie Zhou Zhongruo Wang Chao Li Yeon Seonwoo Nan ChenZhen Ge Gourab KunduWeiqi Zhang Tian Wang Qingjun Cui Trishul Chilimbi Store Foundation AI, Amazon · 2025

Read SynerGen: Contextualized Generative Recommender for Unified Search and Recommendation by Vianne R. Gao, Chen Xue Marc Versage Xie Zhou Zhongruo Wang Chao Li Yeon Seonwoo Nan ChenZhen Ge Gourab KunduWeiqi Zhang Tian Wang Qingjun Cui Trishul Chilimbi Store Foundation AI, Amazon (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-21777.txt.

Introduction

Big online services usually split search and recommendation into a retrieve step and then a rank step. The split causes mismatched tuning and extra upkeep. Vianne R. Gao and thirteen co-authors present SynerGen in this 2025 paper, a single generative model that does both jobs. Earlier generative models merged the steps but often favored one job over the other.

SynerGen is a decoder-only Transformer trained on records of user behavior. One training goal serves retrieval, and a mixed pointwise and pairwise goal serves ranking. Inside the shared model, search signals improve recommendation and recommendation signals improve search. A new way of encoding time helps the model use when things happened. On standard benchmarks for both tasks, SynerGen beat strong rivals, showing one model can serve both kinds of access.

Catalog record

CREATORVianne R. Gao, Chen Xue Marc Versage Xie Zhou Zhongruo Wang Chao Li Yeon Seonwoo Nan ChenZhen Ge Gourab KunduWeiqi Zhang Tian Wang Qingjun Cui Trishul Chilimbi Store Foundation AI, Amazon
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-21777

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SynerGen: Contextualized Generative Recommender for Unified Search and Recommendation Vianne R. Gao, Chen Xue Marc Versage Xie Zhou Zhongruo Wang Chao Li Yeon Seonwoo Nan ChenZhen Ge Gourab KunduWeiqi Zhang Tian Wang Qingjun Cui Trishul Chilimbi Store Foundation AI, Amazon Abstract The dominant retrieve-then-rank pipeline in large-scale recommender systems suffers from mis-calibration and engineering overhead due to its architectural split and differing optimization objectives. While recent generative sequence models have shown promise in unifying retrieval and ranking by auto-regressively generating ranked items, existing solutions typically address either personalized search or query-free recommendation, often exhibiting performance trade-offs when attempting to unify both. We introduce SynerGen , a novel generative recommender model that bridges this critical gap by providing a single generative backbone for both personalized search and recommendation, while simultaneously excelling at retrieval and ranking tasks. Trained on behavioral sequences, our decoder-only Transformer leverages joint optimization with InfoNCE for retrieval and a hybrid pointwise-pairwise loss for ranking, allowing semantic signals from search to improve recommendation and vice versa. We also propose a novel time-aware rotary positional embedding to effectively incorporate time information into the attention mechanism. SynerGen achieves significant improvements on widely adopted recommendation and search benchmarks compared to strong generative recommender and joint search and recommendation baselines. This work demonstrates the viability of a single generative foundation model for industrial-scale unified information access. 1 Introduction Large-scale search and recommendation systems in e-commerce, short video, and food-delivery platforms are typically deployed as multi-stage cascades. A high-recall retriever (e.g., BM25 ( Robertson et al. 2009 ) , two-tower ( Covington et al. 2016 ) , or item–item collaborative filter ( Linden et al. 2003 ) ) narrows hundreds of millions of items to a few thousand candidates, which are then re-ordered by a compute-intensive ranker to optimize business metrics such as click-through rate (CTR), revenue, or watch-time. While pragmatic, this architecture forces each stage to optimize different losses, operate on disjoint features, and refresh on separate cadences—leading to redundant engineering and production misalignment. Inspired by the success of large language models, recent work reframes recommendation as a generative problem: an autoregressive model directly outputs a ranked slate conditioned on user context, thereby aligning retrieval and ranking under a single objective. These generative recommenders have shown promising results in specific domains such as short-video feeds, food delivery, and even trillion-scale deployments. However, existing systems typically target only one interaction mode. Query-aware search and query-free feed recommendation remain siloed: some models focus exclusively on search, while others excel in feed recommendation but ignore queries. Attempts at unification reveal an inherent trade-off: semantic query signals and collaborative behavioral signals compete within shared representations, so improving one task often degrades the other. To date, no published work demonstrates a single generative backbone that simultaneously excels at both retrieval and ranking and supports both query-aware search and query-free recommendation. We address this gap with SynerGen , the first decoder-only generative recommender that unifies these four capabilities. Retrieval and ranking are jointly optimized within one backbone: retrieval with an InfoNCE loss ( Oord et al. 2018 ) (using in-batch and mined hard negatives), and ranking with a hybrid pointwise–pairwise loss. Semantic, behavioral, and temporal signals are fused before the first Transformer layer, ensuring richer contextualization than late concatenation. Joint training allows semantic cues from queries to strengthen feed recommendation and collaborative signals to benefit search. By demonstrating that a single generative foundation model can deliver state-of-the-art performance across both retrieval and ranking, in both search and recommendation, while meeting strict latency constraints, SynerGen positions generative recommendation as a universal backbone for industrial information access. Contributions. In summary, we make the following contributions: 1. We present the first decoder-only generative model that seamlessly supports both query-aware search and query-free recommendation, achieving superior results on standard benchmarks. 2. We show that retrieval and ranking can be jointly optimized within a single backbone without cross-stage misalignment, simplifying deployment while improving effectiveness. Figure 1: Overview of SynerGen pretraining, illustrating unified retrieval and ranking tasks within a joint search and recommendation framework. A single forward pass processes a user behavior sequence of length n , with context and task tokens jointly encoded. Semantic embeddings cached from a pretrained language model are frozen during training. 2 Background and Related Work As large generative models emerge in recommendation and search, the focus of applications has shifted toward addressing long-standing challenges such as: unifying search and recommendation, modeling evolving user preferences, and incorporating temporal patterns into sequential prediction. Unifying Search and Recommendation. Traditional search and recommendation systems have been developed in silos—search engines retrieve items based on explicit queries, while recommenders predict user preferences from interaction histories. Such separation ignores the shared users and overlapping item spaces across tasks. Recent work has sought to unify search and recommendation into a single modeling framework ( Zhao et al. 2025 ; Liu et al. 2024 ) , enabling richer user representations, improved generalization, and reduced data sparsity through joint training. Notable examples include USER ( Yao et al. 2021 ) , which models heterogeneous sequences of queries and item interactions, and UnifiedSSR ( Xie et al. 2023 ) , which learns a shared representation of user behavior across both modalities. UniSAR ( Shi et al. 2024 ) further refines this idea by explicitly modeling cross-modal transitions, using contrastive objectives and cross-attention to align and fuse behaviors from search and recommendation. Generative Search and Recommendation. The emergence of generative large language models (LLMs) has catalyzed a new paradigm for unifying search and recommendation in e-commerce. Unlike traditional retrieval methods that rely on sparse or dense vector matching, generative LLMs can directly generate item identifiers or embeddings in response to user queries or profiles, enabling a seamless integration of both search and recommendation within a single framework. Recent advances demonstrate two primary approaches: text-based generative inputs (e.g., HLLM Chen et al. 2024 ) and ID-based inputs (e.g., HSTU Zhai et al. 2024 and MTGR Han et al. 2025 ). Both have shown that generative models can bridge the gap between search (semantic relevance) and recommendation (collaborative filtering). Beyond these, a growing set of generative recommenders explore collapsing the retrieval–ranking pipeline altogether. OneRec ( Deng et al. 2025 ) applies an encoder–decoder MoE architecture to short-video feeds, surpassing strong two-tower baselines. MTGR ( Han et al. 2025 ) extends this idea to food delivery, using a hierarchical backbone with dynamic masking to preserve cross-feature interactions. Actions Speak Louder than Words ( Zhai et al. 2024 ) scales generative recommendation to the trillion-parameter regime with specialized fast-attention kernels, achieving double-digit online lifts. In contrast, GenR-PO ( Li et al. 2024 ) targets e-commerce search but does not support feed recommendation, while GenRank ( Huang et al. 2025 ) focuses on recommendation without query signals. More recent attempts such as UniSAR ( Shi et al. 2024 ) and GenSAR ( Shi et al. 2025 ) aim at unified modeling but report trade-offs between query-aware and query-free modes. Model Architecture Query-Aware Search Query-Free Recommendation HLLM ( Chen et al. 2024 ) Two Tier Decoder \times \checkmark (short-video feeds) OneRec ( Deng et al. 2025 ) Encoder–Decoder MoE \times \checkmark (short-video feeds) HSTU ( Zhai et al. 2024 ) Causal Encoder on ID-inputs \times \checkmark

Read the complete text