Unifying Search and Recommendation with Dual-View Representation Learning in a Generative Paradigm
Jujia Zhao, Wenjie Wang, Chen Xu, Xiuying Chen, Zhaochun Ren, Suzan Verberne · 2025
Read Unifying Search and Recommendation with Dual-View Representation Learning in a Generative Paradigm by Jujia Zhao, Wenjie Wang, Chen Xu, Xiuying Chen, Zhaochun Ren, Suzan Verberne (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-06714.txt.
Introduction
Jujia Zhao and co-authors wrote this 2025 paper unifying search and recommendation inside one generative model. Platforms both push suggestions and answer queries, and a shared model could understand users and items better. Earlier unification used shared encoders with separate heads and suffered gradient conflicts and fiddly manual design, which the authors trace to low mutual information between inputs and task outputs.
Their GenSR model instead works generatively: prompts partition its parameter space into a subspace per task. A dual representation learner first models collaborative history and semantic history separately, giving each subspace rich material. Both tasks then train together in the single model. The authors argue the generative framing resolves the conflicts structurally, and report the design as a cleaner path to one engine for finding and suggesting.
Catalog record
| CREATOR | Jujia Zhao, Wenjie Wang, Chen Xu, Xiuying Chen, Zhaochun Ren, Suzan Verberne |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 78 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-06714
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Unifying Search and Recommendation with Dual-View Representation Learning in a Generative Paradigm Jujia Zhao, Wenjie Wang, Chen Xu, Xiuying Chen, Zhaochun Ren, Suzan Verberne Abstract . Recommender systems and search engines are critical components of online platforms, with recommender systems proactively providing information to users, whereas search engines enable users to seek information actively. Unifying both tasks in a shared model is promising since it can enhance user modeling and item understanding. Previous approaches mainly follow a discriminative paradigm, utilizing shared encoders to process input features and task-specific heads to perform each task. However, this paradigm faces two key challenges: gradient conflict and manual architecture design overhead. From the information theory perspective, these challenges potentially both stem from the same issue — low mutual information between input features and task-specific output during optimization. To address this, we propose GenSR, a novel generative paradigm for unifying search and recommendation (S&R), which leverages task-specific prompts to partition the model’s parameter space into subspaces, thereby enhancing mutual information. To construct effective subspaces for each task, GenSR first prepares informative representations for each subspace and then optimizes both subspaces in one unified model. Specifically, GenSR consists of two main modules: (1) Dual Representation Learning, which independently models collaborative and semantic historical information to derive expressive item representations; and (2) S&R Task Unifying, which utilizes contrastive learning together with instruction tuning to generate task-specific outputs effectively. Extensive experiments on two benchmarks show GenSR outperforms state-of-the-art methods across S&R tasks. 1. Introduction Recommender systems and search engines have become indispensable components of modern online service platforms, including e-commerce websites and social media networks ( Zhang et al., 2024 ; Wu et al., 2024 ) . Usually, search and recommendation (S&R) tasks are trained on separate models ( Bhattacharya et al., 2024 ) . Recently, advances in information retrieval show that unifying these two tasks within a shared model offers significant advantages ( Yao et al., 2021 ; Si et al., 2023 ) : First, joint modeling of user behaviors across both S&R provides a more comprehensive understanding of user preferences. Second, leveraging interactions from both task domains enriches item-side interactions, enhancing the understanding and delivery of items. Figure 1. (a) and (b) illustrate the discriminative and generative paradigms for unifying S&R, respectively, highlighting their differences in parameter space. While the discriminative paradigm results in low mutual information by optimizing S&R tasks within a shared parameter space, the generative paradigm enhances mutual information by partitioning the space into distinct subspaces through instructions. Existing efforts to unify S&R mostly follow a discriminative paradigm, which utilizes shared encoders to process input features ( e.g., user interaction history) and task-specific heads to predict whether a user will click on an item in S&R tasks, as illustrated in Figure 1 (a) ( Shi et al., 2024 ; Xie et al., 2024 ) . However, such paradigm has two drawbacks: 1) Gradient conflict: The differing optimization objectives of S&R, where search primarily focuses on modeling query-item relevance based on the current query context, while recommendation emphasizes capturing user preferences by analyzing user’s historical interactions, lead to gradient conflicts in the shared encoder ( Shi et al., 2023 ; He et al., 2024 ) . This often results in negative cosine similarity between the task gradients and interferes with effective model optimization ( Yu et al., 2020 ) (see empirical evidence in Section 6.5 ). 2) Manual architecture design overhead: The design of task-specific heads requires substantial manual effort, increasing system complexity and reducing scalability and extensibility ( Rahimian et al., 2023 ; Xie et al., 2024 ) . Inspired by information theory, we argue that these drawbacks potentially both stem from the same underlying issue — low mutual information between the model’s input features and task-specific output during optimization. This low mutual information arises from constraining both tasks within a shared parameter space in the shared encoder, as depicted in the parameter space analysis in Figure 1 (a). This constraint limits the representation capability of the shared encoder, resulting in gradient conflict. Consequently, it necessitates manual designs of task-specific heads to compensate the potential performance degradation caused by gradient conflicts. To address the above limitations, we aim to increase the mutual information between the model’s input features and the task-specific outputs. Partitioning the parameter space into distinct subspaces has proven to be effective for enhancing mutual information, particularly when addressing diverse tasks ( Ueda and Nishikawa, 2020 ) . It reduces task interference and enables the model to learn task-specific predictions through different task optimization subspaces. To naturally achieve such partitioning, we design a generative paradigm that leverages instruction tuning in pre-trained generative models. Instruction tuning partitions the parameter space by introducing distinct prompts for each task, effectively tailoring a unique optimization subspace for S&R as illustrated in Figure 1 (b). To this end, we propose a novel Gen erative paradigm for unifying S earch and R ecommendation, abbreviated as GenSR, which leverages task-specific prompts to partition the model’s parameter space into subspaces, thereby enhancing mutual information (see detailed analysis in § 4 ). To construct effective subspaces for each task, GenSR first prepares informative representations for each subspace and then optimizes both subspaces in one unified model. Specifically, GenSR consists of two main modules: (1) Dual representation learning : GenSR independently models historical dual representations that encompass sufficient information for both S&R tasks. Specifically, we simultaneously learn item representations from both CF ( CF ) view and semantic view. Meanwhile, to capture user preference from extensive S&R historical interactions, a soft-filtering strategy is designed to prioritize the most relevant representations. (2) S&R task unifying : GenSR integrates previously learned representation with task-specific prompts and feeds them into a shared generative model to perform both tasks. Specifically, it employs contrastive learning to align the CF and semantic representations for the same users and uses instruction tuning to effectively generate task-specific outputs. In summary, our main contributions are as follows: (1) We propose GenSR, a generative paradigm designed to unify S&R tasks through dual representation learning and S&R task unifying. (2) We introduce a novel perspective for comparing discriminative and generative paradigms based on mutual information. (3) We conduct comprehensive experiments on two public datasets, including S&R performance analysis, mutual information estimation, parameter space visualization, gradient conflict analysis and ablation study of different modules, to validate GenSR’s effectiveness and efficiency compared to other baselines across both S&R tasks. 2. Related Work 2.1. Unifying search and recommendation Recent research highlights that search and recommendation (S&R) behaviors are inherently complementary, as each provides unique signals that enhance user modeling and item understanding ( Penha et al., 2024 ; Shi et al., 2025 ) . By jointly leveraging data from both tasks, it is possible to achieve more accurate intent modeling and representation learning, thereby improving the performance of both tasks. As a result, an increasing number of studies have focused on unifying S&R. These efforts can be broadly categorized into two main directions: (1) Search-enhanced recommendation ( Wu et al., 2019 ) , which integrates search behavior into the recommendation scenario to improve user preference modeling. This line of research assumes that users’ search queries convey semantic intent signals that are often missing from the