CRM: Retrieval Model with Controllable Condition CCS: Information systems Recommender systems
Chi Liu, Jiangxia Cao, Rui Huang, Kuo Cai, Weifeng Ding, Qiang Luo, Kun Gai, Guorui Zhou · 2024
Read CRM: Retrieval Model with Controllable Condition CCS: Information systems Recommender systems by Chi Liu, Jiangxia Cao, Rui Huang, Kuo Cai, Weifeng Ding, Qiang Luo, Kun Gai, Guorui Zhou (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-13844.txt.
Introduction
Chi Liu and co-authors let a recommendation retrieval model aim at a chosen outcome, such as watch time. Standard retrievers fetch items a user might like, but platforms care how long users stay. Retraining for each target is costly.
Their model takes the desired watch time as an input on the user side only. During training it learns from real watch times. At serving time, staff dial in a target and the model retrieves to match, with no retraining. Item embeddings stay fixed, so fast index search still works. Two builds are shown, a classic two-tower network and a transformer variant. For each request, the target is picked from the user's own history. Steering retrieval this way links ranking to business goals directly.
Catalog record
| CREATOR | Chi Liu, Jiangxia Cao, Rui Huang, Kuo Cai, Weifeng Ding, Qiang Luo, Kun Gai, Guorui Zhou |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 19 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-13844
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CRM: Retrieval Model with Controllable Condition CCS: Information systems Recommender systems Chi Liu, Jiangxia Cao, Rui Huang, Kuo Cai, Weifeng Ding, Qiang Luo, Kun Gai, Guorui Zhou Abstract . Recommendation systems (RecSys) are designed to connect users with relevant items from a vast pool of candidates while aligning with the business goals of the platform. A typical industrial RecSys is composed of two main stages, retrieval and ranking: (1) the retrieval stage aims at searching hundreds of item candidates satisfied user interests; (2) based on the retrieved items, the ranking stage aims at selecting the best dozen items by multiple targets estimation for each item candidate, including classification and regression targets. Compared with ranking model, the retrieval model absence of item candidate information during inference, therefore retrieval models are often trained by classification target only (e.g., click-through rate), but failed to incorporate regression target (e.g., the expected watch-time), which limit the effectiveness of retrieval. In this paper, we propose the Controllable Retrieval Model (CRM), which integrates regression information as conditional features into the two-tower retrieval paradigm. This modification enables the retrieval stage could fulfill the target gap with ranking model, enhancing the retrieval model ability to search item candidates satisfied the user interests and condition effectively. We validate the effectiveness of CRM through real-world A/B testing and demonstrate its successful deployment in Kuaishou’s short-video recommendation system, which serves over 400 million users. Figure 1. Illustration of RecSys chain: (a) Standard two-tower retrieval model with classification task only; (b) the classification and regression targets based ranking model; (c) our controllable retrieval paradigm involves the condition. 1. Introduction Recommendation systems play a pivotal role across many platforms, including short-video sharing platforms such as Kuaishou ( Liu et al. 2024 ) , Douyin ( Zhu et al. 2024 ) , and Google ( Rajput et al. 2023 ) , benefiting billions of users worldwide. These systems aim to efficiently match users with the right items while aligning with platform goals, thereby achieving a positive environment for users, creators, and the platform. To capture user interests precisely, the industrial RecSys always optimized by multiple targets ( Tang et al. 2020 ; Wang et al. 2024 ) , such as classification target (e.g., click, comment) and regression target (e.g., watch-time). By considering these diverse targets, RecSys could select the most related items from a pool of tens of millions of item pool for users. The typical recommendation architecture is typically divided into two stages, retrieval ( Huang et al. 2020 ) and ranking ( Covington et al. 2016 ) : (1) the retrieval stage, where hundreds of candidates are selected from a corpus of millions of items, (2) the ranking stage, where the retrieved hundreds items are multi-target scored one by one to determined the best dozens to users (as shown in Figure 1 (a) and (b)). Compared with ranking model, the retrieval stage often uses the two-tower training paradigm ( Huang et al. 2013 ; Yang et al. 2020a ) , where user/item features are independently encoded by user/item tower, and next utilizing a classification task to optimize model. On the one hand, benefit by the two-tower architecture, we could achieve a efficient retrieval in inference since only the user tower needed re-computation for each recommendation request. On the other hand, the two-tower architecture also seriously limits the retrieval model’s ability to support multi-targets training, especially the regression targets. To fulfill the multiple-targets gap in classification targets ( Huang et al. 2024 ) , a common strategies is introducing multi-route models in retrieval stage, where each route model focuses on a specific target, and then aggregated these results for latter ranking stage. Despite these advances, an important problem still unresolved: how to introduce the regression target into retrieval model? Actually, the regression targets (e.g., expected watch time) should require knowledge of the corresponding item to be determined. This is because the expected watch time lacks a common consensus of ‘good’ or ‘bad’, it depends on the video’s quality and the user’s watch habits at same time, making it challenging to infer solely from user-side information only. Such phenomenon leading a consistency problem between retrieval and ranking stages and constraining the performance of RecSys chain. In this paper, we propose the Controllable Retrieval Model (CRM), a novel retrieval paradigm that incorporates regression information as an additional condition to guide the model. This approach enables the simultaneous utilization of both classification and regression signals, as illustrated in Figure 1 (c). Specifically, during training, regression condition is incorporated as features in the user tower to generate directional user representations. During online inference, condition is strategically set to guide the retrieval process to align with our platform goals. In our implementation, we give two simple versions: the first is naive CRM and the second is decision transformer CRM from reinforce learning (RL) perspective ( Chen et al. 2021 ) . Our contributions are as follows: • We propose a new paradigm for designing retrieval models by incorporating regression information as a condition, enhancing the consistency between the retrieval and ranking stages, and inspiring advancements in recommendation systems. • We introduce two simple yet effective methods for implementing CRM: one involves improving the two-tower architecture, and the other incorporates sequence modeling, providing a reference for others adopting CRM. • We present a novel and effective strategy for selecting conditions, validated in Kuaishou’s largest short video recommendation scenario. 2. Preliminary This section briefly review the: (1) the two-tower retrieval workflow; (2) the RL-based decision transformer for sequence modeling. 2.1. Two-Tower Retrieval Workflow Generally, the retrieval task aims utilizing the user/item feature to model user preference and item attributes to predict the next video that user are likely to interact with. For example, {(x_{1},w_{1}),\dots,(x_{n},w_{n})} represents the IDs and watch times of videos recently viewed by a user, passed to the user tower as part of UserFea , while x_{n+1} represents the ID of the next video viewed as part of ItemFea . The two-tower backbone first employ the user/item side information to generate their representations: (1) \begin{split}\mathbf{u}&=\texttt{User\_Tower}\big(\texttt{UserFea}\big),\\ \mathbf{v}&=\texttt{Item\_Tower}\big(\texttt{ItemFea}\big),\\ \end{split} where User_Tower and Item_Tower can be any arbitrary networks, e.g., multi-layer MLPs , and the UserFea / ItemFea are user/item side features. In training, we could maximize the following likelihood to optimize user and item representations as follows (here we take the long-view prediction as example): (2) \begin{split}&\mathcal{L}=-\texttt{log}{(\hat{y}^{\texttt{lvtr}})},\\ \texttt{where}\ \ \ \hat{y}^{\texttt{lvtr}}&=\texttt{In-ba}\texttt{tch-Softmax}(\mathbf{v}^{\top}\mathbf{u}),\end{split} where \hat{y}^{\texttt{lvtr}}\in\mathbb{R} means the estimated classification score. Benefit from two-tower setting, in inference, we could cache all item representations as \mathbf{V} , then calculate the User_Tower to obtain real-time user representation \mathbf{u} only for a fast retrieval: (3) \{\hat{x}_{n+1}^{1},\hat{x}_{n+1}^{2},\hat{x}_{n+1}^{3},\dots\}=\texttt{ANN}(\mathbf{u},\mathbf{V}) where ANN denotes approximate nearest neighbor (ANN) search operator ( Johnson et al. 2019 ) , the \hat{x}_{n+1}^{i} means the retrieved small group item candidates. 2.2. Decision Transformer in RL RL aims to control an agent to conduct actions to maximum cumulative reward in an given state and environment ( Levine et al. 2020 ) . Actually, the RL idea is closely related with our CRM: based on observed interaction sequence (state) , to find next item (action) under the regression condition (reward) for each user (environment) . In offline RL filed (does not considering the environment factor), the Decision Transformer