An End-to-End Multi-objective Ensemble Ranking Framework for Video Recommendation CCS: Recommender systems

Tiantian He ∗, Minzhi Xie ∗, Runtong Li ∗, Xiaoxiao Xu ∗, Jiaqi Yu ∗, Zixiu Wang ∗, Lantao Hu ∗, Han Li ∗, Kun Gai ∗ · 2025

Read An End-to-End Multi-objective Ensemble Ranking Framework for Video Recommendation CCS: Recommender systems by Tiantian He ∗, Minzhi Xie ∗, Runtong Li ∗, Xiaoxiao Xu ∗, Jiaqi Yu ∗, Zixiu Wang ∗, Lantao Hu ∗, Han Li ∗, Kun Gai ∗ (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-05093.txt.

Introduction

Short-video platforms rank each candidate video by blending many goals at once — watch time, likes, follows — and the blending was long done with hand-written formulas. Tiantian He and co-authors replace the formulas with a learned system, EMER, trained end to end. A crafted loss function stands in for the missing ground truth of user satisfaction, and a transformer reads the whole candidate set together, so ranking reflects comparison rather than isolated scores.

A matching offline-online evaluation setup speeds up model tuning. On real industrial data the framework performed strongly, and it now runs in the main scenarios of the Kuaishou platform, which serves hundreds of millions of daily users. Stay time rose by 1.39 percent and seven-day user lifetime by about 0.2 percent — gains the authors call substantial at that scale.

Catalog record

CREATORTiantian He ∗, Minzhi Xie ∗, Runtong Li ∗, Xiaoxiao Xu ∗, Jiaqi Yu ∗, Zixiu Wang ∗, Lantao Hu ∗, Han Li ∗, Kun Gai ∗
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-05093

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

An End-to-End Multi-objective Ensemble Ranking Framework for Video Recommendation CCS: Recommender systems Tiantian He ∗, Minzhi Xie ∗, Runtong Li ∗, Xiaoxiao Xu ∗, Jiaqi Yu ∗, Zixiu Wang ∗, Lantao Hu ∗, Han Li ∗, Kun Gai ∗ Abstract . We propose a novel E nd-to-end M ulti-objective E nsemble R anking framework (EMER) for the multi-objective ensemble ranking module, which is the most critical component of the short video recommendation system. EMER enhances personalization by replacing manually-designed heuristic formulas with an end-to-end modeling paradigm. EMER introduces a meticulously designed loss function to address the fundamental challenge of defining effective supervision for ensemble ranking, where no single ground-truth signal can fully capture user satisfaction. Moreover, EMER introduces novel sample organization method and transformer-based network architecture to capture the comparative relationships among candidates, which are critical for effective ranking. Additionally, we have proposed an offline-online consistent evaluation system to enhance the efficiency of offline model optimization, which is an established yet persistent challenge within the multi-objective ranking domain in industry. Abundant empirical tests are conducted on a real industrial dataset, and the results well demonstrate the effectiveness of our proposed framework. In addition, our framework has been deployed in the primary scenarios of Kuaishou, a short video recommendation platform with hundreds of millions of daily active users, achieving a 1.39% increase in overall App Stay Time and a 0.196% increase in 7-day user Lifetime(LT7), which are substantial improvements. † † footnotetext: * These authors contributed equally to this work. Introduction Short video sharing platforms attract a substantial number of users by providing valuable content. When a user accesses a video platform, her satisfaction may manifest through diverse behaviors, which can be clustered into two groups. One group are user explicit interactions, such as liking, sharing, commenting, etc. The other group are user implicit feedback, such as watch time, long viewing, etc. The ranking module is the most critical component of the recommendation system, which is ultimately responsible for determining which videos are presented to the user. Figure 1. Heatmaps of normalized user behavior indicators. (left) User behaviors normalized by activity level, lower-activity users tend to express satisfaction through follows, with new users exhibiting approximately 135% higher (0.33 vs 0.14) follow rates than fully active users. (right) User behaviors normalized by content category, users demonstrate a higher likelihood of expressing satisfaction via “longer viewing" for “film/TV/entertainment" content, while preferring “like, follow and collect" for music content. The paradigm for ranking modules widely adopted in industry is a two-stage process. The first stage employs large-scale models to estimate user satisfaction in multiple dimensions. The second stage consolidates these multiple objectives into a single scalar value used for final ranking. In industry, scalarization is predominantly achieved through manually designed heuristic formulas. Although these formulas offer advantages such as low implementation cost, flexible adjustment, and strong interpretability, they exhibit significant limitations in personalization and modeling complex non-linear interactions. To enhance the personalization and nonlinear modeling capbility of multi-objective ensemble ranking modules, the industry has attempted to upgrade them to an end-to-end modeling paradigm. IntEL ( Li et al. 2023 ) explored a model-based approach; however, it retained reliance on a linear ranking formula, with the formula weights being learned by the model. A fundamental limitation of IntEL is the inherently constrained nonlinear capability of the linear formula. UREM subsequently sought to augment IntEL by introducing an unsupervised loss function, aiming to maximize the model’s perceptual capacity regarding input information. Nevertheless, existing research lacks a comprehensive discussion of the challenges related to practical deployment. The core challenges in developing an end-to-end multi-objective ranking model are threefold: 1) Defining effective supervision signals: As illustrated in Figure 1 , user satisfaction manifests through heterogeneous behavioral patterns that vary significantly across both user profiles and content taxonomies. That is to say, there is no single ground-truth signal can fully capture user satisfaction. In other words, unlike click-through rate prediction task, there is no unified ground-truth label for multi-objective ensemble ranking task. 2) Ensuring consistency between offline metrics and online performance: Objectives such as watch time and user interactions are susceptible to confounding factors. In our practical experience of optimizing user experience, we consistently observe a discrepancy: Offline model evaluations show improvements in AUC metrics for both watch time and interactions, yet online deployment yields divergent outcomes: increased watch time accompanied by a decline in interaction metrics. 3) Modeling comparative preferences among candidate items: Traditional recommendation system models estimate a user’s satisfaction level with a given individual video. However, in real-world recommendation scenarios, the focus shifts to the ranking among multiple candidate videos, that is, to the comparative relationships between the videos within the candidate set. In this paper, we propose an end-to-end multi-objective ensemble ranking framework to address the above three core challenges. To address the challenge of designing loss function, we introduce the concept of “Relative Advantage Satisfaction", a personalized, comparative measure of user preference. We implement this metric via a pairwise ranking loss. Furthermore, to improve ranking performance across multiple objectives, we incorporate a multi-dimensional AUC-based auxiliary loss. During training, an Advantage Evaluator dynamically adjusts the weights of this AUC loss in real-time, constraining the model towards “self-evolution" in the direction of comprehensively superior AUC performance. To address the issue of inconsistency between offline and online evaluations for watch time and user interactions, we propose a novel interaction metric: Interaction Probability per Unit Time ( IPUT ). Through leveraging the backdoor criterion from causal inference, the IPUT metric eliminates the confounding factor of watch time inherent in interactions. Furthermore, we designed a sophisticated sample organization scheme that aggregates all candidate videos to rank within a single request into one consolidated sample. A Transformer-based model architecture is specifically designed to process this aggregated set of candidate videos per request as its input, thereby enabling the model to capture the comparative relationships among the candidate videos. We summarize the main contributions as follows: • As far as we know, we are the first to clarify that the core challenges in model-based personalized multi-objective ranking are threefold: 1) the inherent difficulty in defining supervision signals, 2) establishing an offline-online consistent evaluation system, and 3) modeling comparative preferences among candidate items. • To address the three core challenges in model-based personalized multi-objective ranking, we propose a comprehensive framework that includes the design of the loss function, the sample organization scheme, the model architecture, and the evaluation methodology. • We verify the effectiveness of our proposed framework through extensive experiments conducted on a large scale industrial dataset, and successfully apply it in a real-world large scale recommender system bringing a considerable performance improvement. Related Work Short Video Recommendation User-generated content platforms featuring short videos have increasingly become an integral part of daily life. Recently, increasing research has focused on optimizing short video recommendation systems to enhance the accuracy and efficiency of recommending user-preferred content. Deep sequential models, especially GRU ( Chung et al. 2014 ) and Transformer architectures ( Vaswani et al. 2017 ) , have been popular for modeling user behaviors. They enhance interest modeling by capturing patterns in users’ historical interactions ( Hidasi et al. 2015 ; Zhou et al. 2018 ; Zhou et al. 2019 ; Pi et

Read the complete text