Towards End-to-End Alignment of User Satisfaction via Questionnaire in Video Recommendation CCS: Information systems Recommender systems
Na Li, Jiaqi Yu, Minzhi Xie, Tiantian He, Xiaoxiao Xu, Zixiu Wang, Lantao Hu, Yongqi Liu, Han Li, Kaiqiao Zhan, Kun Gai · 2026
Read Towards End-to-End Alignment of User Satisfaction via Questionnaire in Video Recommendation CCS: Information systems Recommender systems by Na Li, Jiaqi Yu, Minzhi Xie, Tiantian He, Xiaoxiao Xu, Zixiu Wang, Lantao Hu, Yongqi Liu, Han Li, Kaiqiao Zhan, Kun Gai (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-20215.txt.
Introduction
Na Li and eleven colleagues work on a gap in short-video recommendation. Systems rank videos by clicks and watch time, but those signals only proxy what users truly feel. Noise and bias creep in, so a video can rank high while leaving viewers unsatisfied. The authors aim to align ranking with user satisfaction itself.
Their route uses questionnaires to measure satisfaction directly, and to tie that measure into the ranking goal end to end. Honest satisfaction signals could reduce the push toward mere engagement. For platforms with huge user bases, even small gains in real satisfaction matter for trust and long-term use.
Catalog record
| CREATOR | Na Li, Jiaqi Yu, Minzhi Xie, Tiantian He, Xiaoxiao Xu, Zixiu Wang, Lantao Hu, Yongqi Liu, Han Li, Kaiqiao Zhan, Kun Gai |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-20215
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Towards End-to-End Alignment of User Satisfaction via Questionnaire in Video Recommendation CCS: Information systems Recommender systems Na Li, Jiaqi Yu, Minzhi Xie, Tiantian He, Xiaoxiao Xu, Zixiu Wang, Lantao Hu, Yongqi Liu, Han Li, Kaiqiao Zhan, Kun Gai Abstract . Short-video recommender systems typically optimize ranking models using dense user behavioral signals, such as clicks and watch time. However, these signals are only indirect proxies of user satisfaction and often suffer from noise and bias. Recently, explicit satisfaction feedback collected through questionnaires has emerged as a high-quality direct alignment supervision, but is extremely sparse and easily overwhelmed by abundant behavioral data, making it difficult to incorporate into online recommendation models. To address these challenges, we propose a novel framework which is towards E nd-to-End A lignment of user S atisfaction via Q uestionaire, named EASQ , to enable real-time alignment of ranking models with true user satisfaction. Specifically, we first construct an independent parameter pathway for sparse questionnaire signals by combining a multi-task architecture and a lightweight LoRA module. The multi-task design separates sparse satisfaction supervision from dense behavioral signals, preventing the former from being overwhelmed. The LoRA module pre-inject these preferences in a parameter-isolated manner, ensuring stability in the backbone while optimizing user satisfaction. Furthermore, we employ a DPO-based optimization objective tailored for online learning, which aligns the main model outputs with sparse satisfaction signals in real time. This design enables end-to-end online learning, allowing the model to continuously adapt to new questionnaire feedback while maintaining the stability and effectiveness of the backbone. Extensive offline experiments and large-scale online A/B tests demonstrate that EASQ consistently improves user satisfaction metrics across multiple scenarios. EASQ has been successfully deployed in a production short-video recommendation system, delivering significant and stable business gains. 1. Introduction Short-video sharing platforms have witnessed explosive growth, making recommender systems a critical component that directly impacts user experience and drives the platform’s commercial success ( 39 ; 35 ; 33 ) . In particular, ranking models ( 1 ; 28 ; 23 ; 40 ; 31 ) play a central role by selecting the most suitable content from a set of candidates, aiming to maximize user satisfaction. To achieve this, models rely on carefully designed optimization objectives, which directly shape the final ranking. Most existing ranking models are trained on relatively dense and easily collected user behavioral signals, such as clicks and watch time ( 41 ; 40 ; 23 ; 15 ; 36 ) . However, these signals are only proxy indicators of user satisfaction. Because users express their satisfaction in different ways, these proxies can be noisy or biased, resulting in suboptimal model performance. Although some prior studies (e.g., EMER ( 13 ) ) attempt to incorporate relative satisfaction to refine the supervision signal, the majority of methods still lack direct supervision indicating whether users are truly satisfied. To better understand and improve user satisfaction, recommender systems have begun to introduce questionnaires ( 36 ; 2 ) . Questionnaires require users to provide explicit, direct satisfaction signals, which can then provide a high-quality optimization objective for ranking model. However, such signals are extremely sparse in real world, and they are easily overwhelmed by a large amount of behavioral signals under conventional training. Based on data collected from our real-world recommendation environment, questionnaires are issued for only about 0.5% of total video views. Moreover, with a click-through rate of less than 2%, only a tiny fraction of questionnaires yield valid responses, making satisfaction signals extremely sparse and difficult to leverage for effective training. Existing research has made various attempts to mitigate the problem of sparse satisfaction signals. SAQRec ( 36 ) designs a satisfaction model to predict user satisfaction levels. Within the reinforcement learning framework, reward shaping ( 9 ; 20 ) is used to address the problem of sparse rewards. However, these methods rely on offline-trained auxiliary models or pre-defined reward functions, which are then plugged into online or reinforcement learning frameworks. This two-stage paradigm limits the ability of the system to continuously adapt to new questionnaire feedback in an online manner. Inspired by recent advances in preference optimization and alignment in large language models ( 24 ; 22 ; 6 ) , we seek to achieve end-to-end alignment of ranking model outputs with true user satisfaction in an online learning setting. To overcome these issues, we develop a framework named EASQ , short for E nd-to-End A lignment of user S atisfaction via Q uestionnaire, aiming to achieve real-time alignment between ranking models and true user satisfaction. Specifically, we first establish a decoupled multi-task architecture with independent expert networks for main task and satisfaction alignment task. At the backbone’s lower layers, we introduce a lightweight LoRA module to pre-inject semantic preferences during the embedding stage while preventing sparse questionnaire signals from being overwhelmed by abundant behavioral data. Through the coordination between the lower-level LoRA and the upper-level expert networks, an independent parameter pathway is created for sparse questionnaire signals. Furthermore, considering the synchronous updates inherent in online learning, we treat the questionnaire expert network as an online surrogate of a reference model and employ DPO to further align the main model with the sparse questionnaire signals. EASQ enables end-to-end integration of sparse satisfaction signals in an online learning setting, resulting in ranking models that are directly aligned with real user satisfaction. Our contributions are summarized as follows: • We propose EASQ , the first framework to directly integrate sparse questionnaire-based satisfaction signals into online learning. The framework constructs an independent parameter pathway, enabling real-time alignment of ranking models with true user satisfaction. • We design a multi-task modeling mechanism with a lightweight LoRA module at the backbone’s lower layers and dedicated expert networks, along with a DPO-based optimization objective, enabling effective alignment of sparse satisfaction signals while preserving the backbone’s stability and capturing human value judgments. • We conduct extensive system experiments and online A/B testing on large-scale industrial data to verify the effectiveness of the proposed framework, and it is stably integrated into a real online recommendation system, demonstrating significant business benefits. 2. Related Work 2.1. User Satisfaction User satisfaction, which serves as the core metric for evaluating recommendation quality, has attracted widespread attention in recent years. Some studies ( 34 ; 3 ; 5 ) attempt to characterize user satisfaction using behavioral signals that are closer to users’ real experiences. For example, BatchRL-MTF ( 37 ) adopts dwell time and the positive-interaction rate as proxy signals for long-term satisfaction. PDA ( 38 ) argues that explicit “like” feedback is more closely aligned with satisfaction objectives than clicks. EMER ( 13 ) addresses the difficulty of quantifying absolute satisfaction by defining relative satisfaction based on posterior behavioral feedback and optimizing AUC. While these approaches can partially improve user experience, they rely on indirect signals and therefore struggle to accurately capture users’ true subjective feelings. Another line of work focuses on directly collecting explicit satisfaction data to obtain higher-quality supervision signals. Imputation Network ( 9 ) requires users to provide explicit ratings for consumed content. Several studies, including SAQRec ( 36 ) and prior work from Google ( 8 ) , collect users’ subjective satisfaction through questionnaires and demonstrate that explicit survey signals better align