A Generative Re-ranking Model for List-level Multi-objective Optimization at Taobao
Yue Meng, Cheng Guo, Yi Cao, Tong Liu, Bo Zheng · 2025
Read A Generative Re-ranking Model for List-level Multi-objective Optimization at Taobao by Yue Meng, Cheng Guo, Yi Cao, Tong Liu, Bo Zheng (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-07197.txt.
Introduction
Yue Meng and four co-authors build a tool that reorders shopping lists for a large online store. Stores rank goods to lift clicks, sales, and total spend at once. Older methods score each item alone, which misses how items in a list sway each other and what the shopper wants right now. Reordering the whole list can fix that, but it must stay fast and keep the list varied.
Their model, called SORT-Gen, splits the task in two parts. A transformer first scores the worth of list chunks of any length across all goals. A fast search step then builds the final list from ranked queues with a spread rule built in. Live tests on a Taobao mini-app lifted clicks by about four percent and total spend by about eight percent. The gains count at platform scale.
Catalog record
| CREATOR | Yue Meng, Cheng Guo, Yi Cao, Tong Liu, Bo Zheng |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-07197
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Generative Re-ranking Model for List-level Multi-objective Optimization at Taobao Yue Meng, Cheng Guo, Yi Cao, Tong Liu, Bo Zheng Abstract . E-commerce recommendation systems aim to generate ordered lists of items for customers, optimizing multiple business objectives, such as clicks, conversions and Gross Merchandise Volume (GMV). Traditional multi-objective optimization methods like formulas or Learning-to-rank (LTR) models take effect at item-level, neglecting dynamic user intent and contextual item interactions. List-level multi-objective optimization in the re-ranking stage can overcome this limitation, but most current re-ranking models focus more on accuracy improvement with context. In addition, re-ranking is faced with the challenges of time complexity and diversity. In light of this, we propose a novel end-to-end generative re-ranking model named Sequential Ordered Regression Transformer-Generator (SORT-Gen) for the less-studied list-level multi-objective optimization problem. Specifically, SORT-Gen is divided into two parts: 1)Sequential Ordered Regression Transformer innovatively uses Transformer and ordered regression to accurately estimate multi-objective values for variable-length sub-lists. 2)Mask-Driven Fast Generation Algorithm combines multi-objective candidate queues, efficient item selection and diversity mechanism into model inference, providing a fast online list generation method. Comprehensive online experiments demonstrate that SORT-Gen brings +4.13% CLCK and +8.10% GMV for Baiyibutie, a notable Mini-app of Taobao. Currently, SORT-Gen has been successfully deployed in multiple scenarios of Taobao App, serving for a vast number of users. DOI: 10.1145/3726302.3731935 Conference: Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 13–18, 2025; Padua, Italy Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’25), July 13–18, 2025, Padua, Italy ISBN: 979-8-4007-1592-1/2025/07 CCS: Information systems Retrieval models and ranking 1. Introduction In e-commerce recommendation systems, it is essential to optimize multiple business objectives, such as clicks, conversions and Gross Merchandise Volume (GMV). Current practices adopt two paradigms. One involves designing a manually formula (e.g. CTR^{a}*CVR^{b}*price^{c} ), the other involves building a Learning-To-Rank (LTR) model that treat objectives as training features. Both merge multiple objectives into a single rank score based on weight parameters for greedy item sorting. Unreasonable weight settings negatively affect multiple objectives. To tackle this, various methods are proposed to identify the Pareto frontier and obtain Pareto optimal solutions ( Miettinen, 1998 ) . For the proposed formulation, optimization theory can be employed to determine the optimal weight parameters in an offline manner. Alternatively, bandit algorithms or reinforcement learning methods are utilized for online weight parameter searching. For stacking a LTR model, methods like Online Deep Controllable LTR (DC-LTR) ( Zeng et al., 2021 ) and Pareto Efficient LTR (PE-LTR) ( Lin et al., 2019 ) employ linear programming to dynamically adjust loss weights in conjunction with the ranking models ( Burges et al., 2005 ) ( Joachims et al., 2007 ) . These approaches which employ fixed weight parameters centered on item-level multi-objective optimization, give rise to two critical issues. First, dynamic user interests mismatch static objective weights. During the browsing process, user interests fluctuate dynamically within the session ( Xu et al., 2023 ) . For example, early positions may prioritize conversion, while later ones focus on exploratory clicks. Existing methods are limited in their ability to adapt to such granularity Second, item-level multi-objective optimization ignores contextual item interactions ( Ai et al., 2018 ) . Current approaches maximize cumulative item-level utility but disregard psychological and economic principles (e.g., anchoring, contrast effects). In reality, users’ decisions on one item depend on surrounding options. In a multi-stage recommendation system, the final stage known as re-ranking stage ( Liu et al., 2022 ) ( Pei et al., 2019 ) , is applied to address the above two limitations. However, current re-ranking models like PRM ( Pei et al., 2019 ) , Seq2Slate ( Bello et al., 2018 ) , DLCM ( Ai et al., 2018 ) and GRN ( Feng et al., 2021 ) focus on leveraging contextual information to improve accuracy but neglect list-level multi-objective optimization, which is actually a relatively less-studied problem. To the best of our knowledge, industry has only made some simple rule-based attempts in the re-ranking stage: 1) Combinatorial Efficiency. Directly evaluating all permutations of candidate lists ( O(n!) complexity) is infeasible for latency-sensitive systems. A straightforward approach would involve repeatedly calling the context-aware model for greedy item selection. Such iterative model calls introduce unacceptable overhead. 2) Accuracy-Diversity Trade-off ( Huang et al., 2021 ) ( Lin et al., 2022 ) ( Cheng et al., 2017 ) . Over-optimizing multi-objective scores risks homogenizing the list, degrading user experience ( Zhang and Hurley, 2008 ) . Compared to ranking, re-ranking shifts the modeling of user lifecycle interest to a list-level real-time interest. Ranking models like Deep Interest Network (DIN) ( Zhou et al., 2018 ) and Search-based User Interest Model (SIM) ( Pi et al., 2020 ) both use Attention mechanisms to encode behavior sequences. Recently, due to the popularity of Large Language Model (LLM), some generative models have directly employed Transformer to model user behavior sequences, such as Meta’s generative recommendation ( Zhai et al., 2024 ) . Re-ranking models are naturally suited to this generative architecture. To this end, we propose a novel generative re-ranking model named Sequential Ordered Regression Transformer-Generator (SORT-Gen) for joint list-level optimization in e-commerce feed recommendation, which consists of two main components. 1)Sequential Ordered Regression Transformer models real-time user intent via Transformer. It innovatively uses ordered regression to accurately predict multi-objective values for variable-length sub-lists. 2)Mask-Driven Fast Generation Algorithm provides an efficient online method for list generation. It eliminates iterative inference by integrating candidate cross-distribution and diversity into tensor operations. Mask matrices are deployed to guide item selection in one forward pass. To sum up, the main contributions of our work as follows: • We investigate less-studied list-level multi-objective optimization problem, which is significant in the industry. • We introduce SORT-Gen, an efficient generative re-ranking model, offering practical solutions for list-level multi-objective optimization on large-scale recommendation systems. • We conduct experiments on online A/B testing. Results prove that SORT-Gen brings huge benefits and has been deployed in multiple scenarios of Taobao App. 2. Problem Formula A typical recommendation system usually consists of three main stages, i.e., matching, ranking and re-ranking ( Wilhelm et al., 2018 ) . Denote the result from ranking stage as I=\left\{i_{1},i_{2},...,i_{l_{s}}\right\} with length l_{s} . Re-ranking aims to reorder I so as to return an optimal ordered list R^{*}=\left\{i^{*}_{1},i^{*}_{2},...,i^{*}_{l_{o}}\right\} , where l_{o} refers to actual length of recommendation results. In practice, l_{s} is always larger than l_{o} . Introducing the context C , when R^{\prime} is a potential reordering result, V_{click} , V_{conversion} and V_{GMV} represent the measurement of click value, conversion value and GMV value at list-level respectively, we can formally express re-ranking that integrates multi-objective optimization as follows: (1) R^{*}=argmax_{R^{\prime}}[\alpha*V_{click}(R^{\prime},C)+\beta*V_{conversion}(R^{\prime},C)+\gamma*V_{GMV}(R^{\prime},C)] where \alpha , \beta and \gamma represent the trade-offs at Pareto boundaries for commercial purposes. List value estimation with context is structured as a sequential incremental value accumulation approach. For example, V_{click} is expressed as: (2) V_{click}(R^{\prime},C)=v_{click}(i^{\prime}_{1})+v_{click}(i^{\prime}_{2}|[i^{\prime}_{1}])+...+v_{click}(i^{\prime}_{l_{o}}|[i^{\prime}_{1},...,i^{\prime}_{l_{o}-1}]) where v_{click} refers to item-level click-value at each step. 3. The Proposed Model Figure 1. An overview of the SORT-Gen framework. 3.1. Sequential Ordered Regression Transformer 3.1.1. Model Structure As illustrated in Fig.1(a), the SORT method employs real exposure item lists as training