Constraint-Aware Generative Re-ranking for Multi-Objective Optimization in Advertising Feeds
Chenfei Li, Hantao Zhao, Weixi Yao, Ruiming Huang, Rongrong Lu, Geng Tian, Dongying Kong · 2026
Read Constraint-Aware Generative Re-ranking for Multi-Objective Optimization in Advertising Feeds by Chenfei Li, Hantao Zhao, Weixi Yao, Ruiming Huang, Rongrong Lu, Geng Tian, Dongying Kong (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-04227.txt.
Introduction
Li and others propose constraint-aware making re-ranking for multi-objective tuning in advertising feeds. They propose a constraint-aware making reranking method transforming constrained tuning into bounded neural decoding. Unlike earlier methods separating generator and evaluator models, their method merges sequence output and reward gauging in a single network. They further add constraint-aware reward pruning, which builds constraint satisfaction straight into decoding to efficiently produce optimal sequences.
Catalog record
| CREATOR | Chenfei Li, Hantao Zhao, Weixi Yao, Ruiming Huang, Rongrong Lu, Geng Tian, Dongying Kong |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 27826 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.04227
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Constraint-Aware Generative Re-ranking for Multi-Objective Optimization in Advertising Feeds Chenfei Li, Hantao Zhao, Weixi Yao, Ruiming Huang, Rongrong Lu, Geng Tian, Dongying Kong Abstract Optimizing reranking in advertising feeds is a constrained combinatorial problem, requiring simultaneous maximization of platform revenue and preservation of user experience. Recent generative ranking methods enable listwise optimization via autoregressive decoding, but their deployment is hindered by high inference latency and limited constraint handling. We propose a constraint-aware generative reranking framework that transforms constrained optimization into bounded neural decoding. Unlike prior approaches that separate generator and evaluator models, our framework unifies sequence generation and reward estimation into a single network. We further introduce constraint-aware reward pruning, integrating constraint satisfaction directly into decoding to efficiently generate optimal sequences. Experiments on large-scale industrial feeds and online A/B tests show that our method improves revenue and user engagement while meeting strict latency requirements, providing an efficient neural solution for constrained listwise optimization. 1 Introduction In modern feed-based recommendation systems, the final stage is commonly referred to as the reranking stage, where a mixed list of organic content (recommendations) and sponsored content (advertisements) is presented to users. A common industrial practice dynamically inserts advertisements into a pre-ranked organic feed. While organic ranking aims to maximize user engagement and long-term experience, ad ranking optimizes expected platform revenue. Consequently, reranking becomes a full-page multi-objective maximization problem [ 1 ] . Due to business and policy requirements, ad insertion must satisfy strict constraints, including position constraints (e.g., preventing overly dense ad placements) and load constraints (e.g., limiting ads to at most x\% of the page). Prior work addresses adaptive ad exposure under hierarchical constraints using dynamic knapsack-style optimization [ 2 ] . With the widespread adoption of deep learning recommendation models (DLRMs), various reranking approaches have been proposed, such as Personalized Re-ranking Models (PRM) [ 3 ] . These methods leverage contextual signals to improve ranking accuracy. More advanced approaches optimize listwise objectives by explicitly modeling inter-item dependencies and capturing real-time user preferences. In industrial systems, reranking is often implemented as a two-stage Generator–Evaluator (GE) framework: a generator proposes candidate sequences, and an evaluator estimates list-level utility for final selection. Although effective, this separation increases inference overhead and complicates constraint enforcement. Recently, generative recommenders [ 4 ] have reframed reranking as a sequence generation problem. Autoregressive listwise optimization has been explored for multi-objective optimization [ 5 ] , while non-autoregressive models aim to reduce decoding latency [ 6 ] . Flow-based generative approaches further enable global sequence modeling [ 7 ] . However, in heterogeneous feeds containing both organic and sponsored content, reranking must simultaneously address multi-objective optimization, inference latency, and constraint-aware ad allocation. Motivated by these challenges, we propose a Constraint-Aware Generative Re-ranking (CGR) framework, which transforms constrained combinatorial optimization into bounded autoregressive decoding solvable within a single neural inference pass. To the best of our knowledge, this is the first work that integrates policy-level constraints directly into autoregressive decoding to obtain optimal constrained sequences in generative reranking. CGR consists of two key components. First, a variable-length listwise autoregressive training network models multi-objective user intent through attention mechanisms and multi-channel mixture-of-experts (MoE) modules, enabling context-aware and interest-aware representation learning. Second, during inference, a constraint-aware reward network generates and evaluates candidate sequences. Inspired by masked tensor propagation strategies similar to M-FALCON [ 4 ] , we amortize decoding cost through structured masking and further improve efficiency via reward-based pruning, enabling fast and optimal constrained sequence generation. 2 Related Work 2.1 Reranking and Listwise Optimization Reranking serves as the final stage of industrial recommendation systems, where a ranked list is refined to optimize downstream objectives. Early approaches focus on pointwise or pairwise ranking models, while more advanced methods adopt listwise optimization to explicitly model inter-item dependencies. Personalized Re-ranking Models (PRM) [ 3 ] incorporate contextual features to improve ranking accuracy. Subsequent work such as DLCM and Seq2Slate leverages recurrent or attention-based architectures to capture list-level interactions. These methods primarily optimize user engagement metrics but do not explicitly address heterogeneous content allocation or business constraints. In advertising feeds, reranking becomes a multi-objective optimization problem balancing user experience and revenue. [ 1 ] formulates feed advertising as a constrained optimization problem. [ 2 ] further introduces hierarchical exposure control under practical business constraints. However, these approaches typically rely on explicit combinatorial solvers rather than neural sequence generation. 2.2 Generative Recommendation and Autoregressive Ranking Recently, generative recommenders have reframed ranking as a sequence generation task. [ 4 ] demonstrates the scalability of large sequential transducers for generative recommendation. Autoregressive reranking has been applied to multi-objective optimization in industrial settings [ 5 ] . Generative Flow Networks (GFN) [ 7 ] model the distribution over ranked lists through flow-based objectives. Non-autoregressive generative models [ 6 ] aim to reduce decoding latency by parallel prediction. Despite their success, most generative ranking methods suffer from two limitations: (1) decoding latency grows with sequence length, and (2) constraint handling is typically external to the decoding process. Business rules such as advertisement load constraints are often enforced through post-processing heuristics. 2.3 Constrained Allocation in Advertising Systems Advertising allocation in feeds has been extensively studied under constrained optimization frameworks. Dynamic programming and knapsack-style solvers are widely adopted to satisfy load and spacing constraints [ 2 , 1 ] . These approaches provide theoretical guarantees but require explicit enumeration or approximate solvers, which complicates integration with deep neural ranking models. In practice, many industrial systems adopt a Generator–Evaluator (GE) paradigm, where a generator proposes candidate sequences and an evaluator estimates list-level utility. Although effective, this two-stage separation increases inference overhead and makes constraint enforcement less efficient. 2.4 Our Contribution Our work bridges generative ranking and constrained allocation. We transform constrained combinatorial optimization into bounded autoregressive decoding. Unlike prior GE-based systems, we unify sequence generation and reward estimation into a single network. Furthermore, constraint-aware reward pruning integrates constraint satisfaction directly into decoding, providing an efficient neural solution with theoretical optimality guarantees under bounded structural assumptions. To our knowledge, this is the first work that embeds policy-level advertisement constraints directly into autoregressive generative reranking to obtain globally optimal constrained sequences in production-scale advertising feeds. 3 Problem Formulation We formulate advertising feed reranking as a constrained combinatorial optimization problem. 3.1 Candidate Set Let \mathcal{X}=\{x_{1},x_{2},\dots,x_{N}\} (1) denote the candidate pool for a given user request, where items consist of: • Organic content (natural recommendations) • Sponsored advertisements Each item x_{i} is associated with feature representation including user context, item features, and positional encoding. 3.2 Ranking Sequence A ranking sequence is defined as an ordered list: A=(a_{1},a_{2},\dots,a_{L}), (2) where L is the page size and a_{j}\in\mathcal{X} . Let \mathcal{S} denote the space of all possible permutations: \mathcal{S}=\text{Perm}(\mathcal{X}). (3) In the unconstrained case, |\mathcal{S}|=N! , which is intractable for real-time inference. 3.3 List-Level Reward The objective of reranking is to maximize a list-level reward function: R(A)=f_{\theta}(A), (4) where f_{\theta}(\cdot) is a neural model estimating multi-objective utility including: • Advertising revenue • User engagement • Experience penalty Concretely, the reward is defined as: R(A)=\sum_{i=1}^{L}\left(V_{i}+N_{i}-P_{i}\right), (5) where V_{i} denotes monetization value, N_{i} denotes engagement benefit, and P_{i} denotes advertisement exposure penalty. 3.4 Business Constraints Industrial advertising feeds impose strict structural constraints. (1) Advertisement Load Constraint Let \#Ad(A) denote the number of ads