Item Level Exploration Traffic Allocation in Large-scale Recommendation Systems DOI: XXXXXXX.XXXXXXX Conference: 18th ACM Conference on Recommender Systems ; October 14–18, 2024; Bari, Italy CCS: Information systems Recommender systems
Dong Wang, Junyi Jiao, Arnab Bhadury, Yaping Zhang, Mingyan Gao · 2025
Read Item Level Exploration Traffic Allocation in Large-scale Recommendation Systems DOI: XXXXXXX.XXXXXXX Conference: 18th ACM Conference on Recommender Systems ; October 14–18, 2024; Bari, Italy CCS: Information systems Recommender systems by Dong Wang, Junyi Jiao, Arnab Bhadury, Yaping Zhang, Mingyan Gao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-09033.txt.
Introduction
Dong Wang and four co-authors design a system that gives new items in a recommender a fair first chance, in a 2025 paper. Fresh content starts cold, with no viewing history. Without early exposure, good items can vanish unseen. Their system predicts each item's discoverability with a learned model. That forecast steers how exploration traffic is handed out.
Budgets adapt as evidence accumulates. The aim is long-term benefit for the whole platform. Deployment ran in a large production service. Cold starts became measurably more efficient there. New items reached audiences sooner and more often. The catalog available for regular recommendation grew richer as a result. The authors frame exploration as an investment problem. Spending impressions wisely early pays off in later engagement.
Catalog record
| CREATOR | Dong Wang, Junyi Jiao, Arnab Bhadury, Yaping Zhang, Mingyan Gao |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 12 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-09033
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Item Level Exploration Traffic Allocation in Large-scale Recommendation Systems DOI: XXXXXXX.XXXXXXX Conference: 18th ACM Conference on Recommender Systems ; October 14–18, 2024; Bari, Italy CCS: Information systems Recommender systems Dong Wang, Junyi Jiao, Arnab Bhadury, Yaping Zhang, Mingyan Gao Abstract . This paper contributes to addressing the item cold start problem in large-scale recommender systems, focusing on how to efficiently gain initial visibility for newly ingested content. We propose an exploration system designed to efficiently allocate impressions to these fresh items. Our approach leverages a learned probabilistic model to predict an item’s discoverability, which then informs a scalable and adaptive traffic allocation strategy. This system intelligently distributes exploration budgets, optimizing for the long-term benefit of the recommendation platform. The impact is a demonstrably more efficient cold-start process, leading to a significant increase in the discoverability of new content and ultimately enriching the item corpus available for exploitation, as evidenced by its successful deployment in a large-scale production environment. 1. Introduction Large-scale recommendation systems, with millions of new items uploaded daily, face the challenge of effectively recommending fresh content to billions of users due to the lack of initial engagement data. These systems, often based on machine learning, exhibit a feedback loop: models trained on past engagement data tend to favor already popular items, hindering the visibility and accumulation of engagement data for new content. This "item cold-start" problem is a well-known issue, e.g., ( Park and Chu 2009 ; Zhang et al. 2010 ) . Exploration, which involves providing initial exposure to new items, is a common approach to address the cold-start problem. By evaluating new items and introducing them to the main recommendation system (exploitation), exploration can help alleviate this issue ( Jadidinejad et al. 2020 ) . While exploration might incur a short-term engagement cost due to uncertainty surrounding new items, studies indicate it can expand the pool of recommendable content, benefiting users in the long run ( Chen 2021 ) . Numerous approaches exist to integrate exploration into retrieval or ranking algorithms ( Su et al. 2024 ) . In this paper, we focus on a dedicated exploration system that allocates traffic specifically for exploring fresh items. Within this dedicated traffic, new items compete only amongst themselves, not with the general content pool. We address the core problem of optimizing the allocation of billions of exploration impressions to millions of fresh items to maximize a specific positive outcome. This optimization is challenging due to variations in item quality, the need for scalability to handle daily fluctuations in fresh content, and adaptability to changes in the main recommendation system. We propose a generic approach that aims to solve this problem of traffic allocation for fresh items, ensuring efficiency, scalability, and adaptability in large-scale recommendation systems. 2. Problem Statement We are given a finite pool of N items (indexed i = 1, 2, …, N) and a total dedicated traffic budget T . The goal is to allocate this traffic across the items, exploring each item i up to a traffic level X_{i} , such that the total allocated traffic does not exceed the budget: (1) \sum_{i=0}^{N}X_{i}\leq T . The objective is to find the optimal traffic allocation X_{1} , X_{2} , …, X_{N} that maximizes the following cumulative metric: (2) \sum_{i=0}^{N}G_{i} , where G_{i} is a binary indicator function defined as: (3) G_{i}=\begin{cases}1&\text{if item is discoverable post exploration}\\ 0&\text{if item is NOT discoverable post exploration}\end{cases} . The desired outcome is defined as "discoverable post exploration". This concept is situated within the framework of exploration and exploitation. An item is classified as discoverable if it can be recommended a minimum number of times by the exploitation engine, signifying that the system has gained sufficient insights into potential user preferences. The exploration phase contributes to an item’s discoverability by gathering the initial data required for this understanding. Furthermore, we assume that exploring each item i incurs a cost C(X_{i}) , and we impose a constraint on the total cost: (4) \sum_{i=0}^{N}C(X_{i})\leq C_{max} . where C_{max} is the maximum allowable cost for exploration. 3. Analysis We begin by analyzing a simple exploration strategy where each item receives an equal allocation of traffic ( X_{i} = X_{o} for all i ), ensuring that X_{o} \leq T / N to satisfy the budget constraint (Equation 1 ). However, this approach has several shortcomings: • Inefficient exploration of popular items : Some items are inherently discoverable ( G_{i} = 1) regardless of exploration. Allocating traffic to these items only increases the cost C(X_{i})) without any gain in the objective function (Equation 2 ). • Inefficient exploration of low-quality items : Other items may remain undiscoverable ( G_{i} = 0) even after receiving the full allocated traffic X_{o} . This is often the case for low-quality items. Exploring such items needlessly consumes the exploration budget. • Potential under-exploration of promising items : There may exist items that would become discoverable if allocated slightly more traffic than X_{o} . These items represent a potentially favorable trade-off between the gain in discoverability and the associated cost. These observations highlight the potential for optimization by assigning different traffic levels based on item-specific characteristics. This leads to the following key question: Given a set of features describing item i , can we predict the minimum traffic level X_{i} required to make it discoverable? 4. Modeling 4.1. Formulation To predict the minimum traffic needed for item i to become discoverable, we propose a modeling approach based on experimental data collection. In this process, we explore each item up to a traffic level Y_{i} and observe the resulting discoverability ( G_{i} ). However, the challenge lies in the fact that Y_{i} does not necessarily equal X_{i} . In fact, any Y_{i} \geq X_{i} could result in G_{i} = 1. To address this, we introduce an intermediate modeling problem that aligns better with our data collection process: Given the features of item i and a traffic level Y_{i} , what is the probability that the item will become discoverable (i.e., P(G_{i}=1|Y_{i}) )? This is formulated as a classification problem. Once we have learned P(G_{i}=1|Y_{i}) , we can determine X_{i} by setting a desired confidence level CF and solving the following equation: (5) P(G_{i}=1|X_{i})=CF. Here, CF represents the probability of achieving discoverability when allocating X_{i} traffic to item i . 4.2. Model Architecture Figure 1. Model architecture for predicting P(G_{i}=1|Y_{i}) . $Y_i$ can be any integer, but for modeling purpose here we discretize $Y_i$. The probability condition $Y_i$ bucket is fed into the model as a discrete feature. To model P(G_{i}=1|Y_{i}) , we employ a standard classification approach with cross-entropy loss. The model utilizes various item metadata that could be predictive of discoverability. Furthermore, we leverage engagement data collected during exploration to enhance model performance. Recognizing the influence of Y_{i} on P(G_{i}=1|Y_{i}) , we discretize Y_{i} into buckets and experiment with different ways of incorporating it into the model: • Direct concatenation with other item features. • Concatenation at intermediate layers within the model. • Attention mechanisms between Y_{i} and other features.. We acknowledge that during serving time, features may become available at different stages, and we can trigger multiple inferences to refine the prediction. 4.3. Example Output Figure 2. An example model