Algorithm Adaptation Bias in Recommendation System Online Experiments Conference: October, 2025; ;

Chen Zheng, Zhenyu Zhao · 2025

Read Algorithm Adaptation Bias in Recommendation System Online Experiments Conference: October, 2025; ; by Chen Zheng, Zhenyu Zhao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-00199.txt.

Introduction

Chen Zheng and Zhenyu Zhao name and study algorithm adaptation bias in online recommender experiments in 2025. A/B tests are the gold standard for launch choices, yet many biases can skew their results. Adaptation bias stems from the flywheel among live models, user data, and training pipelines.

A new model is judged on user data shaped by the incumbent system, or only in a small test group. Its measured effect can thus diverge far from its true effect at full launch. In practice, tests favor the high-traffic live variant and underrate the small-traffic test variant. That skew can cause teams to miss real gains and launch the wrong variant.

Catalog record

CREATORChen Zheng, Zhenyu Zhao
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE16 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-00199

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Algorithm Adaptation Bias in Recommendation System Online Experiments Conference: October, 2025; ; Chen Zheng, Zhenyu Zhao Abstract . Online experiments (A/B tests) are widely regarded as the gold standard for evaluating recommender system variants and guiding launch decisions. However, a variety of biases can distort the results of the experiment and mislead decision-making. An underexplored but critical bias is algorithm adaptation effect . This bias arises from the flywheel dynamics among production models, user data, and training pipelines: new models are evaluated on user data whose distributions are shaped by the incumbent system or tested only in a small treatment group. As a result, the measured effect of a new product change in modeling and user experience in this constrained experimental setting can diverge substantially from its true impact in full deployment. In practice, the experiment results often favor the production variant with large traffic while underestimating the performance of the test variant with small traffic, which leads to missing opportunities to launch a true winning arm or underestimating the impact. This paper aims to raise awareness of algorithm adaptation bias, situate it within the broader landscape of RecSys evaluation biases, and motivate discussion of solutions that span experiment design, measurement, and adjustment. We detail the mechanisms of this bias, present empirical evidence from real-world experiments, and discuss potential methods for a more robust online evaluation. 1. Introduction Recommender systems (RecSys) are central to user experiences on major digital platforms, determining the content, products, or connections users encounter ( Knight and Columbia 2023 ) . Online experiments, particularly A/B tests, are the standard approach for evaluating algorithmic changes, aiming to estimate causal effects on engagement and business metrics through randomized treatment assignment. This setup is based on the stable unit treatment value assumption (SUTVA) ( Imbens and Rubin 2015 ) , which assumes that there is no interference between the units and a consistent treatment application. Although prior work has explored SUTVA violations in networked or adaptive settings ( Zhu et al. 2024 ; Karrer et al. 2021 ; Saint-Jacques et al. 2019 ; Kohavi et al. 2020 ) , a subtle yet pervasive source of bias remains underexplored: algorithm adaptation effect . In typical experiments, a small user segment receives the new model, while the majority remains under the incumbent system. However, user behavior, content popularity, and creator incentives are shaped by the production model, forming a feedback loop that also informs training data for future models. As a result, treatment variants can underperform in limited-rollout experiments, not due to inferior quality, but because they fail to trigger dynamics such as content virality, creator adaptation, or sufficient data accumulation. This misalignment causes bias: the measured treatment effect no longer reflects the true causal effect of full deployment. The bias often favors the dominant-traffic variant (typically the control), leading to understated impact or missed opportunities for beneficial launches. Examples of affected experiments include: (1) algorithmic changes in retrieval or ranking (e.g., adding high-value actions to ranking objectives) and (2) UI modifications that influence content presentation (e.g., thumbnails or metadata). This paper makes the following contributions: • Formalizes the algorithm adaptation effect within the broader taxonomy of RecSys evaluation biases. • Presents empirical evidence from real-world experiments. • Proposes experimental and analytical techniques for more robust measurement. • Outlines future directions for better detection and mitigation. 2. Background and Related Work Our focus is on algorithm adaptation bias in measuring treatment effects from online experiments. While related, this is distinct from the broader literature on algorithmic bias in recommender systems, which examines structural sources of bias such as popularity, selection, exposure, and position bias ( Boratto and Marras 2020 ; Stinson 2022 ; Abdollahpouri et al. 2022 ) . These biases can degrade recommendation quality, reinforce inequality, and lead to misalignment between offline and online performance ( Redgate and Smith 2023 ) . • Popularity Bias : Tendency to overrecommend popular items, reducing visibility for niche or long-tail content ( Abdollahpouri et al. 2022 ) . • Selection Bias : Recommendations shape the observed feedback, creating self-reinforcing loops ( Stinson 2022 ) . • Exposure Bias : Unshown items receive little or no feedback, limiting learning and visibility. • Position/Presentation Bias : UI affects user attention and interaction, such as higher-ranked items get more clicks, regardless of relevance. Although algorithmic bias is well studied, the challenge of algorithm adaptation bias - where experimental outcomes are distorted by the embedded feedback loops of the production system - remains underexplored. A more adjacent area is experimentation bias in networked or interactive environments, particularly on social platforms ( Zhu et al. 2024 ; Karrer et al. 2021 ; Saint-Jacques et al. 2019 ; Kohavi et al. 2020 ) . However, such work rarely addresses the bias introduced by adaptive recommender systems specifically. 3. Algorithm Adaptation Bias in Online Experiments 3.1. Formulation We study the setting in which a platform currently implements a production recommendation policy \pi_{0} and evaluates a candidate policy \pi_{1} through an online A / B test with a (typically small) share of treatment \rho\in(0,1) . Let Y denote a primary outcome of interest (e.g., revenue, retention, click through rate or play through rate, deep engagement). Because recommendation policies shape the data distribution they are trained and evaluated on (via user behavior, creator incentives, content supply, etc.), deploying \pi_{1} only on a small fraction of traffic does not induce the same user–item distribution that would arise if \pi_{1} were fully launched. Consequently, the standard difference-in-means estimator in the experiment targets an estimand that can differ systematically from the platform’s policy-level causal effect under a full rollout. Target (policy-level) estimand. Let \mathcal{D}(\pi) denote the stationary / equilibrium distribution of users, items, and contexts that emerges when policy \pi is deployed platform-wide. 1 1 1 Formally, one can view \mathcal{D}(\pi) as the distribution induced by the data-generating process (users, creators, ranking, feedback, re-training, etc.) under the stable deployment of \pi ; see also performative prediction ( Perdomo et al. 2020 ) and causal interference frameworks ( Hudgens and Halloran 2008 ; Imbens and Rubin 2015 ; Eckles et al. 2017 ; Karrer et al. 2021 ) . The policy-level ATE we care about is (1) \tau^{\star}\;=\;\mathbb{E}_{\mathcal{D}(\pi_{1})}[Y(\pi_{1})]-\mathbb{E}_{\mathcal{D}(\pi_{0})}[Y(\pi_{0})]. This is the effect we would obtain by replacing \pi_{0} with \pi_{1} for the entire population (and letting the system re-equilibrate). Experimental estimand under a partial rollout. In the online experiment, only a fraction \rho of the population is exposed to \pi_{1} , while the remaining 1-\rho continues to interact with \pi_{0} . Let \Pi_{\rho} denote the mixture deployment (control on 1-\rho , treatment on \rho ). Let \mathcal{D}_{\rho} be the induced distribution of users, items, and contexts under \Pi_{\rho} (this generally differs from both \mathcal{D}(\pi_{0}) and \mathcal{D}(\pi_{1}) because users, items, and creators interact across variants). The standard difference-in-means estimand is (2) \tau_{\text{exp}}(\rho)\;=\;\mathbb{E}_{\mathcal{D}_{\rho}}\!\left[\,Y(\pi_{1})\mid Z=1\,\right]-\mathbb{E}_{\mathcal{D}_{\rho}}\!\left[\,Y(\pi_{0})\mid Z=0\,\right], where Z\in\{0,1\} is the treatment assignment. When there is no interference or feedback-loop adaptation, \mathcal{D}_{\rho} factors and \tau_{\text{exp}}(\rho) coincides with \tau^{\star} . In RecSys, however, both user behavior and supply-side responses are shaped by the dominant policy, violating SUTVA ( Imbens and Rubin 2015 ) and inducing interference ( Hudgens and Halloran 2008 ; Karrer et al. 2021 ; Eckles et al. 2017

Read the complete text