Preference Measurement Error, Concentration in Recommendation Systems, and Persuasion
Andreas Haupt · 2025
Read Preference Measurement Error, Concentration in Recommendation Systems, and Persuasion by Andreas Haupt (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-16972.txt.
Introduction
Andreas Haupt studies how noisy preference reading skews recommendations in a 2025 paper. Recommendation systems guess what users like from imperfect signals. He asks what that guessing does to market concentration. Concentration means whether attention piles onto few products or spreads widely.
His model splits users into a majority type and a minority type. A noisy test reveals each user's type only imperfectly. The setup becomes a persuasion problem in formal terms. Persuasion here means choosing what information to reveal strategically. Under fully general noise, effects on concentration can go either way. Under symmetric noise, concentration provably rises. Consumer welfare also becomes more unequal between the groups. The paper gives platforms a clearer picture of hidden recommendation costs.
Catalog record
| CREATOR | Andreas Haupt |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 28 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-16972
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Preference Measurement Error, Concentration in Recommendation Systems, and Persuasion Thanks: I thank Chara Podimata and Dylan Hadfield-Menell for many discussions about recommendation systems, Sendhil Mullainathan for nudging me to think about the role of noisy observations in Economics more broadly, and seminar audiences at MIT and CMU for helpful feedback. Andreas Haupt Abstract Algorithmic recommendation based on noisy preference measurement is prevalent in recommendation systems. This paper discusses the consequences of such recommendation on market concentration and inequality. Binary types denoting a statistical majority and minority are noisily revealed through a statistical experiment. The achievable utilities and recommendation shares for the two groups can be analyzed as a Bayesian Persuasion problem. While under arbitrary noise structures, effects on concentration compared to a full-information market are ambiguous, under symmetric noise, concentration increases and consumer welfare becomes more unequal. We define symmetric statistical experiments and analyze persuasion under a restriction to such experiments, which may be of independent interest. 1 Introduction Personalized experiences are ubiquitous in our everyday lives. From movie recommendations (e.g., Netflix and Hulu) to micro-blogs (e.g., TikTok, X, and Mastodon) and e-commerce (e.g., Amazon and Mercado Libre), people turn to these recommendation systems to select entertainment, information, and products. For example, a recent study by Gomez-Uribe & Hunt 2016 revealed that 80\% of the approximately 160 million hours of video streamed on Netflix were recommended by the service’s recommendation system. Personalized experiences are optimized based on feedback from consumers. Algorithms choose what consumers see, and in response, the consumer decides whether and how to engage with this recommended content. From this engagement, the system receives information about the consumer’s preferences in the form of likes, comments, and shares, as well as information on what the consumer engages with. In a classical recommendation system, a consumer’s recommendations are based on signals \sigma , \sigma(\theta)=\theta+\varepsilon(\theta) where \theta\in\mathbb{R}^{d} is a consumer type, and \varepsilon(\theta)\sim F\in\Delta(\mathbb{R}^{d}) is a measurement error. A personalization algorithm will select content x\in X to maximize consumer welfare u(x;\theta) , while undoing the effect of noise. We are interested in the effect of such measurement noise on concentration equality. Consider two types \theta_{\textsc{maj}} and \theta_{\textsf{min}} , which each have a preferred outcome x_{\textsc{maj}} resp. x_{\textsf{min}} . There are less minority agents, \mathbb{P}[\theta_{\textsf{min}}]=\alpha<\frac{1}{2} . This is the simple setting of the paper, and allows us to reason about the impacts of preference measurement noise. How does \alpha compare to \mathbb{P}[x=x_{\textsf{min}}] ? How does utility compare under noise and no noise? We will close the model below, and fully characterize each of them. One might think that recommendation will favour statistical majorities, as under noise the prior will be more highly weighted, favouring the majority type, hence increasing concentration and inequity. The main observation of this paper is to add nuance to this: The intuition is correct if \varepsilon(\theta) does not depend on \theta (that is, errors are homoskedastic), concentration and inequality in consumer welfare are increased through preference measurement noise. However, under general noise structures, the intuition is misleading. Specifically, even under binary utilities and a general noise structure content may be recommended for any fraction from zero until twice the minority prevalence. Minority welfare might be higher than majority welfare. The main assumption is that minority preference measurements may be significantly more accurate than preference measurements for the majority. Related Work Our literature relates to the popularity bias in recommendation systems. Popularity bias ( Abdollahpouri 2019 ) is a statistical bias arising from not correcting for propensity in recommending content. The problem of recommending based on little data on the consumer is called the cold start and is solved with active exploration techniques ( Safoury & Salah 2013 ; Zheng et al. 2017 ) . Some papers explicitly consider recommendations for small statistical minorities, which are called grey sheep consumers ( Alabdulrahman & Viktor 2021 ; Zheng et al. 2017 ) . Additionally, the present work is related to studies of personalization where consumers choose different strategies to improve their recommendation to a platform ( Eslami et al. 2016 ; Lee et al. 2022 ; Klug et al. 2021 ; Simpson et al. 2022 ; Haupt et al. 2023 ; Cen et al. 2024 ; Cen et al. 2024a ) . We take measurement noise as a given, and consider the impacts on market concentration and consumer utilities. We also relate to a literature in industrial organization on recommendation systems. The simulation study Calvano et al. 2023 considers a two-sided market with a personalization algorithm. The paper’s simulations feature significant measurement error— Calvano et al. 2023 defines noise due to measurement error twice as large as their heterogeneity among consumers. More broadly, our study can be seen as contributing to a conversation on mass vs. niche content. Anderson 2006 argues that algorithms help a long tail, that is, very infrequently bought, items to rise to prominence. Fleder & Hosanagar 2009 takes the opposite perspective and points out additional concentration. We conclude that measurement error may or may not increase concentration, depending on how symmetric the noise is. We also relate to a literature in game theory and behavioral economics. Similarly, the notion of quantal response equilibrium (QRE), McKelvey & Palfrey 1995 relies on players observing a utility shock, optimizing based on it, but not observing other agent’s utility shocks. Our model does not consider random utility shocks, but preference measurement error. Our model also relates to models of mechanism design with complex statistical types ( Cai & Daskalakis 2022 ; Parkes et al. 1998 ; Parkes & Ungar 2000 ) . In contrast to these models, we do not allow the algorithm to decide on queries to the consumer, but we take measurement error as a primitive of the environment. Finally, our preference measurement error can be interpreted as a behavioral imperfection, and actions from consumers to improve signaling as sophisticated behavior, compare Laibson 1997 ; O’Donoghue & Rabin 1999 ; O’Donoghue & Rabin 2001 . Finally, this work relates to algorithmic fairness. In particular, our comparison of the market share of minority content compared to the minority’s incidence is mathematically equivalent to the recommendation algorithm’s calibration gap ( Pleiss et al. 2017 ) . Our result on the incompatibility of fairness and efficiency, Theorem 1 , can hence be interpreted as an instance of the incompatibility of accuracy and calibration. To achieve calibration in recommendation, Steck 2018 formalizes item-level calibration. Recommendations are item-level calibrated if the consumer sees items in a proportion that they consumed them in the past. Our results differ in that we consider the population-level distribution of recommendation. Our techniques make use of (and our Propositions have corresponding results in) the literature on information design and Bayesian persuasion, compare Bergemann & Morris 2019 . In fact, our model is mathematically equivalent to the classical Bayesian Persuasion model ( Kamenica & Gentzkow 2011 ) , but with a very different interaction. 1 1 1 The correspondence is to identify the majority type with the innocent state of the world, the minority type with the guilty state of the world, allocation of majority content with the acquittal action, allocation of minority content with a conviction action, measurement error with the investigation, the judge with the personalization algorithm,