Markets with Heterogeneous Agents: Dynamics and Survival of Bayesian vs. No-Regret Learners

David Easley, Yoav Kolumbus, Éva Tardos · 2025

Read Markets with Heterogeneous Agents: Dynamics and Survival of Bayesian vs. No-Regret Learners by David Easley, Yoav Kolumbus, Éva Tardos (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-08597.txt.

Introduction

David Easley, Yoav Kolumbus, and Éva Tardos compare learning styles in asset markets in a paper from 2025. The catalog title carries a proceedings note, but the head title is clean, and the description follows the head. Bayesian learners update beliefs from a prior, while no-regret learners just minimize past mistakes. The authors link market survival ideas from economics with regret theory from computer science. A surprise emerges: very low regret does not guarantee survival.

A Bayesian rival with the true model in its prior can still drive a low-regret agent out. Yet Bayesian learning is fragile when its prior misses. Two hybrid strategies blend both styles for robustness. The work speaks to how mixed algorithms behave in real markets.

Catalog record

CREATORDavid Easley, Yoav Kolumbus, Éva Tardos
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE108 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-08597

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Markets with Heterogeneous Agents: Dynamics and Survival of Bayesian vs. No-Regret Learners Thanks: An earlier version of this paper appeared in the Proceedings of EC 2025; DOI: 10.1145/3736252.3742595 . David Easley, Yoav Kolumbus, Éva Tardos Abstract We analyze the performance of heterogeneous learning agents in asset markets with stochastic payoffs. Our main focus is on comparing Bayesian learners and no-regret learners who compete in markets and identifying the conditions under which each approach is more effective. We formally relate the notions of survival and market dominance studied in economics and the framework of regret minimization, thereby bridging these theories. A central finding is that regret plays a key role in market selection, but low regret alone does not guarantee survival: surprisingly, an agent may achieve even logarithmic regret and yet be driven out of the market when competing against a Bayesian learner with a finite prior that assigns positive probability to the correct model. At the same time, we show that Bayesian learning is highly fragile, while no-regret learning requires less knowledge of the environment and is therefore more robust. Motivated by this contrast, we propose two simple hybrid strategies that incorporate Bayesian updates while improving robustness and adaptability to distribution shifts, taking a step toward a best-of-both-worlds learning approach. More broadly, our work contributes to the understanding of dynamics of heterogeneous learning agents and their impact on markets. 1 Introduction Learning how to invest in asset markets has been a central topic of study in both the economics and finance literatures, as well as in computer science, where algorithmic approaches to decision-making and market dynamics have received growing attention. Learning-based algorithmic tools are now central to the functioning of many large-scale markets. In financial settings, automated trading algorithms have come to dominate both stock exchanges [ 86 , 50 , 78 ] and trading strategies [ 55 , 36 ] . Beyond asset markets, a similar trend is evident in online advertising, where auction platforms dominated by algorithmic bidding agents allocate ad space at scale and represent a substantial share—over 1\% —of the US GDP [ 76 ] . Learning-based systems also operate in online retail platforms such as Amazon [ 25 , 37 , 11 ] , where pricing, recommendations, and inventory control are largely automated. These reflect a broader shift toward markets increasingly mediated by learning agents. This shift raises foundational questions about the dynamics such systems induce and the outcomes they produce. From the perspective of decision makers managing algorithmic investment strategies in automated markets, a natural question arises: which learning approach should they adopt for their algorithms in a competitive market environment? Generally, players in markets aim to maximize the utility they gain from their resulting wealth. A standard utility function used in both economics and computer science is the \log of the player’s wealth, leading to the objective of maximizing the growth rate of wealth 1 1 1 The economics literature on market selection also considers different objectives based on expected discounted utility of consumption. We consider asset markets in isolation and thus focus on growth rate. See also Sections 1.2 and 4 . (see references below). However, the existing theories of learning from economics and from computer science propose different approaches to how learning agents should evaluate the feedback they receive and what methods they should use to select their strategies, and the two literatures ask different questions about the market dynamics. The literature in economics primarily focuses on Bayesian learning, while the computer science literature focuses on the framework of no-regret learning. While both Bayesian and no-regret learners modify their investment decisions over time, the assumptions about the learners and the measures of success are different. The economics literature studies Bayesian learning, assuming that agents have a prior about the underlying process and update their beliefs over time. If these agents correctly solve their decision problems, they succeed according to their own objectives. In the case that the agents’ objective is expected growth rate and they reach correct beliefs, this aligns also with the external measure of success based on their wealth share in the market. Notably, however, in this approach learners do not directly respond to changes that they experience in their wealth, but rather learn about the underlying stochastic process and best respond to it according to their current beliefs, combining their prior with their experience. The computer science literature makes no assumptions about the underlying process, allowing it to be adversarial, and focuses on no-regret learning, measuring the resulting outcome by the regret in growth rate compared to the best single strategy in hindsight; that is, the constant investment rule an investor would have used had they known the realization of the market variables. In the case of a market with a steady underlying stochastic process that we consider, this includes a comparison to the investor investing knowing the process (although this may not be the best strategy in hindsight for a given history; see Sections 3 and 5 ). Learning agents in this literature explicitly respond to the rate of change in their wealth at each step, considering it as the utility (or loss) input to their no-regret online learning algorithm. We study repeated interactions in asset markets with heterogeneous learning agents: both Bayesians and regret minimizers are present in the market and aim to maximize their expected growth rate of wealth. A question that naturally arises in this setting is whether one type of agent drives the other type out of the market. That is, does an agent’s wealth share converge to zero (the agent vanishes) or does it remain bounded away from zero (the agent survives)? A version of this question has been studied in the economics literature in the context of the market selection hypothesis. The results there show that agents who do not correctly maximize expected growth rate vanish in the presence of agents who do correctly maximize expected growth rate. See the related work section for further discussion and references to this literature. It is important to note that both the computer science and economics literatures on this topic treat the asset market as “perfectly competitive”; that is, although prices are endogenous (equilibrium prices evolve as wealths change over time), individual agents are “price takers” that do not take into account any impact of their decisions on equilibrium prices. To understand which learning approaches are more useful in this competitive setting, we ask the market selection question for markets populated with a greater variety of learning agents. Some are Bayesian optimizers, some are Bayesians who make small mistakes in the set of models they consider or in updating their beliefs, and some use no-regret learning. A key question that arises is: what is the meaning or role of regret in this context? Regret-minimizing agents achieve low regret in the complete asset market we analyze, but we show that if there is a Bayesian who makes correct updates and whose prior on models puts positive probability on the correct model, then regret minimizers vanish. That is, surprisingly, successfully reaching low regret does not guarantee survival . However, we also show that Bayesian learning is fragile ; if the Bayesian does not have the correct

Read the complete text