Can Generative AI agents behave like humans? Evidence from laboratory market experiments

R. Maria del Rio-Chanona *, Marco Pangallo *, Cars Hommes · 2025

Read Can Generative AI agents behave like humans? Evidence from laboratory market experiments by R. Maria del Rio-Chanona *, Marco Pangallo *, Cars Hommes (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-07457.txt.

Introduction

Maria del Rio-Chanona and co-authors test whether AI agents act like people in markets in a 2025 paper. Lab markets show human traders overshooting and correcting in waves. The team let language model agents trade against each other live. Each agent's trades moved the price the others then faced.

The models did not follow textbook rational forecasts in the runs. Instead they showed the bounded, rule of thumb behavior humans show. A short memory window plus varied response settings matched broad human trends. Fine detail still differed, since the agents varied less than human traders do.

Catalog record

CREATORR. Maria del Rio-Chanona *, Marco Pangallo *, Cars Hommes
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-07457

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Can Generative AI agents behave like humans? Evidence from laboratory market experiments R. Maria del Rio-Chanona *, Marco Pangallo *, Cars Hommes Abstract We explore the potential of Large Language Models (LLMs) to replicate human behavior in economic market experiments. Compared to previous studies, we focus on dynamic feedback between LLM agents: the decisions of each LLM impact the market price at the current step, and so affect the decisions of the other LLMs at the next step. We compare LLM behavior to market dynamics observed in laboratory settings and assess their alignment with human participants’ behavior. Our findings indicate that LLMs do not adhere strictly to rational expectations, displaying instead bounded rationality, similarly to human participants. Providing a minimal context window i.e. memory of three previous time steps, combined with a high variability setting capturing response heterogeneity, allows LLMs to replicate broad trends seen in human experiments, such as the distinction between positive and negative feedback markets. However, differences remain at a granular level–LLMs exhibit less heterogeneity in behavior than humans. These results suggest that LLMs hold promise as tools for simulating realistic human behavior in economic contexts, though further research is needed to refine their accuracy and increase behavioral diversity. 1 Introduction During the 21st century, the academic literature has made significant strides in understanding human behavior in economics, shifting from rational expectations to a more nuanced perspective informed by behavioral economics and experimental research. Despite these advances, challenges remain.. Conducting and replicating experiments that inform these models is resource-intensive, making it difficult to integrate more realistic behavior into economic models with many heterogeneous agents. Recent developments in large language models (LLMs) present a promising solution. Their lower cost compared to traditional laboratory experiments offers a cost-effective alternative for incorporating human behavior into economic modeling ( Horton 2023 ) . However, before LLMs can be used to model economic behavior accurately, we must evaluate their capabilities in replicating both individual behaviors and market interactions. In this paper, we explore the extent to which LLMs can replicate human behavior in laboratory market settings and identify conditions under which they exhibit human-like economic behaviour. LLMs’ ability to simulate human interactions has led academics to suggest they could transform social sciences ( Grossmann et al. 2023 ) . LLM agents in social systems have demonstrated human-like characteristics and produced emergent phenomena, such as organizing events or making decisions about pandemic response ( Park et al. 2023 ; Williams et al. 2023 ) . They have also passed the Turing test in various games and experiments ( Mei et al. 2024 ) and shown heterogeneity (e.g. Argyle et al. 2023 found that LLMs could adopt political identities, such as Republican or Democrat, depending on the prompts given). While these studies show that LLMs can simulate social interactions, modeling economic behavior poses different challenges due to its reliance on quantitative reasoning. Yet, research shows that LLMs can reproduce to some extent the economic behaviour of individuals. Horton 2023 showed that LLM agents can behave similarly to humans when it comes to status quo bias and labour substitution with respect to minimum wage, and Mei et al. 2024 shows that LLMs pass the Turing test in economic games such as public goods, the ultimatum game, and the prisoners’ dilemma. When faced with budgetary decisions, LLMs exhibit rational behaviour ( Chen, Liu, Shan and Zhong 2023 ) that is somewhat similar, though not perfectly aligned, with humans with respect to risk, social, food, and time preferences. These studies focus on individual economic behaviors, but much less existing work aims at understanding how the interaction of multiple LLMs plays out over time . For example, would individual agents interacting in a market converge to the rational equilibrium price? Even if they converge, what type of fluctuations would they produce on their way to equilibrium? Although a few studies have looked at dynamic settings, the temporal dimension is not explored in detail. For instance, Chen, Yuan, Ye, Majumder and Richardson 2023 simulate auction markets, but mostly focus on the relative effectiveness of different bidding strategies. Similarly, Fish et al. 2024 examined firms’ pricing strategies in an oligopoly setting, but only focus on the final prices firms settle on. 1 1 1 Moreover, Zhao et al. 2024 simulated an economic environment involving restaurants and consumers, and find the emergence of diverse strategies from restaurants to attract customers. Li et al. 2024 study a macroeconomic agent-based model, focusing on the replication of stylized facts. Moreover, these studies do not compare LLM-generated dynamics to empirical or experimental dynamics. 2 2 2 Some studies achieved partial validation through static stylized facts; for example, Zhao et al. 2024 reproduced the Matthew effect, and Li et al. 2024 captured Okun’s law, but failed to capture the Phillips curve. To fully understand the potential of LLMs in economic contexts, we must explore their capacity to replicate market dynamics and agent interactions while validating these simulations against detailed human behavior. This is particularly challenging for three reasons: First, modeling market dynamics requires LLM agents to understand money, quantities, and mathematical concepts—areas where they initially struggled. Second, unlike single economic experiments, simulating markets hinges on interaction. This requires effectively translating these interactions into a virtual environment and providing LLM agents with the necessary context to engage iteratively without exhausting context window limits. Third, establishing a ground truth for behavior in markets is difficult since experiments of humans in markets are scarcer than those of individual economic behaviour. To address these challenges, we focus on market dynamics well-documented in human experiments, particularly the literature on price expectations and the behavior of participants in laboratory market experiments ( Heemeijer et al. 2009 ) 3 3 3 These market experiments are in fact repeated Keynes’ beauty contest or guessing games as introduced in ( Nagel 1995 ) ; See ( Mauersberger and Nagel 2018 ) for a survey of beauty contest games in the lab. . This body of work has been crucial in understanding how expectations form and deviate from rational expectations ( Hommes 2021 ; Anufriev and Hommes 2012 ) . Market participants use simple heurisitcs 4 4 4 In the psychology literature, heuristics have been studied extensively in the last few decades, following the seminal work of Tversky and Kahneman 1974 and Gigerenzer and Gaissmaier 2011 —fundamentalists, trend followers, naive forecasters, and adaptive learners—each influence market outcomes in distinct ways. An interesting finding is that market behavior also varies by market type. In positive feedback markets, dominated by trend followers, self-reinforcing behaviors often lead to bubbles ( Hommes et al. 2008 ) . In contrast, negative feedback markets, where fundamentalists are prevalent, tend to be more stable, with prices closely aligning with fundamentals ( Heemeijer et al. 2009 ) . We choose this literature due to its relevance in behavioural economics ( Hommes 2021 ) and for two practical reasons. First, the experiments were conducted with written instructions, and participants interacted through a computer, making it easier to translate the experiment into an LLM environment. Second, these experiments are among the few that capture detailed market dynamics and participant interactions, allowing for a thorough comparison. In this paper, we contribute to the literature by providing a

Read the complete text