Magentic Marketplace: An Open-Source Environment for Studying Agentic Markets

Gagan Bansal, Wenyue Hua, Zezhou Huang, Adam Fourney, Amanda Swearngin, Will Epperson, Tyler Payne, Jake M. Hofman, Brendan Lucier, Chinmay Singh, Markus Mobius, Akshay Nambi, Archana Yadav, Kevin Gao, David M. Rothschild,, Aleksandrs Slivkins, Daniel G. Goldstein, Hussein Mozannar, Nicole Immorlica · 2025

Read Magentic Marketplace: An Open-Source Environment for Studying Agentic Markets by Gagan Bansal, Wenyue Hua, Zezhou Huang, Adam Fourney, Amanda Swearngin, Will Epperson, Tyler Payne, Jake M. Hofman, Brendan Lucier, Chinmay Singh, Markus Mobius, Akshay Nambi, Archana Yadav, Kevin Gao, David M. Rothschild,, Aleksandrs Slivkins, Daniel G. Goldstein, Hussein Mozannar, Nicole Immorlica (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-25779.txt.

Introduction

Gagan Bansal led twenty-three co-authors on agentic marketplaces. Wenyue Hua, Zezhou Huang, and Adam Fourney helped. Amanda Swearngin, Will Epperson, and Tyler Payne joined. Their 2025 paper studies language agents mediating economic decisions.

Such uses promise benefits but raise accountability questions. Realistic market settings are needed to understand actions. Previous research tested agents in constrained settings. Single-task markets and pairs of agents dominated. Real markets require diverse economic activities coordination. Large dynamic ecosystems have multiple opaque agents. Open-ended dialogues occur between those agents. They develop Magentic-Marketplace, a simulated two-sided environment. Service agents represent competing businesses there. Key changes include utility, biases, and manipulation vulnerability. Search mechanisms shape market outcomes strongly. Frontier models method optimal welfare under ideal search. Results degrades sharply with scale.

Catalog record

CREATORGagan Bansal, Wenyue Hua, Zezhou Huang, Adam Fourney, Amanda Swearngin, Will Epperson, Tyler Payne, Jake M. Hofman, Brendan Lucier, Chinmay Singh, Markus Mobius, Akshay Nambi, Archana Yadav, Kevin Gao, David M. Rothschild,, Aleksandrs Slivkins, Daniel G. Goldstein, Hussein Mozannar, Nicole Immorlica
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-25779

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Magentic Marketplace: An Open-Source Environment for Studying Agentic Markets Gagan Bansal, Wenyue Hua, Zezhou Huang, Adam Fourney, Amanda Swearngin, Will Epperson, Tyler Payne, Jake M. Hofman, Brendan Lucier, Chinmay Singh, Markus Mobius, Akshay Nambi, Archana Yadav, Kevin Gao, David M. Rothschild,, Aleksandrs Slivkins, Daniel G. Goldstein, Hussein Mozannar, Nicole Immorlica,, Maya Murad, Matthew Vogel, Subbarao Kambhampati, Eric Horvitz, Saleema Amershi Microsoft Abstract As LLM agents advance, they are increasingly mediating economic decisions, ranging from product discovery to transactions, on behalf of users. Such applications promise benefits but also raise many questions about agent accountability and value for users. Addressing these questions requires understanding how agents behave in realistic market conditions. However, previous research has largely evaluated agents in constrained settings, such as single-task marketplaces (e.g., negotiation) or structured two-agent interactions. Real-world markets are fundamentally different: they require agents to handle diverse economic activities and coordinate within large, dynamic ecosystems where multiple agents with opaque behaviors may engage in open-ended dialogues. To bridge this gap, we investigate two-sided agentic marketplaces where Assistant agents represent consumers and Service agents represent competing businesses. To study these interactions safely, we develop Magentic Marketplace -- a simulated environment where Assistants and Services can operate. This environment enables us to study key market dynamics: the utility agents achieve, behavioral biases, vulnerability to manipulation, and how search mechanisms shape market outcomes. Our experiments show that frontier models can approach optimal welfare—but only under ideal search conditions. Performance degrades sharply with scale, and all models exhibit severe first-proposal bias, creating 10-30x advantages for response speed over quality. These findings reveal how behaviors emerge across market conditions, informing the design of fair and efficient agentic marketplaces. 1 1 1 Available open-source at https://github.com/microsoft/multi-agent-marketplace . Figure 1: Magentic Marketplace is an open-source environment where AI agents can discover, communicate, and transact with each other. The environment can be used for evaluating different market designs and agent behaviors. 1 Introduction Autonomous agents powered by large language models (LLMs) demonstrate rapidly expanding capabilities, ranging from software development and customer service to strategic negotiation and complex decision-making ( Dong et al. 2025 ; Robeyns et al. 2025 ; Li et al. 2024 ; Cui et al. 2017 ; Huang et al. 2024 ; Eigner & Händler 2024 ; Hua et al. 2024 ; Abdelnabi et al. 2023 ; Ferrag et al. 2025 ) . As these capabilities mature, they create the foundation for multi-agent ecosystems where users can delegate economic activities to AI proxies that autonomously search and transact on their behalf ( Hao & Xie 2025 ; Karten et al. 2025b ; Liu et al. 2024 ) . The proliferation of such agents in markets is poised to have a disruptive impact on economic activity, creating an urgent need for a deeper understanding of multi-agent economic behavior. Background: Agentic Markets. Major economic platforms like Amazon, Facebook Marketplace, Google, and Bing are two-sided markets where consumers (on one side) and businesses (on the other) discover and transact with each other. Autonomous agents have appeared on both sides of these markets, such as shopping agents that mimic a human consumer navigating websites ( e.g. , OpenAI Operator) and customer support agents that assist businesses in answering consumer queries ( e.g. , Amazon Rufus and Expedia Romie). At present, these agents are designed to act as proxies for humans on one side of the market, with the implicit assumption that the other side is non-agentic. Rothschild et al. 2025 argues that dramatic shifts will occur when both sides are simultaneously represented by agents that interact with each other in a two-sided agentic market . Two-sided agentic markets promise to generate added value by reducing communication costs and information asymmetries ( e.g. , a business may not list every product configuration on its website). Humans cannot discover bespoke configurations without costly communication ( e.g. , phone calls). Shopping agents that mimic human website-browsing encounter a similar information asymmetry. Agent-to-agent interaction, however, can overcome such an asymmetry by inexpensively engaging in conversation to explore the full range of possible options, generating value for both consumers and businesses. There are many design decisions needed to architect and operationalize two-sided agentic marketplaces and many open questions about how current SOTA LLMs would perform under different market implementations. One critical challenge is to develop protocols that extend legacy designs for human consumers and businesses to allow for friction-less agent-to-agent interactions while allowing for human-human market interactions. At the same time, there is a growing commercial interest in implementing two-sided agentic markets, with companies like Google launching agent-to-agent communication and payment protocols (A2A, AP2). Current research on agentic systems has focused mainly on individual agent performance and structured interactions between agents for isolated economic tasks ( Wang et al. 2024 ; Buscemi et al. 2025 ; Mao et al. 2025 ; Abdelnabi et al. 2024 ) . Our work goes beyond existing studies to capture the complex dynamics of two-sided agentic markets for future design decisions end-to-end. An Open-Source Environment. We propose an agent-marketplace research paradigm, centering on the use of simulation environments for empirical studies of the capabilities and risks of LLM-based agents in multi-agent economic ecosystems. In particular, we introduce Magentic Marketplace , a simulated m ulti- agentic marketplace environment for controlled experimentation in agentic markets. The environment supports the full transaction lifecycle: from search and matching to negotiation and transaction, enabling systematic study of agent behavior under realistic marketplace conditions (see Figure 1 for an example). This simulation environment enables us to answer questions such as: How effectively can agents discover and transact with one another? How do market design decisions impact agent efficacy at scale? How does current AI agent technology compare to ideal agentic behavior and non-agentic markets? How do agents behave in response to strategic and competitive market environments, relative to classic economic predictions? Using Magentic Marketplace , we implement an experimental market scenario where agents seek to optimize outcomes for the consumers they represent, maximizing individual utility and generating rich interaction data. To enable controlled, repeatable experiments and safe exploration of agent behaviors, our current study uses fully synthetic data e.g. , from a restaurant domain (specifically, Mexican restaurants and contractors). But the environment is extensible: it supports additional synthetic domains and public/open datasets, facilitating research that shows generalization across market settings. We demonstrate how this setup can be used to evaluate market efficiencies under search limitations, susceptibility to manipulation. Our results reveal systematic behavioral biases and vulnerabilities across models, underscoring the need for further advancement of both agents and market mechanisms. Together, this paper establishes an empirical foundation for understanding the capabilities and risks of LLM-based agents in multi-agent economic ecosystems. Our contributions are as follows: 1. We design and implement the Magentic Marketplace environment to study LLM agents end-to-end across the two-sided economic market lifecycle, including search, inquiry and potential negotiation, and transactions. 2. We instantiate Magentic Marketplace with synthetic consumer and business data to measure economic welfare gains from two-sided agentic markets and understand their performance and vulnerabilities to manipulation and bias. 3. We open-source Magentic Marketplace to help others build multi-agent market designs, test new agentic solutions in these settings, and contribute experiment protocols to explore additional marketplace behaviors of

Read the complete text