Grounding Natural Language for Multi-agent Decision-Making with Multi-agentic LLMs
Dom Huh, Prasant Mohapatra, [email protected], [email protected] · 2025
Read Grounding Natural Language for Multi-agent Decision-Making with Multi-agentic LLMs by Dom Huh, Prasant Mohapatra, [email protected], [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-07466.txt.
Introduction
Dom Huh and Prasant Mohapatra propose design principles for teams of language-model agents that must decide together, in a 2025 paper. A shared, grounded language lets agents coordinate, but simply wiring models together does not guarantee it. The authors lay out a systematic framework for multi-agent LLM systems, built on key integration practices rather than ad hoc prompting.
The practices include advanced prompt engineering, memory architectures that let agents retain what matters, processing of multiple information types, and alignment through fine-tuning. Each choice was tested with extensive ablation studies, removing one piece at a time to see its contribution. The testbeds were classic games carrying social dilemmas, where cooperation and defection pull against each other. The authors argue that grounding natural language in the agents' decision algorithms is what turns a set of chatbots into a functioning team.
Catalog record
| CREATOR | Dom Huh, Prasant Mohapatra, [email protected], [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-07466
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Grounding Natural Language for Multi-agent Decision-Making with Multi-agentic LLMs Dom Huh, Prasant Mohapatra, [email protected], [email protected] Abstract Language is a ubiquitous tool that is foundational to reasoning and collaboration, ranging from everyday interactions to sophisticated problem-solving tasks. The establishment of a common language can serve as a powerful asset in ensuring clear communication and understanding amongst agents, facilitating desired coordination and strategies. In this work, we extend the capabilities of large language models (LLMs) by integrating them with advancements in multi-agent decision-making algorithms. We propose a systematic framework for the design of multi-agentic large language models (LLMs), focusing on key integration practices. These include advanced prompt engineering techniques, the development of effective memory architectures, multi-modal information processing, and alignment strategies through fine-tuning algorithms. We evaluate these design choices through extensive ablation studies on classic game settings with significant underlying social dilemmas and game-theoretic considerations. 1 Introduction Language has long been recognized as a critical enabler of intelligence and cooperation [ 10 , 20 , 6 , 19 ] . In multi-agent systems, the role of language parallels its function in human societies—enabling agents to express intentions, align goals, and coordinate actions [ 9 , 7 , 18 ] . However, despite these promising developments, there remain legitimate concerns regarding the reliability of such claims [ 15 ] . In particular, large language models (LLMs) often fall short of expectations when they are not provided with sufficient context or lack the mechanisms to accurately interpret and operationalize that context for the task at hand [ 1 , 23 , 21 , 3 ] . In this work, we investigate these limitations of LLMs within the context of decentralized multi-agent decision-making systems. Specifically, we study how the integration of LLMs can properly leverage the utility of a grounded linguistic framework to facilitate coordination to fully understand its context of a multi-agent task. Our goal is to harness the expressive power of natural language—along with its emergent reasoning capabilities—to address the challenges of learning coordinated behaviors in multi-agent environments. While traditional multi-agent communication approaches rely on either pre-defined symbolic protocols or end-to-end learned strategies that often suffer from limited interpretability [ 24 ] , we advocate for the use of natural language as a medium for interpretable inter-agent communication and reasoning. Our central hypothesis is that, when mediated by our multi-agentic LLM framework, natural language can function not only as a shared communication protocol but also as a mechanism to enhance the decision-making capabilities of individual agents and the collective system. We evaluate several key considerations for integrating LLMs into the multi-agent decision-making loop: 1. We design structured prompts and response strategies tailored for multi-agent coordination. Our approach incorporates chain-of-thought prompting, self/team reflections, and multi-stage prompt chaining. Additionally, we develop a task-specific decentralized retrieval-augmented generation (RAG) system to enhance contextual grounding with the capabilities of memory in repeated distributed game settings. 2. We align LLMs to task-specific norms by grounding natural language in the dynamics of the environment. This involves extracting learning signals from unique aspects of decision-making tasks and the multi-agent interactive nature, and using them to guide strategy optimization through advanced fine-tuning algorithms. Beyond these components, we conduct ablation studies to isolate the contribution of each integration method. We also explore nuanced multi-agent behaviors—such as ad-hoc team-play and mechanism design, which are critical for robustness and adaptability in real-world multi-agent environments. Our work evaluates the performance of our proposed multi-agentic LLM-based framework on a set of classic games, such as Prisoner’s Dilemma, Chicken, Stag Hunt, Battle of the Sexes, and Matching Pennies, to demonstrate its effectiveness in addressing multi-agent social dilemmas and achieving key solution concepts in distributed settings. We further extend this analysis to more complex variants, including repeated interactions, incomplete information, dynamic game structures, incentive incompatibilities, and communication-mediated coordination. Additionally, we explore LLM-driven mechanism design, in which elements of the game, particularly utility structures and "soft rules", are adaptively modified to mitigate incentive incompatibilities and steer agents toward desirable equilibria. Our results indicate that our multi-agentic LLM framework not only facilitates flexible and interpretable reasoning by grounding natural language in agent actions, but also supports the emergence of robust, adaptive behaviors in complex multi-agent environments. Figure 1 : A sample context window of Player A in the Prisoner’s Dilemma game. The structure of the player’s system prompt and the multi-stage prompt chaining framework are outlined. 2 Prompt Engineering for Multi-agent Decision-Making We propose a structured approach to prompting large language models (LLMs) for effective multi-agent decision-making, as illustrated in Figure 1 , following an iterative framework of multi-stage prompt chaining inspired by ReACT [ 22 ] . To mitigate context degradation over time [ 8 ] , we adopt a minimalist yet expressive prompting strategy. System Prompt The system prompt establishes foundational context and behavioral guidelines for the LLM. It sets the stage for role-based reasoning by embedding ethical, operational, and performance-related guidelines that shape the model’s behavior. In multi-agent settings, the system prompt consists of four core components: 1. Role Definition : This section defines the LLM’s role within the game. For example, as illustrated in Figure 1 , the LLM may act as a player in the Prisoner’s Dilemma. Other roles include an observing strategist who evaluates the behaviors of players or a mechanism designer who can modify the game dynamics. Additionally, we define any role-specific tokens or interface conventions used in communication or reasoning. 2. Task Context : This section outlines essential information about the game, such as its rules, the roles of players, the observation and action spaces, the payoff structures, and the game dynamics. Importantly, the granularity and scope of the task context may differ based on the LLM’s role and the nature of the task itself. This enables us to explore different game variants and their implications flexibly. The task context should be consistent with the role definition; for instance, a player’s task context may be limited due to its local view of its environment. 3. Multi-Agent Context : This section defines the target solution concepts or objectives (e.g., Nash equilibrium, Pareto efficiency, social welfare maximization, regret minimization). These objectives guide the LLM’s reasoning and incentivize different behaviors. Additionally, this context may include guidance on incorporating game-theoretic reasoning strategies, such as theory of mind or backward induction, through statements to encourage such concepts. 4. Memory Context : In repeated games, we retrieve information regarding prior interactions and experiences with the task and append this information to the system prompt. The memory context is retrieved based on the current system prompt (i.e., Role Definition, Task Context, and Multi-Agent Context) and any other available information (e.g., Observation). Thinking Stage In this stage, the players are prompted to engage in structured reasoning before taking any action. It is encouraged to simulate possible scenarios, analyze strategic factors, and reflect on its individual objectives as well as its role within the broader multi-agent environment. This introspective process aims to foster a more interpretable and grounded decision-making process. Multi-Agent Communication Stage Following the thinking stage, players may engage in a communication protocol. Here, players can exchange messages over a predetermined number of rounds, either simultaneously or sequentially, depending on the game’s protocol. The communication protocol can vary in permissibility depending