Reasoning and Behavioral Equilibria in LLM-Nash Games: From Mindsets to Actions

Quanyan Zhu · 2025

Read Reasoning and Behavioral Equilibria in LLM-Nash Games: From Mindsets to Actions by Quanyan Zhu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-08208.txt.

Introduction

Quanyan Zhu presents a 2025 paper on games played by language model agents. In a classic game, each player is fully rational and picks the move with the best payoff. Here, agents pick a reasoning prompt first, and the model then acts from that prompt. Mindset thus comes before action, and full rationality is not assumed.

Balance in this frame is defined over the space of prompts, not moves. Worked examples show that results can depart from classic Nash outcomes. The frame lets scholars study limits on thought, how rich a mindset can be, and learning about what others know. Zhu offers it as a new base for strategy work in systems built on language models. The paper is a single-author work.

Catalog record

CREATORQuanyan Zhu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-08208

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Reasoning and Behavioral Equilibria in LLM-Nash Games: From Mindsets to Actions Quanyan Zhu Abstract We introduce the LLM-Nash framework, a game-theoretic model where agents select reasoning prompts to guide decision-making via Large Language Models (LLMs). Unlike classical games that assume utility-maximizing agents with full rationality, this framework captures bounded rationality by modeling the reasoning process explicitly. Equilibrium is defined over the prompt space, with actions emerging as the behavioral output of LLM inference. This approach enables the study of cognitive constraints, mindset expressiveness, and epistemic learning. Through illustrative examples, we show how reasoning equilibria can diverge from classical Nash outcomes, offering a new foundation for strategic interaction in LLM-enabled systems. 1 Introduction Large Language Models (LLMs) fundamentally reshape decision-making in multi-agent systems, particularly in strategic contexts such as negotiation, cooperation, and adversarial interaction. Traditional game-theoretic formulations typically assume that agents select actions by explicitly solving a utility maximization problem; i.e., choosing the action that maximizes expected utility given the available information and beliefs about other agents’ strategies. While this optimization-based approach is grounded in classical decision theory and supports rigorous equilibrium analysis, it often rests on strong assumptions despite efforts to relax them: perfect rationality, complete knowledge of the game structure, and cognitive symmetry across agents. These assumptions, however, are seldom satisfied in real-world settings involving uncertainty, incomplete information, and heterogeneous cognitive capacities. LLMs offer a new paradigm that relaxes these assumptions. Rather than mapping information to actions via explicit optimization, LLM-based agents generate responses conditioned on observed context and internal latent representations. These representations are high-dimensional and implicitly encode elements such as intent, perception, belief, and anticipation of others’ reasoning. Importantly, the reasoning process itself is embedded in the generative capabilities of the LLM, and is influenced by natural language prompts that guide the model’s internal deliberation. In contrast to classical models that treat reasoning as a hidden byproduct of optimization, LLMs make the reasoning process explicit, interpretable, and manipulable. This shift enables several new directions of inquiry. First, it facilitates the analysis of bounded rationality by revealing the intermediate reasoning steps that lead to potentially suboptimal or biased behavior. Second, it invites the design of new solution concepts, such as reasoning-level equilibria, that account for the cognitive scaffolding underlying behavior. Third, it supports a novel class of epistemic learning processes in which agents not only adapt their strategies but also refine their reasoning mechanisms over time through prompt engineering or model fine-tuning. Moreover, LLMs provide a compelling framework for modeling human-like decision-making under uncertainty. Because they are trained on data that reflects diverse forms of human reasoning often under cognitive stress, limited information, or ambiguity, LLMs can naturally replicate heuristic behavior, framing effects, and strategic inconsistencies that are difficult to capture using normative models. As such, LLM-enabled agents serve not only as decision-makers but also as cognitive simulators that bridge the gap between theoretical rationality and observed behavior. This paper introduces a formal framework termed LLM-Nash Games , which extends classical equilibrium concepts to settings where agent policies are generated through prompt-conditioned LLMs. The framework defines equilibrium not only at the behavioral level , specifying which actions are ultimately taken, but also at the reasoning level , where those actions are derived via natural language prompts and LLM-based inference. By explicitly modeling both layers, the framework enables the analysis of decision-making in environments characterized by language-based reasoning, epistemic asymmetry, and bounded rationality. The remainder of the paper is organized as follows. Section 2 formulates the LLM-Nash Game model and relates it to the mental models of agents. Section 3 defines the corresponding equilibrium concept, termed reasoning equilibrium , which induces behavioral strategies. Section 4 investigates the relationship between behavioral and reasoning equilibria and studies how the richness of an agent’s mindset influences decision outcomes. Section 5 presents a case study that illustrates the proposed solution concept in a strategic game. Finally, Section 6 concludes the paper and outlines directions for future work. 2 LLM-Nash Game Formulation The LLM Nash game extends classical game-theoretic formulations—particularly the standard Nash game by replacing explicit utility maximization with generative reasoning powered by LLMs. This formulation is especially salient in agentic AI environments , where agents must operate under uncertainty, adapt dynamically to feedback, and reason with incomplete or unstructured information. Typical applications include agentic AI negotiation, voting protocols, and security workflows. Consider a simultaneous-move game involving two players: A and D . Let \mathcal{A} and \mathcal{D} denote the respective action sets of players A and D . Each player selects a mixed strategy over their action space: player A selects a distribution \mu_{A}\in\Delta(\mathcal{A}) over actions a\in\mathcal{A} , and player D selects a distribution \mu_{D}\in\Delta(\mathcal{D}) over actions d\in\mathcal{D} . We begin with the standard two-person game structure \mathcal{G}=(\mathcal{A},\mathcal{D},u_{A},u_{D}), where \mathcal{A} and \mathcal{D} are the action spaces of the players, and u_{A},u_{D}:\mathcal{A}\times\mathcal{D}\to\mathbb{R} are their respective payoff functions. The game is played in a one-shot, simultaneous setting: both players choose their actions independently and without knowledge of the other’s choice. The outcome of the game is determined by the joint action profile (a,d) . Each player also receives an information set, denoted I_{A}\in\mathcal{I}_{A} and I_{D}\in\mathcal{I}_{D} , respectively. The sets \mathcal{I}_{A} and \mathcal{I}_{D} represent the respective spaces of information that each player may possess during the game. Information sets contain local observations, past interactions, and contextual knowledge relevant to the strategic decision. In practice, they serve as input to the agents’ decision mechanisms. For example, in a cybersecurity context, player A (the attacker) may observe network traffic and identify vulnerabilities, while player D (the defender) may monitor system logs and analyze threat indicators. In the classical formulation, a player’s strategy is a mapping from their information set to a mixed strategy. That is, let \Gamma_{A} and \Gamma_{D} denote the spaces of such mappings (strategy functions), where \gamma_{A}:\mathcal{I}_{A}\to\Delta(\mathcal{A}),\gamma_{D}:\mathcal{I}_{D}\to\Delta(\mathcal{D}). Then, the induced mixed strategies are given by \mu_{A}=\gamma_{A}(\cdot\mid I_{A}),\mu_{D}=\gamma_{D}(\cdot\mid I_{D}). Definition 1 (Behavioral Nash Equilibrium) Consider a two-player game between agents A and D , where each player’s strategy is given by a stochastic policy: \gamma_{A}\in\Gamma_{A},\gamma_{D}\in\Gamma_{D}, mapping information inputs to probability distributions over actions. The expected utility for player A , under the strategy profile (\gamma_{A},\gamma_{D}) , is defined as \bar{u}_{A}(\gamma_{A},\gamma_{D})=\mathbb{E}_{a\sim\gamma_{A},\,d\sim\gamma_{D}}\left[u_{A}(a,d)\right], and similarly for player D , \bar{u}_{D}(\gamma_{A},\gamma_{D})=\mathbb{E}_{a\sim\gamma_{A},\,d\sim\gamma_{D}}\left[u_{D}(a,d)\right]. A strategy profile (\gamma_{A}^{*},\gamma_{D}^{*}) is said to be a Behavioral Nash Equilibrium if neither player has an incentive to unilaterally deviate from their strategy. That is, the equilibrium conditions are: \bar{u}_{A}(\gamma_{A}^{*},\gamma_{D}^{*})\geq\bar{u}_{A}(\gamma_{A},\gamma_{D}^{*}),\ \ \forall\gamma_{A}\in\Gamma_{A}, \bar{u}_{D}(\gamma_{A}^{*},\gamma_{D}^{*})\geq\bar{u}_{D}(\gamma_{A}^{*},\gamma_{D}),\ \ \forall\gamma_{D}\in\Gamma_{D}. The equilibrium pair (\gamma_{A}^{*},\gamma_{D}^{*}) characterizes the rational behavioral strategies of the agents. At equilibrium, no agent benefits from unilaterally changing their behavior, since each is optimally responding to the other’s strategy. Definition of LLM Nash Games Rather than optimizing over known utility functions, each agent queries an LLM with a structured prompt to generate a probability distribution over available actions. The resulting policies are defined as: \displaystyle\mu_{A}(a) \displaystyle=\tilde{\gamma}_{A}(a\mid I_{A},x,\theta):=\mathbb{P}^{A}_{\texttt{LLM}}[a\mid I_{A},x,\theta], (1) \displaystyle\mu_{D}(d) \displaystyle=\tilde{\gamma}_{D}(d\mid I_{D},y,\delta):=\mathbb{P}^{D}_{\texttt{LLM}}[d\mid I_{D},y,\delta]. Here, x\in\mathcal{X} and y\in\mathcal{Y} are structured prompts designed by the agents. These prompts encode intent, reasoning heuristics, strategic framing, or a chain of thought to guide the LLM’s generative process. They may also serve as cognitive scaffolding , shaping how the LLM reasons over the input I_{A} and I_{D} . The parameters \theta,\delta\in\Xi represent the respective worldviews of players

Read the complete text