When Reasoning Models Hurt Behavioral Simulation: A Solver-Sampler Mismatch in Multi-Agent LLM Negotiation
Sandro Andric · 2026
Read When Reasoning Models Hurt Behavioral Simulation: A Solver-Sampler Mismatch in Multi-Agent LLM Negotiation by Sandro Andric (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-11840.txt.
Introduction
Andric tests whether reasoning modes that strengthen language models as problem solvers also help them simulate people, using five-agent negotiations over a regulation lasting fifteen turns. Without a running memory of talks, agreement almost never happens: 314 of 315 runs end with an authority deciding, reasoning or not. Reasoning only changes how failure looks, adding varied moves and concessions, while agents writing their own short notes reach agreement as the norm.
Catalog record
| CREATOR | Sandro Andric |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52721 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.11840
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
When Reasoning Models Hurt Behavioral Simulation: A Solver-Sampler Mismatch in Multi-Agent LLM Negotiation Sandro Andric Abstract Large language models are increasingly used as agents in social, economic, and policy simulations. A common assumption is that stronger reasoning should improve simulation fidelity. We argue that this assumption can fail when the objective is not to solve a strategic problem, but to sample plausible boundedly rational behavior. In such settings, reasoning-enhanced models can become better solvers and worse simulators: they can over-optimize for strategically dominant actions, collapse compromise-oriented terminal behavior, and sometimes exhibit a diversity-without-fidelity pattern in which local variation survives without outcome-level fidelity. We study this solver-sampler mismatch in three multi-agent negotiation environments adapted from earlier simulation work: an ambiguous fragmented-authority trading-limits scenario, an ambiguous unified-opposition trading-limits scenario, and a new-domain grid-curtailment case in emergency electricity management. We compare three reflection conditions, no reflection, bounded reflection, and native reasoning, across two primary model families and then extend the same protocol to direct OpenAI runs with GPT-4.1 and GPT-5.2. Across all three experiments, bounded reflection produces substantially more diverse and compromise-oriented trajectories than either no reflection or native reasoning. In the direct OpenAI extension, GPT-5.2 native ends in authority decisions in 45 of 45 runs across the three experiments, while GPT-5.2 bounded recovers compromise outcomes in every environment. The contribution is not a claim that reasoning is generally harmful. It is a methodological warning: model capability and simulation fidelity are different objectives, and behavioral simulation should qualify models as samplers, not only as solvers. Introduction Behavioral simulation and strategic problem solving are not the same task. A model that performs well on benchmarks rewarding correct reasoning, long-horizon planning, or strategic optimization may still be a poor instrument for simulating human behavior. This matters because large language models are increasingly deployed as agents in synthetic societies, negotiation simulators, policy-analysis tools, and economic games ( Bonabeau 2002 ; Epstein and Axtell 1996 ; Aher, Arriaga, and Kalai 2023 ; Horton 2023 ) . In these settings, the practical goal is often not to discover the optimal strategy from first principles. It is to sample a plausible distribution of boundedly rational trajectories under uncertainty ( Simon 1955 ; Kahneman 2003 ; Rubinstein 1998 ) . That objective creates a tension that is easy to miss. If the target population is boundedly rational, then a model optimized for extended reasoning may become misspecified as a simulator. Instead of producing diverse, path-dependent trajectories shaped by incomplete information, satisficing, pressure, and timing, it may infer the strategic structure too cleanly and converge on a narrow policy. In a multi-agent setting, that shift can collapse the very variation that simulation is supposed to reveal. We study this tension as a measurement problem. Recent work on generative social simulation argues that validation, rather than raw capability, is the central challenge for this entire research area ( Larooij and Törnberg 2026 ; Collins, Koehler, and Lynch 2024 ; Wallach et al. 2025 ; Zhou et al. 2024 ; Hullman et al. 2026 ) . We call the specific failure mode analyzed here the solver-sampler mismatch: the mismatch between the capabilities that make a model a stronger strategic solver and the properties required for it to act as a good behavioral sampler. A good solver seeks dominance, consistency, and efficiency. A good sampler, by contrast, must preserve bounded-rational variation. It must allow agents to concede late, misread leverage, settle on suboptimal but plausible arrangements, or fail to converge at all. When those behaviors disappear, simulation can become cleaner while becoming less faithful. Our starting point comes from a broader line of multi-agent simulation work we refer to as Narrative Monte Carlo, in which LLM agents are treated as stochastic samplers over plausible negotiation trajectories. Within that work, a recurring empirical pattern emerged: models with stronger native reasoning frequently produced degenerate simulations. They favored a narrow subset of actions, rarely conceded, and often drove interactions to rigid terminal states. By contrast, bounded reflection mechanisms improved memory and convergence without inducing the same rigidity. This paper isolates that thread as a standalone methodological question rather than as a subcomponent of a larger simulation project. This paper makes four contributions. 1. It formalizes the distinction between solver quality and sampler quality in multi-agent simulation. 2. It proposes a practical metric framework for behavioral sampler fidelity. 3. It presents evidence from three scenario-based, institutionally structured multi-agent negotiation experiments spanning two coalition structures and two substantive domains, plus a direct OpenAI provider extension, showing that bounded reflection can improve simulation fidelity while native reasoning can degrade it. 4. It argues that model selection for behavioral simulation should optimize sampler fidelity rather than raw benchmark capability. The claims here are intentionally narrow. We do not argue that reasoning is generally harmful or that reasoning models are universally inferior. We argue that, in bounded-rational multi-agent simulation settings, stronger native reasoning can degrade behavioral simulation fidelity under the conditions studied here. Why Solvers Are Not Necessarily Samplers The core mistake in many LLM simulation pipelines is objective slippage. Simulation asks one question: what range of plausible trajectories might agents produce under a structured set of conditions? Strategic problem solving asks another: what is the best action sequence under those conditions? These are related but not identical objectives. If a model is rewarded or tuned for coherent long-horizon optimization, it may reinterpret a simulation prompt as a task to be solved. In multi-agent settings, this often manifests as: • repeated use of the same dominant action • suppressed concession behavior • rapid convergence on a single normative interpretation of the game • failure to preserve the frictions, misalignments, and partial commitments that create plausible bounded-rational trajectories For social or policy simulation, that is an instrument-selection problem. The model is not failing in an absolute sense. It may be performing exactly as a strong strategic reasoner should. The failure is relative to the task of sampling boundedly rational behavior. This framing matters because it shifts the question from ”which model is smartest?” to ”which model best matches the behavioral target?” A strong decision-support model may be the wrong simulation model. A weaker but more behaviorally diverse model may be the better simulator. Behavioral Sampler Fidelity We define behavioral sampler fidelity as the degree to which a model preserves the plausible variation, negotiation dynamics, and bounded-rational path dependence required by the target simulation task. Outcome quality alone is insufficient for this purpose. A model can arrive at an apparently sensible final agreement while still producing a behaviorally implausible trajectory. For that reason, we evaluate sampler fidelity with trajectory-level diagnostics rather than endpoint accuracy alone. These diagnostics should be read as necessary but not sufficient conditions for fidelity. High action entropy alone does not prove faithful simulation. Our claim is narrower and more defensible: near-zero diversity, zero concession, and universal turn-budget exhaustion are inconsistent with any plausible account of bounded-rational negotiation in the environments studied here. In that sense, the metrics are best understood as falsification tools for sampler failure rather than as complete validation criteria. Primary Metrics We use three primary metrics. 1. Action entropy Measures behavioral diversity within trajectories. Low entropy indicates repetitive strategic play; higher entropy indicates a richer mix of