ElementaryNet: A Non-Strategic Neural Network for Predicting Human Behavior in Normal-Form Games
Greg d’Eon, Hala Murad, Kevin Leyton-Brown, James R. Wright · 2025
Read ElementaryNet: A Non-Strategic Neural Network for Predicting Human Behavior in Normal-Form Games by Greg d’Eon, Hala Murad, Kevin Leyton-Brown, James R. Wright (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-05925.txt.
Introduction
Greg d'Eon and co-authors build a neural network that predicts how people play simple games, without being able to reason in a strategic way itself. Their 2025 paper starts from GameNet, a top system that pairs a simple level-k model of thought with a flexible network for base level play. That flexible part, they show, is too general and could mimic strategy.
Their new network, ElementaryNet, is built so it provably cannot express strategic behavior. In tests it matched GameNet, with no firm gap in performance. By varying its inputs and reading its parameters, the team found signs of step by step reasoning in human play and learned how deep that reasoning goes.
Catalog record
| CREATOR | Greg d’Eon, Hala Murad, Kevin Leyton-Brown, James R. Wright |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 58 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-05925
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ElementaryNet: A Non-Strategic Neural Network for Predicting Human Behavior in Normal-Form Games Greg d’Eon, Hala Murad, Kevin Leyton-Brown, James R. Wright Abstract Behavioral game theory models serve two purposes: yielding insights into how human decision-making works, and predicting how people would behave in novel strategic settings. A system called GameNet represents the state of the art for predicting human behavior in the setting of unrepeated simultaneous-move games, combining a simple “level- k k ” model of strategic reasoning with a complex neural network model of non-strategic “level-0” behavior. Although this reliance on well-established ideas from cognitive science ought to make GameNet interpretable, the flexibility of its level-0 model raises the possibility that it is able to emulate strategic reasoning. In this work, we prove that GameNet’s level-0 model is indeed too general. We then introduce ElementaryNet, a novel neural network that is provably incapable of expressing strategic behavior. We show that these additional restrictions are empirically harmless, with ElementaryNet and GameNet having statistically indistinguishable performance. We then show how it is possible to derive insights about human behavior by varying ElementaryNet’s features and interpreting its parameters, finding evidence of iterative reasoning, learning about the depth of this reasoning process, and showing the value of a rich level-0 specification. 1 University of British Columbia 2 University of Alberta [email protected], [email protected], [email protected], [email protected] Code & data — https://github.com/gregdeon/elementarynet 1 Introduction Human behavior in strategic settings often deviates significantly from the predictions of classical game theory: for instance, humans often play dominated actions (as in the unrepeated Prisoner’s Dilemma), which a fully rational agent would not. Behavioral game theory aims to address these shortcomings by developing predictive models of human strategic behavior. The purpose of such models is two-fold. First, such models that have been trained on experimental data can be analyzed to yield insight about human psychology. In this sense, classical game theory can be seen as a zero-parameter model that predicts poorly; the goal here is to find models that make much more accurate predictions, but are as simple and interpretable as possible. Second, we might simply build models that are as accurate as possible. Such models are useful for developing agents that will interact with humans or for designing systems of rules (“mechanisms”) that will perform well when faced with human participants. Past work has made substantial progress towards the first goal, demonstrating that so-called iterative reasoning models with just two parameters are surprisingly good at predicting behavior in new strategic settings, and hence giving insight into the way human subjects reason. Let us describe Quantal Cognitive Hierarchy (QCH), the best performing such model ( Camerer et al. 2004 ) . QCH predicts that people perform strategic reasoning at some finite “level”. The model includes a probability distribution describing the proportion of agents at each level; when this distribution is Poisson (having one parameter), we call the model QCHp. Level-0 reasoners are nonstrategic: they perform some arbitrary computation that falls short of forming beliefs about their opponents and best responding to these beliefs. Camerer et al. (2004) simply assert that level-0 reasoners choose actions uniformly at random, which is clearly nonstrategic (and parameter free); we call this instantiation of the model Uniform + QCHp. Level-1 reasoners quantally best respond to level-0 agents, where quantal response is a noisy version of best response that depends on a “precision” parameter. Level- k reasoners for k\geq 2 are more complex: they know the distribution over levels 0,\ldots,k-1 , and quantally best respond to the aggregate distribution of play by all lower-level agents. More recent work showed that even better performance can be achieved by hand-crafting a richer level-0 model based on insights from cognitive psychology, at the expense of adding more parameters ( Wright and Leyton-Brown 2019 ) . Regarding the second goal of raw predictive performance, it is perhaps unsurprising that the current state-of-the-art model for predicting human behavior in unrepeated normal-form games, dubbed GameNet ( Hartford et al. 2016 ) , is based on a neural network. GameNet extends the Uniform + QCHp architecture by replacing the uniform level-0 specification with a learned model and the Poisson distribution by a finite-depth histogram. The learned model uses a permutation-equivariant architecture to express the inductive bias that an action should be played with the same probability regardless of its index in the game matrix, but is otherwise unrestricted. Empirically, GameNet dramatically outperforms Uniform + QCHp. Although its neural network component is an uninterpretable black box, GameNet was based on the QCH architecture in part to allow for meaningful interpretation: one can ask about the shape of the level distribution, the precision parameter, and the way model performance varies when levels are added or removed. In this vein, Hartford et al. (2016) made a striking observation: GameNet performed best when it was restricted to predict that all agents were level-0. What should we make of this result? Does it show that iterative strategic reasoning is a dead end, and that human subjects are better described in some different way? Or, does it show that a sufficiently general neural network is already able to simulate iterative strategic reasoning, and hence that GameNet’s apparent interpretability was a mirage? Finally, how would we tell the difference? In this work, we make three main contributions. First, in Section 3 , we show that GameNet’s purportedly level-0 neural network is capable of strategic reasoning, and is hence inappropriate to use for describing level-0 agents. Our proof is constructive: we give a specific setting of its parameters that computes quantal best response to maxmax, a strategic model. This finding helps to explain why adding levels of strategic reasoning did not improve GameNet’s performance. Second, in Section 4 , we introduce ElementaryNet , a new restriction of GameNet’s architecture that is only capable of non-strategic behavior. Our architecture is rooted in the concept of elementary models ( Wright and Leyton-Brown 2022 ) , a set of behavioral models which are provably incapable of representing strategic behavior. Elementary models compute a real-valued “potential” for each outcome of the game that summarizes the set of utilities for all the players into a single number, and then compute a distribution of play using only those potentials. Intuitively, this restriction to a single summary per outcome prevents the model from forming a belief about the opponent’s play (based on the opponent’s utilities), and then best responding to that belief (based on the model’s own utilities). Our architecture is a convex combination of neural networks whose inputs are summarized by a single potential function each; it is thus a convex combination of elementary models, which is provably non-strategic in a precise, formal sense. Finally, in Section 5 , we perform extensive experiments on ElementaryNet. We first show that, despite the additional restrictions on its architecture, ElementaryNet combined with an iterative reasoning model achieves predictive power statistically indistinguishable from that of GameNet. We then show how the model’s clean delineation between strategic and non-strategic components makes it possible to obtain interpretable insights about human behavior by varying different features of the model. In particular, we show that ElementaryNet performs significantly worse without a strategic model, demonstrating that iterative reasoning is indeed a good model of human behavior.