Triadic Werewolf: A Jester Role for Multi-Hop Theory of Mind in LLMs
Avni Mittal · 2026
Read Triadic Werewolf: A Jester Role for Multi-Hop Theory of Mind in LLMs by Avni Mittal (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-27909.txt.
Introduction
Avni Mittal extends the social deduction game Werewolf in 2026 to test theory of mind in language models. Standard tests are dyadic, with every cue pointing to one hidden side. A model can score well through language priors alone. Mittal adds a Jester, a third faction that wins by being voted out, so suspicion helps it and play involves three opposing utility functions.
Sixty games were run on three frontier models, with self-learning switched on and off. The Jester won sixty to seventy percent of games, while Werewolves never exceeded twenty percent. The strongest model, GPT-4.1, saw its wolves vote the Jester out on day one in most games, a self-defeating move. Self-learning helped DeepSeek and Llama but hurt that model, with the cost landing on Villagers. Only DeepSeek learned to look suspicious without looking intentionally suspicious.
Catalog record
| CREATOR | Avni Mittal |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 107 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.27909
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Triadic Werewolf: A Jester Role for Multi-Hop Theory of Mind in LLMs Avni Mittal Abstract Theory-of-mind evaluations of large language models typically use dyadic social-deduction games, where every observable cue points to a single hidden side, so a model with strong language priors can score well without ever simulating opponents’ incentives. We extend the Werewolf game with a Jester , a third faction whose utility on peer suspicion is inverted because it wins by being voted out, so optimal play requires reasoning across three opposing utility functions. Across 60 games on GPT-4.1, DeepSeek-V3.1, and Llama-3.3-70B with Jester self-learning on and off, the Jester wins 60–70% of games while Werewolves never exceed 20%, and GPT-4.1 wolves vote the Jester out on day 1 in 60–70% of games, a strictly self-defeating action. Self-learning helps DeepSeek and Llama but hurts GPT-4.1, with the cost landing on Villagers rather than Werewolves. Only DeepSeek learns the subtle strategy of looking suspicious without looking intentionally suspicious, and it gains the most from the loop. Triadic incentive structure exposes a layer of multi-agent reasoning that dyadic deduction games leave invisible. 1 Introduction Werewolf and related social-deduction benchmarks for large language models are dyadic, splitting players into two opposing sides, Villagers against Werewolves or loyal players against traitors ( 16 ; 3 ; 6 ; 36 ; 38 ; 33 ) , so every decision reduces to one question. Is this player an ally or an enemy? Every observable cue points one way, so a model that learns the surface pattern hesitation \Rightarrow likely werewolf can win without modelling any opponent. The theory-of-mind (ToM) ( 23 ) optimal policy and a pure cue-reading policy then select the same action, and a model can win by exploiting cues as it might exploit shortcut features elsewhere ( 9 ; 17 ; 18 ) . We call this the cue-sufficiency problem , and a high score under it does not show genuine mental-state reasoning ( 26 ; 31 ) , a coincidence we confirm in our dyadic control. We break this coincidence by adding a third faction whose payoff on the same cue runs the opposite way. The Jester wins if and only if the Villagers vote them out, so it tries to look as suspicious as possible while the Werewolves try to look innocent. A high-suspicion player is now ambiguous evidence, a Werewolf to exile or the Jester to leave alone, so good play must avoid looking like either while steering Villager attention away from anyone who might be the Jester. No dyadic variant draws out this multi-hop reasoning over three competing goals ( 11 ; 30 ; 33 ) . Figure 1: Overview of the WOLF triadic-incentive pipeline. A 10-player Werewolf game is instantiated with three competing factions (Villagers, Werewolves, and the Jester) whose utilities over the same observable cue diverge. Each game produces a transcript that is scored along faction outcomes, per-statement deception annotations, and voting dynamics. After every Jester game, the Jester-side model condenses what worked into a persistent learning file that is fed back into the next game’s Jester system prompt, yielding the OFF \to ON self-learning condition we evaluate. We argue that current LLMs do not reliably make this inference ( 25 ; 28 ; 26 ; 31 ) , and the failure shows up faction by faction. Three behavioral signatures follow if models fall back on dyadic priors. (i) The Jester wins more often than either other side. (ii) Werewolves sabotage themselves by voting the Jester out on day 1. (iii) An intervention aimed only at the Jester takes its gains from the Villagers rather than the Werewolves, since the Werewolves already fail the inference and only Villager belief-updating gives the Jester something to exploit. Our contributions are: • A 10-player triadic Werewolf benchmark whose Jester’s inverted utility breaks the cue-sufficiency of dyadic deduction games. • A controlled 60-game evaluation across three frontier models (GPT-4.1, DeepSeek-V3.1, Llama-3.3-70B) ( 1 ; 7 ; 8 ) with a Jester self-learning loop toggled OFF/ON ( 27 ; 36 ) , measuring first-order Jester gains and second-order effects on the other sides. • A hand-coded analysis of each model’s accumulated Jester lessons by theory-of-mind depth, linking depth to the model’s gain from the loop. 2 Related Work LLMs in Werewolf and other social-deduction games. Werewolf has become the canonical testbed for LLM agents under deception and hidden-role inference. 39 pair an LLM proposer with an RL action selector to reach human-comparable play; 34 couple a System-1 LLM to a System-2 “Thinker” trained on a 19k-game corpus; 37 optimise an abstract latent strategy space with counterfactual regret minimisation. Werewolf Arena ( 3 ) introduces the bidding-based debate protocol that we adopt, and InterIntent ( 16 ) probes goal-tracking among LLM agents. The wider family includes AvalonBench ( 15 ) , AmongAgents ( 5 ) , The Traitors ( 6 ) , Hoodwinked ( 19 ) , SpyGame ( 13 ) , and CICERO’s Diplomacy agent ( 4 ) . All of these are dyadic at the faction level, so a model can win by maximising a single “does this player look suspicious?” signal. We add a third faction whose utility on that same signal is inverted, dissociating “detect deception” from “decide whose deception to act on”. Theory of mind in LLMs. Static ToM benchmarks include FANToM ( 14 ) , OpenToM ( 35 ) , and Hi-ToM ( 11 ) , which varies recursion depth explicitly. 29 report that GPT-4 matches humans on classical false-belief tasks but underperforms on faux-pas detection, while 10 show that deception itself emerges with scale. The recurring critique ( 24 ) is that surface heuristics solve many ostensibly mental-state items without genuine belief representation. Multi-agent games complement static items by reading mental-state inference out of strategic behaviour under incentive pressure; our claim is sharper, that the incentive structure must itself be designed to dissociate ToM-driven from heuristic-driven solutions. Strategic deception, alignment, and self-improvement. A parallel literature studies hidden objectives and evaluator manipulation. MACHIAVELLI ( 20 ) measures the reward-vs-ethics trade-off across 134 text adventures; Sleeper Agents ( 12 ) show that backdoor deception survives standard safety training; GovSim ( 22 ) shows LLM societies overconsume shared resources under misaligned incentives. On in-context self-improvement, Reflexion ( 27 ) , Voyager ( 32 ) , and Generative Agents ( 21 ) all formalise verbal RL loops that rewrite a textual memory between episodes. Our jester_learning condition is a deliberately minimal instance of this paradigm and lets us audit whether such a loop helps or hurts when the role’s task is inherently deceptive. The Jester mechanic. Human social-deduction games such as Mafia and Town of Salem have long used the Jester, a role that wins by being voted out and so breaks the single axis of suspicion the other roles rely on. We are the first to use it for studying Theory of Mind Reasoning in an LLM benchmark. 3 Methodology 3.1 Game architecture Figure 1 summarises the full pipeline. We adopt the game architecture and implementation of WOLF ( 2 ) and make three changes, giving the 10-player roster in Table 1 . We drop the Seer, whose nightly check of whether a chosen player is