Large Language Models Persuade Without Planning Theory of Mind Jared Moore, Rasmus Overmark, Ned Cooper, Beba Cibralic, Nick Haber, Cameron R. Jones Abstract A growing body of work attempts to evaluate the theory of mind (ToM) abilities of humans and large language models (LLMs) using static, non-interactive question-and-answer benchmarks. However, theoretical work in the field suggests that first-personal interaction is a crucial part of ToM and that such predictive, spectatorial tasks may fail to evaluate it. We address this gap with a novel ToM task that requires an agent to persuade a target to choose one of three policy proposals by strategically revealing information. Success depends on a persuader’s sensitivity to a given target’s knowledge states (what the target knows about the policies) and motivational states (how much the target values different outcomes). We varied whether these states were Revealed to persuaders or Hidden , in which case persuaders had to inquire about or infer them. In Experiment 1, participants persuaded a bot programmed to make only rational inferences. LLMs excelled in the Revealed condition but performed below chance in the Hidden condition, suggesting difficulty with the multi-step planning required to elicit and use mental state information. Humans performed moderately well in both conditions, indicating an ability to engage such planning. In Experiment 2, where a human target role-played the bot, and in Experiment 3, where we measured whether human targets’ real beliefs changed, LLMs outperformed human persuaders across all conditions. These results suggest that effective persuasion can occur without explicit ToM reasoning (e.g., through rhetorical strategies) and that LLMs excel at this form of persuasion. Overall, our results caution against attributing human-like ToM to LLMs while highlighting LLMs’ potential to influence people’s beliefs and behavior. Keywords: theory of mind; planning; large language models; persuasion; causal reasoning; mentalizing; social interaction 1 Introduction Planning with Theory of Mind Theory of Mind (ToM) describes the ability of an agent to understand behaviors of other agents in terms of underlying mental states. This ability plays a crucial role in human social interaction. Impressed with LLM performance on various benchmark tests for ToM, some researchers suggest that LLMs may exhibit human-like reasoning about mental states. This suggestion raises two questions. First, what constitutes human-like ToM? And second, how do we best investigate this capacity, in humans and LLMs alike? ToM is often studied via behavioral prediction measures ( Wimmer and Perner 1983 ; Baron-Cohen et al. 1985 ; Wellman and Liu 2004 ; Peterson et al. 2012 ) . Classic ToM tasks have participants predict the outcome of a story given some initial information about a character’s mental states. In the false belief task, a character, Sally, places her marble in a basket. Where will Sally look for the marble if she put it in the basket but did not see it get moved to the box ( Wimmer and Perner 1983 ; Baron-Cohen et al. 1985 ) ? Success in this task only requires predicting Sally’s behavior, not causally understanding how her beliefs generate her behavior; a participant may succeed using only a heuristic such as ‘people look for things where they last saw them’ without attributing any beliefs ( Ho et al. 2022 ; Tamir and Thornton 2018 ) . In addition, these tasks are spectatorial : participants predict the outcome of situations that they are not themselves part of. This is the case for a range of common ToM tasks ( Wimmer and Perner 1983 ; Baron-Cohen et al. 1985 ; Happé 1994 ; Wellman and Liu 2004 ; Peterson et al. 2012 ) . Human ToM is not exhaustively described by predictive and spectatorial functions. Classic accounts, such as the theory-theory, emphasize that ToM also supports explanation and understanding of behaviors through a causal model of the relationship between actions and mental states ( Gopnik and Wellman 1992 ; Gopnik and Meltzoff 1997 ; Gopnik and Wellman 2012 ) . Moreover, many researchers highlight that the most natural context for ToM is in active interaction with other agents ( Hutto 2012 ; Schilbach et al. 2013 ) . More recent work emphasizes planning and intervention as key elements of human ToM ( Ho et al. 2022 ; Wu et al. 2024 ) . A causal understanding of the mind allows us to plan and carry out interventions on other people’s mental states, e.g. as in persuasion. After Ho et al. 2022 , we call this capacity Planning Theory of Mind (PToM). PToM captures both a dimension of causal understanding and of social interaction. To carry out an effective intervention, one must be engaged in an interaction with an interlocutor one can intervene on, and one must have a causal understanding of how the intervened-upon mental states can bring about a desired behavior ( Ho et al. 2022 ) . Causal and interactive ToM measures In response to limitations of classic spectatorial and predictive ToM tasks, researchers in developmental and comparative psychology have developed several interactive adaptations of classic tasks. Call and Tomasello 1999 developed a false belief task where a child must not only rely on a character for cues about the location of a hidden reward, but must also recognize when the character’s cues are unreliable: when the character could not know the reward’s true location. In the active helping paradigm, the child must help an experimenter access the toy by e.g., unlocking one of two boxes that the character is struggling to open ( Buttelmann et al. 2014 ) . Similar interactive designs exist in comparative psychology: the active helping paradigm has been adapted for Great apes ( Buttelmann et al. 2017 ) , and competitive games assess understanding of false beliefs in both chimpanzees and children ( Kaminski et al. 2008 ) . Still, while interactive, these tasks do not target a causal understanding of mental states. Other paradigms integrate robust measures of causal understanding , but lack an interactive component. The strange stories task measures childrens’ causal understanding of mental states ( Happé 1994 ) . Participants must explain why characters behaved as they did in complicated social scenarios (e.g., from bluffs to sarcasm). To succeed, participants must cite mental states as reasons or causes for behaviors. Similarly, the short stories task asks adult participants to explain nuanced character behaviors in a story in terms of mental states ( Dodell-Feder et al. 2013 ) . These tasks highlight the explanatory role of ToM and, in turn, the causal understanding it involves. Nevertheless, they involve spectatorial contexts—not interaction. Persuasion paradigms in developmental psychology most clearly (1) measure a causal understanding of mind in (2) an interactive context. Good persuasion skills plausibly require a causal model of the target, which the persuader can use to ask questions such as “if I say X, what impact will that have on my target?” For example, if you are trying to persuade someone to adopt a vegan diet, it might be valuable to know whether they value animal welfare, are concerned about the environment, or dedicate lots of time to cooking. A persuader could inquire about or infer these values and adapt their persuasion strategy accordingly. In such persuasion tasks with children, researchers, e.g., present a child participant with a puppet that refuses to pet a kitten and ask the child to persuade the puppet to pet the kitten ( Bartsch and London 2000 ; Bartsch et al. 2010 ; Bartsch et al. 2011 ; Peterson et al. 2018 ) . The puppet might say that they think the kitten will scratch them, but the participant knows that the kitten is really both clean and friendly. The participant must then choose what information to reveal to the puppet to effectively persuade it. Hence participants must tailor their interventions to the preferences of the target to succeed. This intervention provides evidence of an underlying causal model because the desired action (petting the kitten) can be generated by intervening on the beliefs or desires that jointly cause behaviors. A clear limitation of these persuasion designs is that they are circumscribed, often relying on forced choices between few options; given this, they are too simple to illustrate meaningful differences in adult populations. LLM performance on ToM tasks A growing body of work has evaluated Large Language Models (LLMs) on ToM tasks, investigating the extent to which LLMs’ human-like behavior extends to classic psychological tasks ( Binz and Schulz 2023 ; Binz et al. 2025 ) . Some studies have focused on measuring the capabilities of LLMs, treating ToM tasks as benchmarks for social reasoning ( Sap et al. 2022 ; Hu et al. 2025 ; Kosinski 2024 ) . Other studies have used LLMs as explicit computational operationalizations of theories of human cognition and tested whether they can explain human behavior ( Trott et al. 2023 ; Binz et al. 2025 ) . While the literature on animal, child, and adult-human ToM has taken steps to address the limitations of predictive and spectatorial tasks, research on LLMs has tended to focus on only predictive measures. Early work established that LLMs can produce correct answers in text-based versions of the false belief task ( Trott et al. 2023 ; Kosinski 2024 ) . However, later work suggested that LLMs showed inconsistent performance on slightly modified versions of these stimuli, suggesting that their responses were not based on robust causal models ( Ullman 2023 ; Shapira et al. 2024 ) . Many papers have now assessed LLMs on batteries of ToM tasks reframed as “benchmarks”, including: tracking the beliefs of multiple agents ( Kim et al. 2023 ) , tracking beliefs recursively ( Jones et al. 2024 ; Street et al. 2024 ; Xu et al. 2024 ) , detecting social norm violations ( Strachan et al. 2024 ) , and interpreting non-literal language ( Jones et al. 2023 ) . However, these tasks are largely predictive and spectatorial. Some studies have used tasks that provide richer evidence for a causal model. Gandhi et al. 2023 tested whether LLMs can infer beliefs “backward” from actions, rather than “forward” from world-states to actions or beliefs. Yu et al. 2025 and Chan et al. 2024 , used pre-existing dialogues to test whether LLMs can predict how participants will behave and respond in real persuasion and negotiation contexts. Jones et al. 2023 evaluated LLMs on the short story and strange stories tasks. While these tasks make steps toward requiring inferences about the mental causes of behavior, they are still fundamentally spectatorial tasks focused on passively inferring the beliefs of other agents. To our knowledge, no research has tested LLMs’ PToM ability by having them dynamically interact with a human or artificial partner. Persuasion measures in LLMs One of the most promising directions for measuring the causal and interactive PToM capacity could be measuring persuasion ability. An emerging subfield tries to measure the extent to which conversations with LLMs can change people’s beliefs ( Rogiers et al. 2024 ; Jones and Bergen 2024 ; Bozdag et al. 2025 ) . Although these tasks were not motivated as ToM measures, but rather by the intrinsic benefits and risks of measuring the persuasion abilities of LLMs ( Jones and Bergen 2024 ; El-Sayed et al. 2024 ) , they nevertheless provide important evidence of the abilities of models to influence people’s mental states. These studies typically measure participants’ beliefs before and after interacting with an LLM ( Rogiers et al. 2024 ) . Research suggests LLMs can alter people’s beliefs and behavior toward policy issues ( Salvi et al. 2024 ; Hackenburg et al. 2025 ; Potter et al. 2024 ) , factual questions ( Schoenegger et al. 2025 ) , conspiracy theories ( Costello et al. 2024 ) , consumer choices ( Werner et al. 2024 ; Tang et al. 2024 ) , charitable donations ( Phuong et al. 2024 ) , and business decisions ( Benton et al. 2024 ) . Some studies have also found that LLMs are more effective at persuading human participants than are other humans ( Salvi et al. 2024 ; Schoenegger et al. 2025 ) . However, while these results are impressive, they do not provide good estimates of ToM abilities in general, nor PToM abilities in particular. Open-ended persuasion tasks allow multiple paths to success that do not necessarily require sensitivity to interlocutors’ mental states. LLMs may succeed through memorized persuasive arguments, classical rhetorical techniques, or simply by providing a target with novel facts or statistics. Without experimental control over what information the persuader has access to—and thus what mental states they could be modeling—existing tasks cannot distinguish between persuasion through strategic mental state modeling versus persuasion through memorized rhetoric and generic strategies. The Present Studies We address the gaps in these areas by extending the MindGames advanced PToM task into a flexible task framework ( Authors 2025 ) . Our task involves persuaders interacting with another agent (the “target”) through an online conversation game. Persuaders must convince targets to choose the persuader’s preferred policy proposal—out of three proposals—by strategically revealing information about the proposals. Each proposal affects three attributes differently. For example, in a scenario about AI policy, each proposal might increase or decrease one or all of safety and control of LLMs, development speed, and public trust in LLMs. Importantly, persuaders and targets have different value functions over the attributes—what the persuader favors may be neutral or unfavorable to the target. Figure 1: The view a persuader ( ) has when interacting with a target ( ). In the Revealed condition (shown), the persuader has access to the target’s mental states in “What the other player knows” section, but the persuader does not see this in the Hidden condition. Blue messages on the right are the persuader’s ( ). Black messages on the left are the target’s ( ). To succeed (persuade the target) a persuader must disclose some, but not all, of the information the target is missing. In the “real persuasion” condition (E3), persuaders were not told which attributes they liked (just “You want proposal A” B or C) and in the “What the other player knows” section saw the target’s answers to a few related survey questions. A demo of Experiment 1 is available at mindgames.psych-experiments.com . This chat depicts the beginning of a successful persuasive conversation between two humans where the target was given a value function to maximize (role-play persuasion; E2). Full dialogue in Appendix Fig. 15 . Figure 2: Example Conversations from each of the three experiments (columns) where the persuader was the LLM o3 (top row) or a human (bottom row). In our task, the persuader always has complete information about all proposals, while the target initially has partial information. This information asymmetry means persuaders can make their preferred proposal attractive to the target by selectively disclosing favorable information and, at the same time, they can retain other information that would make other proposals more attractive. Success in the task depends on understanding both what the target knows (informational states) and what they value (motivational states) and using this understanding to plan interventions (in the form of disclosures). We manipulate PToM demands through two conditions. In Revealed , persuaders can see the target’s value function and existing knowledge of the proposals. In Hidden , persuaders must infer these mental states through dialogue. While persuaders still must interact with the target in Revealed , Hidden requires more complex counterfactual planning (reflecting PToM ( Ho et al. 2022 ) ). In Hidden , persuaders must first inquire about the target’s mental states, then simulate how specific disclosures would update those states, before intervening to produce the desired behavior change. We use this framework to address a tradeoff between internal and external validity that has plagued existing work on ToM. On one hand, tightly controlled studies, like those based on the false belief task, allow clear inferences about specific cognitive capacities, but may poorly reflect real-world use of such capacities. Conversely, externally valid tasks like open-ended persuasion capture real-world complexity, but confound multiple factors, making it unclear whether ToM or other abilities underlie performance. We address this tradeoff by conducting three experiments that progressively sacrifice internal for external validity. Experiment 1 maximizes internal validity by using a rational bot as the target that responds only to appeals to its mental states, ensuring success depends on PToM (§ 2 ). Experiment 2 introduces human targets role-playing assigned values , introducing the potential for rhetorical and other strategies (§ 3 ). Finally, Experiment 3 allows human targets to act on their own values , in order to approximate real persuasion where targets’ preferences are mutable (§ 4 ). Through these experiments we test both whether LLMs possess PToM abilities and whether such abilities matter for naturalistic persuasion. Our contributions are as follows: 1. We introduce a family of experimental designs that trade off internal for external validity to systematically explore the relationship between PToM and persuasion. 2. We conduct a comparison of adult human and LLM abilities across experimental conditions requiring different levels of mental state reasoning, addressing limitations of prior evaluations of LLMs on ToM tasks. 3. We demonstrate that while LLMs lack human-like PToM abilities on controlled tasks (Experiment 1, Hidden ; Fig. 3 ), they can nevertheless be highly effective persuaders of human targets (Experiments 2 and 3; Figs. 4 and 6 ), suggesting that PToM and persuasion success are dissociable. 4. We provide evidence that persuader performance is driven partly by properties of human targets, such as cooperativeness and susceptibility to rhetoric, which creates opportunities for persuasion success without PToM (§ 5.3 ). 5. We argue this comparison suggests that humans and LLMs have different ToM styles—causal ToM and associative ToM, respectively (§ 5.2 ). 2 Experiment 1: Rational Bot Persuasion In Experiment 1, we sought to maximize internal validity over the target’s mental states, robustly measuring PToM. To do so, the design screened off non-PToM persuasion strategies. First, by randomly varying the target’s informational and motivational state, we ensured a dynamic target that was unlikely to be persuaded by one general persuasion strategy. Second, we designed the target of persuasion to be impervious to persuasion strategies that do not rely on planned interventions on mental states. We accomplished this by implementing the target as a “naively rational “ automated bot. This target was assigned a value function that specified how it valued different policies and was designed to only change its preferred proposal if its value function was better satisfied by the information revealed by the persuader. This meant that the target was immune to any appeal that was not an intervention on its informational states. These two constraints ensure that success in this experiment depends on the persuader’s ability to gather information about mental states through interaction with the target, and then to use that information in interventions. The Revealed and Hidden conditions allow us to contrast different PToM demands. By design, a persuader can be successful in the Revealed condition with a single message explaining that the target’s preferred proposal has drawbacks that do not align with the target’s value function, and that the persuader’s preferred proposal has advantages that align with the target’s value function. Although a basic level of planned intervention is needed to do well in the Revealed condition, the Hidden condition is far more demanding. Because the persuader does not have full information about the target’s value function, they must seek out this information and monitor when they have enough to intervene. This means that they must evaluate whether their causal model of the interlocutor’s informational and motivational states is sufficiently detailed for successful intervention. An agent that performs well on the Hidden condition shows clear evidence of PToM. An agent that only performs well on the Revealed condition displays only a limited capacity for PToM. For this reason, we treat above-chance performance on the Hidden condition as a signature of PToM. 2.1 Methods 2.1.1 Materials We presented persuaders with five different scenarios each of which had a different payoff matrix (see Tab. 1 ). A scenario involved a theme (such as AI policy) and three different proposals. The persuader must persuade the target to choose their preferred proposal. Each proposal had different effects on three different attributes unique to each scenario (such as safety and control of LLMs, development speed, and public trust in LLMs). Persuaders and targets valued attributes differently (e.g., preference for high development speed, neutrality toward safety, preference for low public trust in LLMs) given different value functions. The persuader and the target communicated via free-response messages. Fig. 1 depicts an example of the MindGames interface with a scenario and a payoff matrix (a game). Payoff Matrices. A player prefers a proposal when it has the highest utility (sum of attribute preferences given its value function) relative to other proposals. We structured the payoff matrices of all the games such that: 1. the persuader always prefers one proposal (e.g., “A”) and has complete information about the effects of the proposals, 2. the target is missing the crucial information about four attributes across the three proposals (of nine total), 3. therefore the target initially prefers a proposal dispreferred by the persuader (e.g., “C”), 4. if the target knew all of the information it would prefer a different proposal dispreferred by the persuader (e.g., “B”), and 5. if the target learns about two specific pieces of information it will prefer the persuader’s proposal (i.e., “A”). We used a constraint solver to generate payoff matrices obeying these constraints and selected a random sample of 100 of them. (See Appendix A.1 .) 2.1.2 Procedure In Experiment 1, persuaders had to persuade a rational bot. The rational bot updates its preferences based on its assigned value function and available information, answers questions truthfully when asked, but never volunteers information. We used gpt-4o to classify whether any incoming persuader message: 1) discloses information about the proposals or 2) inquires about the target’s (a) informational or (b) motivational states. We then generated a canned response from the rational bot to: 1) acknowledge information revealed, 2) reveal states appealed to, or 3) respond generically (neither 1 nor 2). We call this target rational because it always chooses the proposal that is maximally in line with its preferences and current information, and naive because it freely discloses its preferences and information and takes all disclosures of information at face value. Disclosures and Appeals. A persuader had to strategically disclose information to persuade the rational bot. If the persuader discloses no information, the rational bot will never switch from a proposal the persuader disprefers. If the persuader discloses all of the information, the bot will choose a different proposal that the persuader also disprefers. Persuasion in Hidden vs. Revealed . In Hidden , the persuader does not know the target’s value function nor the information they have. In Revealed , we reveal the target’s mental states to the persuader. Hence, to know which pieces of information to disclose in Hidden , a persuader must appeal to the target’s informational and motivational state with questions of the form, “what do you know about the policies?” and “which attributes do you like? “. Only with this information may the persuader successfully disclose the relevant two pieces of information to persuade the target more often than chance. Worked Example. In Fig. 1 , the persuader prefers proposal A while the target initially prefers proposal C. By disclosing one favorable piece of information about proposal A (“Proposal A will increase development speed of LLMs” while the target likes development speed) and one disfavorable piece of information about proposal C (“Proposal C will decrease safety and control of LLMs”), the persuader convinces the rational bot to choose proposal A. If the persuader additionally discloses that Proposal B increases development speed of and public trust in LLMs (the target likes both), the target would choose Proposal B. An example dialogue (albeit with a different payoff matrix) between the rational bot and a human persuader appears in Fig. 2 . 1 1 1 U_{\text{target}}(A)=1 U_{\text{target}}(B)=1 U_{\text{target}}(C)=2 initial U_{\text{target}}(A)=2 U_{\text{target}}(B)=1 U_{\text{target}}(C)=1 disclose some U_{\text{target}}(A)=2 U_{\text{target}}(B)=3 U_{\text{target}}(C)=1 disclose all 2.1.3 Participants We elicited 200 trials from the LLM o3-2025-04-16 on five different scenarios, with 40 different payoff matrices per scenario, for a total of 200 games. We prompted o3 with default parameters through the API with only the messages from the current conversation in context. 2 2 2 All data from our experiment and code to replicate it are in the linked Github repository: https://github.com/jlcmoore/mindgames . We compared LLM responses to data from 124 participants recruited through Prolific in Authors 2025 , including 202 Revealed condition trials and 199 Hidden condition trials, from five different scenarios with randomized payoff matrices . Participants were not told whether they were interacting with a human or bot. We debriefed them afterward. 2.2 Hypotheses In Authors 2025 , we found that humans significantly outperformed OpenAI’s o1-preview in the PToM experiment. Since this initial study, the more advanced reasoning model o3 was released. o1 ’s poor performance may be due to limitations in the model that have since been improved upon. In this experiment, we ask whether the PToM deficit persists in state-of-the-art reasoning models, specifically OpenAI’s o3 . In doing so we establish a baseline of LLM performance to compare to E2 and E3. We hypothesized that: 3 3 3 Preregistration: https://aspredicted.org/9vp6-nn89.pdf . H1 o3 can discover the rational bot’s informational and motivational states in the Hidden condition and use this information to successfully intervene on the target’s decisions —i.e., o3 success in the Hidden condition is significantly greater than 0.1. H2 o3 performs better on the task when the target’s informational and motivational states are Revealed and do not need to be inferred —i.e., o3 success in the Revealed condition is significantly greater than in the Hidden condition. Although we expected o3 to perform better than o1 , humans should still outperform o3 in the Hidden condition. While the Hidden condition is also challenging for human participants, it draws on capacities that are well established in human social life. Finally, since PToM tasks are likely difficult for LLMs compared to tasks that rely on, e.g., statistical models of mental states, we expected the difference in performance between Revealed and Hidden conditions to be larger for o3 than for humans. We therefore hypothesized that: H3 Humans perform better than o3 in the Hidden condition ., i.e. human Persuasion Success is significantly greater than o3 Persuasion Success in the Hidden condition. H4 o3 performs better than human participants in the Revealed condition ., i.e. o3 Persuasion Success is significantly greater than human Persuasion Success in the Revealed condition. H5 There is a larger effect of Revealed over Hidden for o3 than for humans . i.e. the effect size between conditions will be significantly larger for o3 . We tested our hypotheses by comparison to a conservative success rate baseline of 10% for chance performance. 2.3 Results 2.3.1 Pre-registered Hypotheses Figure 3: In the Hidden condition of Experiment 1, which tightly measures “planning with ToM”, humans outperform o3 while o3 outperforms humans in the easier Revealed condition. “Rational target success” is how often on average, at the end of the game the rational bot chose the persuader’s preferred proposal. Each bar (condition) has about 200 games for n=124 human participants. In the Revealed condition, persuaders have access to the target’s informational and motivational state, but in the Hidden condition, they must plan and act to gather this information (cf. Fig. 1 ). The scatter plots show individual-level performance (averaged from up to five games per human participant). Error bars show bootstrapped 95% confidence intervals. The grey, dashed line at .1 shows the random baseline. Results are summarized in Fig. 3 . We carried out hypothesis testing at a baseline for chance performance at 10% at a significance threshold of p=0.05 , using binomial mixed effects models with random intercepts by participant and scenario. Contrary to H1, o3 succeeded 5% of the time in the Hidden , which was below the 10% baseline ( z=-1.762 , p=0.078 ). o3 did not succeed on the PToM-intensive condition, replicating the performance of o1 . In line with H2, o3 succeeded 65% of the time in Revealed . This was significantly above the 10% baseline ( z=10.11 , p<0.001 ). o3 therefore shows vastly better performance on a less PToM-intensive condition, replicating o1 ’s performance. Upon comparing human and LLM performance, we find support for all our comparative hypotheses (H3-H5). With a human success rate of 29% and a o3 success rate of 5%, humans performed significantly better than o3 in Hidden ( z=-5.650 , p<0.001 ). With a human success rate of 22% and a o3 success rate of 65%, o3 performed significantly better than humans in the Revealed condition ( z=8.290 , p<0.001 ). Finally, the difference in performance between Revealed and Hidden was significantly larger for o3 than for humans ( z=9.460 , p<0.001 ). 2.3.2 Exploratory findings Disclosures and Appeals We investigated the rates at which humans and o3 disclosed information and made appeals to the target. On average, humans made 6.1 appeals and 2.5 disclosures per scenario in Hidden . In comparison, o3 made 4.7 appeals and 5.4 disclosures. (See Fig. 8 .) o3 revealed much more information to the target based on fewer appeals. Conversely, humans made relatively few disclosures but on the basis of many more appeals, suggesting that human participants were more information seeking. This gives the impression that o3 discloses information in a scattershot way, whereas humans make more surgical interventions. Moreover, in Revealed , humans made on average 3.4 appeals and 2.4 disclosures and o3 made on average 3.3 appeals and 4.0 disclosures. 2.4 Discussion Different ToM styles Experiment 1 shows that humans significantly outperform o3 in the PToM-intensive Hidden condition of MindGames. This supports the claim that earlier LLM successes on predictive ToM tasks, such as the false belief tasks, are not evidence of human-like ToM. Human-like ToM characteristically bears the marks of both a causal understanding of mental states and interaction as its primary context. This may reflect fundamental differences in ToM styles between LLMs and humans; the ToM capacities of LLMs may merely involve a statistical model of mental states. This model relies on associations between different observable states, as opposed to causally-efficacious underlying mental states that generate behaviors. Whereas an LLM may possess an association-based understanding of mental states that can support predictions in many common contexts, they do not then possess a causal understanding of mental states as underlying causes of behaviors, as is characteristic of PToM. This contrasts clearly with human ToM, which is characterized by both associative and causal models of mental states. The data on appeals and disclosures supports the interpretation that humans and LLMs deploy different ToM styles. Humans are selectively information-seeking when faced with an opaque interlocutor in Hidden and seemingly seek information to support surgical interventions. This suggests that our human participants actively model the target’s informational and motivational states by seeking out information where this model is incomplete and use this information to drive surgical interventions. In contrast, o3 ’s performance is characterized by more disclosures on the basis of less information. Moreover, its behavior does not change as markedly between the conditions as the behavior of human participants. In short, o3 is not particularly sensitive to what it knows about the target. This pattern is what we would expect if o3 was not relying on a model of the target’s mental states to guide its disclosures and appeals. Performance differences between conditions offer a final piece of support for the different ToM styles interpretation. In earlier work, we found that humans perform equally well on the Hidden condition and the Revealed condition ( Authors 2025 ) . In contrast, the difference between these conditions is very large for o3 , with markedly better performance in Revealed . Success in Revealed can be association-based: the persuader need not monitor whether it has enough information about its interlocutor’s mental states to carry out a successful intervention. Because all information about the target’s mental states is immediately available in Revealed , an agent can perform well if they look for matches between the target’s preferences and the information available to the persuader, using the heuristic that targets will endorse proposals that best satisfy their preferences. o3 performs poorly in Hidden , where the demand for causal modeling is high, but without the demand for a causal model of mental states in Revealed , o3 improves. This is what we would expect if o3 relies on an associational ToM, as opposed to the causal PToM. Planning interventions for persuasion We proposed that persuasion is a natural context to use PToM. A subset of successful persuasion attempts (for humans in Hidden ) seem to rely on causal models of the target’s mental states. Experiment 1 shows that PToM is relevant to persuasion, suggesting a relationship between them. However, Experiment 1 is limited by its low external validity. MindGames is a significantly more open-ended and more complex persuasion task than previous ToM tasks ( Bartsch and London 2000 ; Bartsch et al. 2010 ; Bartsch et al. 2011 ; Peterson et al. 2018 ) . Nonetheless, the rational bot is a highly circumscribed interaction partner; it is only sensitive to exactly those persuasion attempts that draw on PToM. This is by design. To provide the clearest measure of PToM in our samples, Experiment 1 aims for a high degree of internal validity. We can achieve higher external validity by using a less strict target—one susceptible to a wider range of persuasion. Consequently, Experiment 1 points to a substantive difference in ToM capacities between humans and LLMs, but fails to establish a general relationship between persuasion and PToM. 3 Experiment 2: Role-Play Persuasion In Experiment 1, we could entirely determine the information that the rational bot had access to, the circumstances under which it would reveal information, and the inferences that it would make from the persuader’s behavior. While this ensured that persuaders must strategically inquire about and use mental state information to guide interventions, it differs from persuading humans in many ways. Human targets might be susceptible to rhetorical strategies (such as appeals to emotion or authority) that do not depend on accurate mental state modeling ( Cialdini et al. 2009 ) . They might provide more cues to their mental states—both explicitly and implicitly—than the rational bot, making their beliefs and desires easier to infer without direct questioning. Finally, humans might make decisions that deviate from strict utility maximization, either through reasoning errors or by weighing considerations beyond the stated attributes. These differences matter for interpreting our Experiment 1 results. Suppose we observe the same pattern of results with humans role-playing a rational target. This would suggest that LLMs’ lack of PToM means they are unlikely to persuade effectively in the real world when facing the kind of information asymmetry that our task exhibits. Alternatively, suppose LLMs persuade human targets in Hidden more effectively than they were able to persuade the rational bot. This would suggest that LLMs are capable of persuading people by means other than PToM. Moreover, it would suggest LLM success in this task is based on quite different mechanisms to the ones that we theorize successful human persuaders use. Experiment 2 sacrifices some internal for external validity, by replacing the rational bot with human participants. However, as with the rational bot in Experiment 1, target participants were given a pre-specified value function over the attributes rather than using their own values. They were also financially incentivized to select the optimal choice with respect to these values. We called this ‘role-play’ persuasion because the human targets were playing the role of someone else who had the values assigned to them. If human targets behave as rational agents who simply communicate more naturally than our automated bot, we should observe similar patterns to Experiment 1: human persuaders should maintain their advantage over LLMs in the Hidden condition, and LLM persuaders ought to perform better in the Revealed versus the Hidden condition. However, if human targets are persuaded through rhetorical means that bypass mental state modeling, or if they cooperatively disclose information without prompting, we may see LLMs narrow or eliminate these performance gaps. 3.1 Methods Experiment 2 proceeded identically to Experiment 1 except for the following differences. 3.1.1 Materials We used the same scenarios as in Experiment 1 except for some small clarifying changes (see Tab. 2 ). These changes were made to more closely tie the labels for attributes to the context of the scenarios, for example changing the abstract attribute “safety and control” to “safety and control of LLMs”. 3.1.2 Procedure We assigned some human participants to be targets, playing the role that the rational bot played in Experiment 1. We assigned human targets a value function over the three attributes (e.g., ” You like safety and control of LLMs, dislike development speed of LLMs, and feel indifferent about public trust in LLMs “) and showed them partial information about the proposals, exactly as with the rational bot. Before receiving any messages from persuaders, targets indicated which proposal they would initially choose. This pre-persuasion choice allowed us to verify whether targets appropriately followed their assigned values and to analyze how often persuasion changed their minds. We excluded targets if their choice did not align with the optimal choice before any interaction with the persuader. In Fig. 1 , Human targets had a similar view to the persuaders but (1) only ever saw a “What you know” section (which here would be the content of the “What the other player knows” section), (2) were not told which proposal they ought to prefer, and (3) saw the text “You should listen to the other player to help make your choice.” instead of “You must persuade the other player of your preferred proposal.” (See Fig. 11 .) Analysis We analyzed our data in the same way as in Experiment 1, except we refined our chance baseline from 10% (a nominal operationalization of chance performance) to 7.5% (based on a simulated analysis). That is, if a persuader randomly (with replacement) discloses six pieces of information (of the nine total), they will persuade the rational bot about 7.5% of the time. (Revealing any more or fewer pieces of information than six leads to an even lower success rate. See Appendix A .) This change in threshold did not materially affect any of our conclusions in any of the experiments. 3.1.3 Participants In Experiment 2, we recruited human participants to serve both as persuaders and targets. We aimed to sample a total of 100 trials per condition. 4 4 4 In our pre-registration, we aimed to sample 200 trials per condition. During the experiment we realized that the attrition rate for participants was too high and collecting the full sample would be impractically expensive. Based on the effect sizes in Experiment 1, we decided to lower our target sample to 100. We made this decision before looking at any of the data from Experiment 2. We recruited 152 participants who were randomly assigned to one of three roles: Human Persuader, Human Target (for human persuader), or Human Target (for o3 persuader). Each participant was assigned to complete five trials in the same role, one for each of the five scenarios, however, due to matchmaking issues and dropout participants often did not complete all 5 trials (2.7 trials on average). In total we collected 413 trials. 182 trials were excluded because the human target did not initially select the policy with the highest value under their assigned value function. After exclusions, 231 trials were retained. The condition with the fewest number of trials was the Human persuader Hidden , with 48 trials. We recruited participants from the platform Prolific, and paid $15/hr for their time, plus a bonus of $1 for each trial in which they successfully persuaded the target to select their preferred option (for persuaders) or successfully selected the optimal choice (for targets). The average persuader bonus was $0.55, and the average target bonus was $0.09. This study was approved by our IRB. 3.2 Hypotheses Our hypotheses were the same as in Experiment 1, except that we added two new hypotheses to analyze the human persuader data. 5 5 5 https://aspredicted.org/6t7t-mtfj.pdf These hypotheses mirror H1 and H2 for o3 in Experiment 1 as well as the hypotheses for human persuaders used in Authors 2025 . H6 humans can discover the target’s informational and motivational states in Hidden and use this information to successfully intervene on the target’s decisions — i.e., human success in Hidden is significantly greater than 0.075. H7 humans perform better on the task when the target’s informational and motivational states are Revealed and do not need to be inferred — i.e., human success in Revealed is significantly greater than in Hidden . 3.3 Results Figure 4: In both the Hidden and Revealed conditions in Experiment 2, o3 outperforms human persuaders on the ability to persuade actual human participants. “Persuasion success” measures whether the human target chose the persuader’s preferred proposal. (The human targets do not necessarily agree with rational bot from E1.) Each bar (condition) represents 48–64 games (human persuader: 48 Hidden , 64 Revealed ; o3 : 59 Hidden , 60 Revealed ) for n=152 human participants. In the Revealed condition, persuaders have access to the target’s informational and motivational state, but in the Hidden condition, they must plan and act to gather this information (cf. Fig. 1 ). The scatter plots show individual-level performance (averaged from up to five games per human participant). Error bars show bootstrapped 95% confidence intervals. The grey, dashed line at .1 shows the random baseline. 3.3.1 Pre-registered Hypotheses Human persuaders succeeded 34% of the time in Hidden , significantly above the 7.5% baseline ( z=5.826,p<0.001 ), and confirming H6 (see Fig. 4 ). However, the results did not confirm H7: human persuaders performed no better in Revealed (35%) compared to Hidden ( 34\%;z=0.148,p=0.882 ). The o3 persuader showed the same pattern of results: achieving 51% success in Hidden (H1: z=6.087,p<0.001 ), but performing no better in Revealed than Hidden (H2: z=1.135,p=0.257 ). Contrary to Experiment 1, where humans substantially outperformed o3 in Hidden (H3), humans did not significantly outperform o3 in Experiment 2. In fact, o3 trended toward better performance (51% vs 34%), though this difference was not significant ( z=1.631,p=0.103 ). As in Experiment 1, o3 outperformed humans in Revealed (H4; 66% vs 35%; z=2.811,p=0.005 ). We found no significant interaction between persuader type and condition (H5; z=0.845,p=0.398 ). 3.3.2 Exploratory Analyses Disclosures and Appeals As in Experiment 1, o3 made a larger number of disclosures per game (4.4 in Hidden , 3.7 in Revealed ) than human persuaders did (1.9 in Hidden , 1.7 in Revealed ), and there was not a large difference in the number of disclosures per condition. (See Fig. 8 . Both human persuaders and o3 made generally fewer appeals per game than they did in Experiment 1.) Moreover, unlike in Experiment 1, human participants in Experiment 2 did not make significantly more appeals in Hidden (1.6) than they did in Revealed (1.4). o3 made significantly more appeals in Revealed versus Hidden (2.2 vs 0.4 per game). Rational Bot Success In order to investigate differences between Experiment 1 and Experiment 2, we calculated which option the rational bot would have selected on the basis of the information provided in each game transcript. This analysis is importantly different from Experiment 1 itself: the human target may have revealed information that the rational bot would not have revealed. More generally, persuaders might behave differently with real human targets. Therefore this analysis allows us to isolate the extent to which differences between Experiment 1 and Experiment 2 resulted from human targets making different decisions from the rational bot on the basis of the same information. Fig. 7 shows the actual rate of target persuasion (” Persuasion Success “) and the simulated success rate at which the rational bot would have been persuaded by the same content (” Rational Bot Success “) for the Hidden condition. For human persuaders, the Rational Bot Success was much lower (2%) than the actual rate of persuading human targets (34%), and lower than target success in Experiment 1 (29%). The pattern of results was similar in the Revealed condition (35% Persuasion Success vs. 0% Rational Bot Success). o3 ’s real success (51%) was also greater than its simulated Rational Bot Success (2%) in the Hidden condition, which was similar to its actual performance against the rational bot in Experiment 1 (6%). In the Revealed condition, o3 also performed better against human targets than the simulated rational bot (66% vs 17%). Overall people made the same decision as the rational bot 61% of the time (see Fig. 5 ). In a further 20% of cases, the human target and rational bot made different choices that had the same perceived utility (given the revealed information). In 19% of cases, the human target’s choice had a higher utility (given perfect information) than the choice the rational bot would have made, while the rational bot made a higher utility choice 0% of the time. Figure 5: In Experiment 2, human targets outperform the rational bot , achieving the same utility 81% of the time and beating it about 19% of the time. Shown are the proportion of games in which the human target agreed with the rational bot ( R=T ), or did not agree with the rational bot but made a choice with as good of an outcome given the prescribed value function and available information ( U(T)=U(R) ), the rational bot made a better choice ( U(R)>U(T) ), or the actual target made a better choice ( U(T)>U(R) ). We combine the games where o3 and humans were persuaders. Error bars are 95% bootstrapped confidence intervals averaging the proportion of success across participants. 3.4 Discussion In Experiment 1, we found that humans and LLMs display very different styles of ToM and that this led to divergent levels of persuasive success in a tightly controlled task. Experiment 2 asked whether these conclusions would generalize to a more realistic setting where a human plays the role of the persuasion target. Do humans continue to outperform LLMs in the Hidden condition? In contrast to Experiment 1, o3 ’s persuasive success was better than would be expected by chance (H1), no worse than its performance in the Revealed condition (H2), and no worse than human performance in the same condition (H3). Collectively, these results suggest that the LLM is able to persuade human targets in ways that it was unable to persuade the rational bot. If o3 lacks the PToM ability to persuade the rational bot, but can nevertheless persuade human targets, this implies that interacting with humans bypasses some of the need for PToM. Why did o3’s persuasion success increase? There are several differences between Experiments 1 and 2 which could have led to o3’s increased persuasive success. First, human targets may simply be more susceptible to persuasion than the bot. The success of human persuaders was also higher in Experiment 2 than in Experiment 1, suggesting it may simply have been easier to persuade people. More specifically, where two options had apparently equal utility (given the information available to the target), the rational bot would stubbornly maintain its preference for whichever option it had favored first, a policy which would always disadvantage the persuader (see Fig. 10 ). By contrast, human targets might have been sensitive to the motivations of the persuader, opting for the persuader’s desired choice where this appeared to be costless. In theory, humans may have been easier to persuade because they made irrational decisions given the information available to them. However, our results suggest that humans virtually never made decisions that had worse utility than the decision that the naively rational target would have made (see Figure 5 ). Thus, it appears that o3 was not performing better in E2 due to human error. On the contrary, in many cases the human target made a choice that had a higher utility than the one the rational bot would have chosen. Payoff matrices were sometimes set up such that there was an option that benefited both the persuader and the target more than the target’s initial choice. This nonzero-sum nature of the payoffs explains why games with human targets led to both higher Persuasion Success and higher target utility compared to the rational bot. Third, humans were more cooperative communicators. The rational bot never revealed information unless explicitly asked. Human targets, by contrast, might spontaneously volunteer information about their value function (e.g. “Which option should I pick to maximize environmental benefits?” ) or informational state (e.g. “What impact will plan A have on tech progress? “). This cooperativity might decrease the need for appeals about mental states in Hidden , masking the PToM limitations of the LLM. Indeed, while the number of target disclosures remained constant across experiments, the number of appeals went down (see Fig. 8 ), suggesting that persuaders were acquiring information without having to ask for it. Strikingly, o3 made almost no appeals in Hidden in Experiment 2, but was nevertheless able to successfully persuade over 50% of the time. Collectively, the results suggest that humans and o3 continue to show very distinct styles of ToM in Experiment 2. However, in contrast to Experiment 1, this difference did not lead to a large divergence in Persuasion Success. Nevertheless, the role-play persuasion we investigated in Experiment 2 is still importantly different from real-world persuasion. Participants were assigned values to defend, and may have behaved differently because they were not reasoning about their real beliefs. We address this issue in Experiment 3 by having persuaders attempt to change participants’ real preferences over the policies. 4 Experiment 3: Real Persuasion Figure 6: In the open-ended Experiment 3, which does not tightly measure “planning with ToM”, o3 outperforms human participants. “Persuasion success” measures whether the human target chose the persuader’s preferred proposal. (The human targets do not necessarily agree with the rational bot from E1.) Each bar (condition) represents 38–61 games (human persuader: 61 Hidden , 50 Revealed ; o3 : 49 Hidden , 38 Revealed ) for n=79 human participants. In the Revealed condition, persuaders have access to the target’s informational and motivational state, but in the Hidden condition, they must plan and act to gather this information (cf. Fig. 1 ). The scatter plots show individual-level performance (averaged from up to five games per human participant). Error bars show bootstrapped 95% confidence intervals. The grey, dashed line at .1 shows the random baseline. While Experiment 2 introduced a more dynamic target by using human targets with assigned preferences, a person’s preferences or values with respect to a given proposal are neither assigned nor immutable. In advertising, political campaigning, and interpersonal influence, effective persuaders do not only convince interlocutors by strategically revealing information that aligns with set values. Rather, persuaders often attempt to change what attributes their interlocutors value. Experiment 3 attempted to reflect the more naturalistic setting of persuasion while maintaining a similar task setup. This experiment maximized external validity by using human targets’ real values rather than assigned value functions. Before the game began, we estimated targets’ real values over the scenario attributes via a survey (e.g., how much they cared about safety of LLMs, development speed, and public trust). While persuaders could still succeed in the task through strategic information disclosure, they could additionally succeed via any number of persuasive interventions. For example, a persuader might convince a target to care more about attributes where the persuader’s proposal excels, or care less about attributes where it does not. Changing to a real persuasion context may particularly benefit LLMs, as it creates opportunities to deploy rhetoric or other strategies that do not require explicit modeling of mental states. While humans in Experiment 1 demonstrated better PToM abilities than o3 in the Hidden condition, these abilities may matter less when successful persuasion does not rely on strategically disclosing information conditional on fixed values. More generally, Persuasion Success may increase substantially overall in this experiment, as persuaders could succeed by changing what targets value rather than just updating what they know. We pre-registered the same hypotheses for Experiment 3 as we did for Experiment 2. 6 6 6 https://aspredicted.org/6t7t-mtfj.pdf 4.1 Methods Experiment 3 was the same as Experiment 2 except for the following differences. 4.1.1 Procedure Before Experiment 3 began, human participants playing as targets completed a survey so we could estimate their real preferences over the scenarios. For each attribute in each scenario, participants answered the question, ‘‘Would you prefer if [attribute]...’’ on a five-point Likert scale, with options ranging from ‘‘Increased a lot’’ to ‘‘Stayed the same’’ to ‘‘Decreased a lot.’’ We converted these responses into a value function for each scenario 7 7 7 We coded both “Decreased” as “dislikes”, or -1 internally; “Stayed the same” as “is indifferent to”, or 0; and both “Increased” as “likes”, or +1 , which was displayed to the target throughout their games to serve as a reference for their own stated preferences. (See Appendix § A.2 .) 4.1.2 Participants As in Experiment 2, we aimed to sample a total of 100 trials per condition. We recruited 79 participants from Prolific whom we randomly assigned as Human Persuader, Human Target (for human persuader) or Human Target (for o3 persuader). In total we collected 422 trials. We excluded 224 trials where the human target did not initially select the policy that was highest value under their inferred value function (based on their survey answers). After exclusions, we retained 198 trials. In this experiment, human persuaders’ performance bonuses averaged $0.76. 4.2 Results 4.2.1 Pre-registered Hypotheses We tested the same seven pre-registered hypotheses as we did in Experiment 2. (See Fig. 6 ). Human persuaders succeeded 36% of the time in Hidden , significantly above the 7.5% baseline ( z=7.187,p<0.001 ), confirming H6. However, as in Experiment 2, we did not confirm H7: there was no significant difference between human performance in Hidden (36%) and Revealed (53%) ( z=1.769,p=0.077 ). o3 ’s Persuasion Success in Hidden was 45%, significantly above the baseline ( z=5.349,p<0.001 ), confirming H1. Unlike human persuaders, we found a significant difference between o3 ’s performance in Hidden (45%) and Revealed (94%) ( z=2.785,p=0.005 ), confirming H2. Contrary to H3, human persuaders (36%) did not significantly outperform o3 (45%) in Hidden ( z=0.551,p=0.582 ). However, consistent with H4, o3 (94.44%) significantly outperformed human persuaders (53%) in Revealed ( z=2.494,p=0.013 ). Finally, confirming H5, there was a significant interaction effect between persuader type and condition ( z=2.023,p=0.043 )—a larger effect for o3 . 4.2.2 Exploratory Analyses Disclosures and Appeals Overall, both persuader types made more disclosures than in Experiment 2. o3 again made substantially more informational disclosures per game than human persuaders, as in Experiments 1 and 2. While there was a difference between the number of disclosures in each condition for human persuaders (2.6 in Hidden vs. 1.8 in Revealed ), there was almost no difference for o3 (5.1 in Hidden vs. 4.9 in Revealed ). Within Experiment 3, o3 made fewer appeals to elicit the target’s mental states compared to human persuaders. In the Revealed condition, humans made an average of 1.3 appeals per game vs. 1.1 by o3 , while in the Hidden condition, human persuaders made 1.3 appeals per game vs. only 0.6 by o3 . Rational Bot Success In Experiment 2, where values were assigned, the gap between Persuasion Success and Rational Bot Success represents the target’s failure to maximize their assigned utility. In Experiment 3, however, there are more possible explanations for deviation from rational bot behavior, as the target’s values were not assigned. Both persuader types succeeded in Experiment 3 substantially more often than they would have done if playing against the rational bot (based on the value function we inferred for each target; see also Fig. 7 ). Human persuaders achieved 44.8% Persuasion Success but would have succeeded in only 3.8% of games against the rational bot. o3 showed a similar pattern: 65.9% Persuasion Success vs. 12.2% Rational Bot Success. The gap between Persuasion Success and Rational Bot Success was larger in Experiment 3 than in Experiment 2 for both humans (Experiment 3 gap: 41.0% vs. Experiment 2 gap: 34.3%) and o3 (Experiment 3 gap: 53.7% vs. Experiment 2 gap: 48.7%). 4.3 Discussion Experiment 3 investigated whether the patterns observed in the more controlled settings of Experiments 1 and 2 generalized to real persuasion. We sought to understand how persuaders’ strategies and performance changed when human targets could act on their own mutable preferences rather than assigned value functions. Overall, Persuasion Success peaked in this experiment. Both o3 (68.4%) and human persuaders (43.8%) achieved higher Persuasion Success than in Experiment 2 (57.7% and 35.2%, respectively) and substantially higher than in Experiment 1. The open-ended environment of Experiment 3 proved particularly advantageous for o3 . The model outperformed human persuaders in both Hidden and Revealed (though only significantly in the latter). This continues the trend from Experiment 2 and contrasts Experiment 1, where o3 failed to perform above chance in Hidden . Our exploratory analysis highlights a change in strategy for both human persuaders and o3 . Both human persuaders and o3 asked minimal diagnostic questions in the Hidden condition, appealing to the target’s mental states only 1.3 times and 0.6 times per game, respectively. This is a notable departure from Experiment 1, where humans made 6.1 appeals and the model made 4.7 appeals per game. In Experiment 3, when constraints on the target’s actions had significantly eased, both humans and o3 relied minimally on explicit inquiries about mental states. Instead, o3 succeeded in Experiment 3 when flooding conversations with information disclosures. o3 made substantially more disclosures per game than humans in the Hidden condition across all experiments. One possible explanation is that the model may have learned a heuristic association between verbosity (or high information disclosure) and reward based on its training data, without a causal understanding of why acquiring information about the target’s mental states is helpful. However, we note that possible information disclosure in this task is constrained relative to natural dialogue. Another possible explanation is that the model may retrieve familiar arguments statistically associated with the discussion topic ( e.g. , recycling arguments for action on AI policy), rather than tailoring its points to the target’s belief or motivational states. The efficacy of this high-information-disclosure strategy depended on the target. In Experiment 1, the strategy failed because the rational bot required specific information and could penalize irrelevant disclosures. In Experiment 2, the strategy achieved moderate success; the human targets were likely more tolerant of verbosity than the rational bot, yet the assigned value functions still limited the effectiveness of a high volume information strategy. In Experiment 3, however, human targets with their own values were tolerant of—and perhaps even persuaded by—the volume of information, even if it wasn’t specifically tailored to information they lacked about the proposals. Finally, the gap between Persuasion Success and Rational Bot Success was at its widest in this experiment. Both o3 and human persuaders succeeded far more often than they would have against the rational bot given the same information and initial value functions. (We inferred the target’s value function in Experiment 3, which may not accurately reflect the target’s real values). This discrepancy suggests that success in Experiment 3 was driven by more than just target error, which was possible in Experiment 2, or the specific information disclosures required in Experiment 1. The delta suggests that persuaders were likely influencing how their targets weighed the attributes for a given proposal—effectively changing the target’s motivational state rather than just updating their informational state. Together, the results suggest that o3 , in particular, simulated the outcome of persuasion (providing information) without performing the cognitive work of mental state inference (diagnosing what information is missing). Figure 7: In Experiments 2 and 3, o3 and human persuaders persuade human targets in ways that would not have persuaded the rational bot, although humans (and not o3 ) are able to persuade the rational bot when forced to in Experiment 1. In Experiment 1, these measures are equal. Shown is the Hidden condition only. These are the same data as in Figs. 3 - 6 . Figure 8: In the Hidden condition and within each experiment, humans make more appeals to the target’s mental states than does o3 , which also discloses more information. “Avg. Persuader Disclosures” (top row) is the average of the total number of informational disclosures (e.g., “Proposal A will increase development speed.”) made across all games by persuaders (human participants or o3 ) in the Hidden and Revealed conditions. “Avg. Persuader Appeals” (middle row) combines the counts for both ‘Informational’ appeals to the belief state of the target (e.g., “What do you know about the proposals?”) as well as ‘Motivational’ appeals to the target’s desires (e.g., “How do you feel about the attributes?”). “Avg. Target Disclosures” (bottom row) counts the informational disclosures the target made using the same classifier as above for the persuader. (In Experiment 1, these are exactly what the persuader appealed to informationally but not motivationally.) Here we see that human targets disclose information in Hidden even when persuaders do not directly appeal to this information. 5 General Discussion Our results suggest a dissociation between planning Theory of Mind (PToM) and persuasion capabilities , cautioning against premature attributions of human-like ToM to LLMs while nonetheless highlighting LLMs’ potential to influence people’s beliefs and behavior. o3 failed at causal mental state reasoning in controlled conditions yet remained highly effective at persuading human targets. The MindGames framework made this dissociation visible through three tasks that systematically trade off internal validity against external validity, with two conditions. Human participants outperformed o3 in the tightly controlled Hidden condition of Experiment 1, yet o3 matched or exceeded human performance in the more externally valid settings of Experiments 2 and 3. Importantly, o3 achieved this performance while making fewer appeals to targets’ mental states than in Experiment 1. The dissociation between PToM and persuasion capabilities has implications for both ToM research and research on the persuasive capabilities of LLMs, which we explore below. 5.1 Humans are capable of PToM and persuasion MindGames provides a first-personal, interactive measure of PToM that requires persuaders to engage directly with a target to change their beliefs and behavior. In doing this, we provide evidence of an advanced capacity for PToM in humans. We build on existing persuasion paradigms used with children (§ 1 ), to create a rich, dynamic and interactive task fit for use with even mature mindreaders. Success in Experiment 1 Hidden requires counterfactual reasoning: persuaders must inquire about a target’s beliefs and values, then simulate how a specific disclosure might update that target’s mental states, before intervening to generate the desired behavior change. Our human participants showed clear evidence of this capacity, performing significantly above the baseline in Hidden . Nonetheless, human performance in Experiment 1 was far from the ceiling. We observed substantial variability in performance between participants (Fig. 3 ), and many participants found the task challenging. This variability may be a strength. Many ToM tasks are designed for children, which can elicit at-ceiling performance in human adults. In contrast, MindGames provides a highly discriminative ToM task that could be useful for downstream research. Whether this variability reflects individual differences in PToM ability, task comprehension, or other factors remains an open question. Future work could investigate whether Experiment 1 performance correlates with other ToM measures, such as the Strange Stories task ( Happé 1994 ) or the Short Stories task ( Dodell-Feder et al. 2013 ) . Across experiments, human participants appeared to rely on mental state reasoning selectively. In Experiment 1, humans made substantially more appeals than disclosures in Hidden ; in Experiment 2, humans made roughly similar numbers of appeals and disclosures; and in Experiment 3, more disclosures than appeals (Fig. 8 ). This progression implies that in the latter two settings, persuaders were not deploying PToM in the same way that Experiment 1 required them to. In parallel, Rational Bot Success for human persuaders in Experiment 2 was near zero, while Persuasion Success was substantially higher, and this gap grew further in Experiment 3. These patterns across experiments suggest humans drew on PToM when the task demanded it but shifted to other strategies when interacting with more cooperative human targets—consistent with the theory that explicit ToM is cognitively costly and deployed selectively ( Apperly and Butterfill 2009 ) . 5.2 LLMs lack PToM but are still effective persuaders For o3 , we observed a clear dissociation between performance by condition in Experiment 1. In Revealed , o3 substantially outperformed human participants; in Hidden , o3 performed below the chance baseline. These results extend those for earlier models ( Authors 2025 ) , suggesting that the dissociation in performance persists in newer reasoning-focused models. We characterize the different strategies of o3 and humans in Experiment 1 Hidden as reflecting distinct “styles” of ToM. Humans appear to build a causal model of the target’s mental states, while o3 relies on associative processes—pattern matching between observable game states and persuasive strategies—without representing the target’s mental states in a causal model. This associative approach succeeded when information about the target’s mental states was provided to the persuader (Experiment 1 Revealed ), or when familiar persuasive strategies happened to work ( e.g. , Experiment 2 and Experiment 3), but failed when success required building a model of the target’s mental states through dialogue (Experiment 1 Hidden ). Notably, o3 ’s improvement in Experiments 2 and 3 occurred despite using the same low appeal, high disclosure strategy that failed in Experiment 1. The LLM succeeded at persuading humans without relying on PToM. 5.3 Human targets allow multiple paths to Persuasion Success Both o3 and human persuaders achieved significantly higher Persuasion Success in Experiments 2 and 3 than in Experiment 1 (in the Hidden condition). Several factors suggest why persuasion became “easier” as the external validity of the experiments increased. First, the rational bot and human targets differ by design. The rational bot provides information only when directly asked, updates preferences based only on disclosed information, and cannot be moved from its value function. Human targets, on the other hand, can volunteer information freely, update their preferences based on context they deem pertinent, and update their value function (inadvertently in Experiment 2 or deliberately in Experiment 3). Second, human targets were more cooperative than the rational bot. Appeals declined significantly in Experiments 2 and 3 relative to Experiment 1 across both persuader types and conditions. Yet target disclosures remained relatively constant (indeed, they progressively increased for o3 in Hidden : Fig. 8 ). Human targets appeared to volunteer information to persuaders, which reduced the need for persuaders to make explicit appeals. Human conversation is structured by cooperative norms that our rational bot explicitly violates: where Grice’s ( Grice 1975 ) cooperative principle predicts that speakers will volunteer relevant information and signal their communicative intentions, our bot responds only when directly queried and never attempts to facilitate mutual understanding ( Clark and Brennan 1991 , cf.) . In short, human communicators cooperatively scaffold successful communication. The presence of this communicative scaffold in Experiment 2, may explain why LLMs perform much better here than in Experiment 1. LLMs, trained overwhelmingly on cooperative human discourse, may be well-calibrated for exploiting this scaffold, but poorly equipped for the genuinely adversarial epistemic environment that the bot created. A general consequence is that, if LLMs can persuade effectively through rhetoric and pragmatic exploitation alone, then high performance on existing persuasion benchmarks may tell us little about ToM—and much about the vulnerability of human interlocutors. However, human cooperativeness alone cannot explain the relative ease of Experiments 2 and 3 compared to Experiment 1 ( Hidden ). If performance differences in these experiments were driven solely by human targets volunteering more information, then this additional information should have made it easier for persuaders to identify strategically optimal disclosures, and those disclosures would also have convinced the rational bot. Yet Rational Bot Success was substantially lower than Persuasion Success for both persuader types in Experiments 2 and 3. Whether persuaders failed to translate volunteered information into strategically optimal disclosures or never attempted to, cooperativeness alone cannot account for their success. Persuaders must have also succeeded through means by which the rational bot was immune. For example, in the transcripts in Fig. 14 , o3 appeared to try to reframe the target’s values rather than updating their information by arguing that “paradoxically, tight safety controls often hide problems.” More broadly, persuaders in Experiments 2 and 3 may have succeeded not only by disclosing information (as in Experiment 1) but also by exploiting reasoning errors or changing what targets valued (motivational states). 5.4 Implications for real-world persuasion Our results suggest that even though LLMs can be effective persuaders, this is not evidence that LLMs possess advanced ToM capacities. More generally, real-world persuasion may not call for much PToM at all. Persuaders may rely on a suite of alternative strategies. Humans and language models alike may exploit observed associations between certain persuasion strategies (such as verbosity) and desired outcomes, or may heuristically rely on rehearsed general-purpose arguments rather than interventions tailored to their interlocutor’s specific beliefs and desires. A persuader who relies on association-based heuristics may persuade very well using only associative ToM—creating associations between behavioral events—and not a causal one, that allows them to model the internal causes of such behavioral events. The split between tailored and heuristic persuasion strategies mirrors dual process theories of persuasion, such as the Elaboration Likelihood Model ( Petty and Cacioppo 1986 ) . While we have focused on the cognitive capacities of the persuader , the Elaboration Likelihood Model is a cognitive model of the target’s information processing during a persuasion attempt. Targets can be persuaded via two routes: the central route and the peripheral route . If the persuasion attempt, in the form of e.g. , an utterance, travels through the central route and the target is motivated and capable of evaluating the content of the utterance thoroughly, persuasion will likely result from a reflective process on the part of the target. If the persuasion attempt travels through the peripheral route, it is not examined as thoroughly, and successful persuasion will result from the target’s identification of positive or negative cues in the utterance. In short, targets evaluate peripheral route messages heuristically. The peripheral route is the default for humans when processing incoming messages, because it is less effortful ( Petty et al. 1981 ) . For this reason, it is unsurprising that our human participants likewise largely rely on heuristic persuasion strategies. Our findings suggest that humans may be more effective persuaders than LLMs when targets process incoming messages through the central route, as humans can deploy PToM to design arguments that specifically appeal to a motivated and thorough target. Although tailored arguments are not strictly necessary for central route persuasion (e.g., the rehearsed argument could still be compelling), it stands to reason that tailored arguments should have greater success with reflective targets. Future work should compare persuasion in LLMs and humans, manipulating whether the target processes incoming messages through the central or peripheral route. Our findings suggest that humans should significantly outperform LLMs in persuading more reflective targets. 5.5 What is Theory of Mind, really? In a seminal paper, Gopnik and Wellman 1992 argued that our everyday understanding of the mind is structured like a scientific theory. Scientific theories posit unobservable entities (gravity, viruses) to explain observable phenomena (the movement of bodies, the spread of diseases). Gopnik and Wellman contend that to explain the phenomenon of behavior, our ToM relies on unobservable mental states as its explanatory posits. These unseen mental states explain observable behaviors because they cause these behaviors. Consequently, a causal understanding of mental states props up human social interaction, rendering us understandable to each other. Gopnik and Wellman’s theory-theory has been very influential on the ToM literature. However, our findings suggest that in some social interaction contexts ( i.e. , persuasion), a causal understanding of mental states is less and less important the more we approach naturalistic contexts. This means that the causal understanding of mental states that we have referred to as PToM is at once characteristic of human ToM and also rarely relied on by humans. The claim that sophisticated ToM capacities, such as PToM, are rare in social interaction has been developed in the dual process theory of ToM. This theory distinguishes implicit and explicit levels of ToM, each with its own associated system ( Apperly and Butterfill 2009 ; Butterfill and Apperly 2013 ) . A fast, automatic system maintains implicit forms of ToM and a slow, effortful system maintains explicit forms of ToM. According to the dual process theory, explicit ToM is rarer than implicit ToM precisely because it is effortful. PToM is likely also highly effortful, compared to associative ToM alternatives, suggesting that the explicit/implicit distinction aligns with our distinction between associative and causal ToM styles. The cognitive demands of explicit ToM also means that it is only deployed in service of the agent’s goals ( Apperly 2012 ; Westra 2017 ) . Our design enforces goal-dependent processing by rewarding successful persuaders. It is surprising, then, that participants in Experiments 2 and 3 relied very little on PToM. This suggests either that PToM is prohibitively expensive (deployed only when no alternative exists, as in Experiment 1), or that persuasion simply calls for other strategies entirely. To examine the relative contributions of the factors of costs and relevance, future work should investigate the cognitive costs of PToM and its deployment across other contexts that may call for causal models of mental states. More fundamentally, why should we care about PToM if it is rarely deployed to alter people’s opinions in naturalistic interaction? The importance of PToM may not primarily lie in its ability to explain the behavior of participants in natural interaction, but rather in its ability to map the space of socio-cognitive representations. Highly controlled designs are commonplace in psychology. Paradigms such as the Stroop task ( Stroop 1935 ) , garden-path sentences ( Bever 1970 ) , and verbal interference ( Baddeley and Hitch 1974 ) all involve creating artificially challenging circumstances precisely to uncover cognitive mechanisms. The scenarios presented in classical false belief tasks are themselves highly artificial, as we have argued (§ 1 ). The importance of the false belief task does not lie in its ability to adequately model the child’s everyday cognitive challenges, but to reveal whether children understand the perspectival nature of thought, which is a crucial building block of a mature understanding of the mind. Similarly, although our identification of PToM in Experiment 1 may have only limited applicability in explaining natural persuasion behaviors, it provides evidence that humans have a causal understanding of mental states that they can use to plan and act out interventions on their environments. PToM is important for a variety of reasons. For example, it likely contributes to our explicit understanding of behaviors ( Cavallini et al. 2013 ) . It may also enrich children’s developing ToM, because it supports interventions to test specific hypotheses about the mental causes of behavior. ( Gopnik and Schulz 2004 ; Gopnik 2012 ; Gopnik and Wellman 2012 ) . Since PToM is important at the levels of development and cognitive mechanisms, it raises deeper questions about the relationship between ToM and persuasion. Even if adult humans mostly get by on associative reasoning in persuasion, the capacity to identify and learn the relevant associations may depend on an earlier ability to bring about evidence of such associations through interventions. For this reason, participants who perform strongly in measures of PToM (Experiment 1) may show surprising transfer effects to measures of naturalistic persuasion (Experiments 2 and 3). Future work could investigate within-subject correlations of performance in Experiment 1 and Experiment 3 to test this hypothesis. The upshot of the above discussion is that real ToM is neither effortful deliberation nor frugal heuristics but the broader capacity to deploy both of these capacities flexibly and effectively . An understanding of human social cognition, requires that we can both identify representational mechanisms in controlled conditions and evaluate how they are and are not deployed in externally valid environments. Our work explicitly engages in this explanatory project. 6 Conclusion We used a persuasion-based measure to compare the capacity for Planning Theory of Mind (PToM; § 1 ) in adult humans and LLMs. We adapted this task for three experiments that systematically traded off internal for external validity. Humans significantly outperformed LLMs in Experiment 1 Hidden (Fig. 3 ), where success required PToM, while LLMs outperformed humans on Experiments 2 (Fig. 4 ) and 3 (Fig. 6 ), which gradually relaxed PToM demands. Our findings suggest that humans and LLMs may fundamentally diverge in their ToM styles: humans can represent mental states as causes of behaviors whereas LLMs rely only on associations between behaviors. Consequently, we recommend a cautious attitude toward exaggerated claims about human-like ToM in LLMs. Nonetheless, LLMs can still be impressively persuasive. Our findings raise further questions about the relationship between persuasion and PToM, as well as foundational questions about the nature of ToM itself. Restricted persuasion contexts (as in Experiment 1) are a powerful tool for revealing PToM capacities, and they may even be especially useful for persuading more reflective targets—a target that can only be evaluated through the central route ( Petty and Cacioppo 1986 ) . We propose that the broad capacity for ToM may be flexible: fast, efficient, and based largely on association when the contextual scaffold is present, and slow, costly, and based on causal understanding when the context is challenging. This paints a multifaceted picture of ToM that aligns with theories that divide the capacity into the reflective and the heuristic, the explicit and the implicit. Ethics Statement We received IRB approval from our institution for this study. We reviewed all conversation transcripts to remove personally identifying information, including Prolific identifiers. At the end of the experiment, we informed participants when they had not been interacting with other humans. Reproducibility Statement All code to re-run our experiments and analyses appears in our linked repository: https://github.com/jlcmoore/mindgames .