Theory of Mind and Persuasion Beyond Conversation: Assessing the Capacity of LLMs to Induce Belief States via Planning and Action
Ben Slater, Matteo G. Mecattaf, Lucy G. Cheke, John Burden, Winnie Street · 2026
Read Theory of Mind and Persuasion Beyond Conversation: Assessing the Capacity of LLMs to Induce Belief States via Planning and Action by Ben Slater, Matteo G. Mecattaf, Lucy G. Cheke, John Burden, Winnie Street (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-31916.txt.
Introduction
Slater and four colleagues test whether language models can shape what others believe by acting, not by talking. Theory of mind benchmarks usually ask passive questions about stories. Agentic systems instead move objects and arrange scenes, so belief change through planning and action is the skill that deployment will actually exercise.
Their NCP-ExploreToM framework hands models a target belief state and asks them to move objects or direct characters between rooms to achieve it. Six frontier models and human participants faced 600 task instances. GPT-5 succeeded on approximately 80 percent of tasks in the agentic setting, the only model to beat humans overall, though it stayed less robust across contexts. True-belief goals proved easier than false-belief goals for models and humans alike.
Catalog record
| CREATOR | Ben Slater, Matteo G. Mecattaf, Lucy G. Cheke, John Burden, Winnie Street |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 66 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.31916
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Theory of Mind and Persuasion Beyond Conversation: Assessing the Capacity of LLMs to Induce Belief States via Planning and Action Ben Slater, Matteo G. Mecattaf, Lucy G. Cheke, John Burden, Winnie Street Abstract Theory of Mind (ToM) benchmarks for Large Language Models (LLMs) typically rely on passive question-answering formats, but the deployment of LLMs in increasingly agentic and autonomous forms demands new evaluations. In this paper we evaluate an agent’s ability to induce specific belief states in other agents by taking actions rather than using conversational persuasion, a capability we call Non-Conversational Planning ToM (NCP-ToM). NCP-ToM is likely to be essential for many agent use-cases, including within user-assistant interactions and pedagogical contexts, but may also present manipulation or misinformation risks. Using a novel framework, NCP-ExploreToM, we subvert the conventional task structure by providing models with a set of belief state goals and requiring them to move objects or direct characters into rooms to achieve their goals. We evaluated six frontier models, including GPT-5, Gemini 2.5 Pro and the Claude 4 series, and a cohort of human participants, across 600 task instances. GPT-5 was successful on approximately 80% of tasks in the agentic setting, and was the only model to outperform human participants on our task, but was still less robust than humans across contexts. We additionally found that all models, like humans, performed better on tasks inducing true belief states than false belief states, which is a positive signal for alignment efforts. These findings highlight emerging social-reasoning capabilities in LLMs for non-conversational task completion and underscore the necessity of agentic evaluations for understanding the safety and alignment of autonomous social agents. 1 Introduction Theory of Mind (ToM)—the ability to infer the mental and emotional states of others—is key to social cooperation in humans ( 10 ; 3 ; 25 ) and other animals ( 8 ; 24 ) . In recent years, there has been an explosion of interest in probing the social reasoning capacities of Large Language Models (LLMs), and in particular their ToM ( 27 ; 14 ) , reflecting their increasingly widespread deployment in social roles, including as companions, assistants, teachers, and coworkers. Understanding the extent and limitations of LLM ToM has become even more crucial as LLMs are embedded in agentic systems capable of taking actions using the internet, tools and APIs and interacting with other LLM-based agents without full human oversight ( 2 ) . In this work we address a significant gap in the LLM ToM literature as it pertains to LLM-based agents: assessing whether or not LLMs can plan a series of actions to produce certain belief states in other agents without using conversational persuasion . We call this capability Non-Conversational Planning Theory of Mind (NCP-ToM). NCP-ToM is likely to be essential for many AI agent use-cases. For example, in a user-assistant setting, an assistant may want to bring about the true belief in the user that a friend’s plane is likely to arrive late, by highlighting up to date flight data. In a business setting, an agent may want to stop information about a new product launch from leaking early, and so choose to maintain the false belief of journalists that a product is not being developed, by ensuring that released documents do not include information that may be used to infer its development. However, LLM NCP-ToM might also create significant safety risks if agents’ goals for the belief-states of other actors are misaligned, if their goals are manipulated by bad actors, or if steps they take to achieve belief-state goals create unintended negative externalities. For instance, if an agent were seeking to frame another for a misaligned action they had taken, they might make information that supports the false belief the action was taken by the other agent easily available, while suppressing information to the contrary. Each of these examples show cases in which an LLM may influence a belief state without the use of conversational persuasion. (no goal) Sally Marble Anne Basket Box Sally places the marble in the basket Sally Marble Anne Basket Box Sally leaves the room, then Anne moves the marble to the box Question: Where does Sally believe the marble is? Goal: Sally believes the marble is in the basket, but it is in the box Sally Marble Anne Agent Basket Box The agent places the marble in the basket Sally Marble Anne Agent Basket Box The agent asks Sally to leave the room, then moves the marble to the box (no question) Figure 1 : An illustration of our approach using the conventional Sally-Anne task from Psychology ( 1 ) . The left hand panel shows a conventional Sally-Anne test, in which the participant is a passive observer to the scene in which Sally gains a false belief. The right hand panel shows our adaptation of this approach, where the participant is placed as an agent inside the scene and tasked with eliciting this false belief in Sally. Given that NCP-ToM is a fundamentally agentic form of ToM, we develop a task that subverts the classical Q&A format of ToM evaluations (where subjects are provided with a series of events, and questioned about the mental states of actors as a result of these events) by providing LLM agents with a set of goals for the belief states of characters, and evaluating their capacity to achieve those goals by taking actions in an environment. In our setup, LLM agents can achieve their belief state goals by directing characters to different rooms in a simulated environment to curate the observations of those characters and produce certain belief states in them (Illustrated in Figure 1 ). The complexity of our task is varied by increasing the order of intentionality ; the number of belief states included in the reasoning process. For example, a more complex task may involve making person A believe that person B believes something, as opposed to making person A believe something ( 32 ) . Complexity is also varied by increasing the total number of belief states to produce within a given task. We find that the most recent models can complete many NCP-ToM tasks, but that increasing the order and total number of belief states increases the difficulty of the task, models perform better on true belief tasks than false belief tasks, and their performance is sensitive to context. We collect data from human participants as a performance baseline for our task, and find they are only outperformed by GPT-5, but notably have performance which is less sensitive to context than all models. These results suggest that current state of the art models are capable of planning for belief states and are more likely to be successful for non-deceptive forms of belief state change. However, our tasks remain relatively simple compared to real-world deployment settings, so it would be fruitful to evaluate how well models can utilise these capabilities in deployed environments. A second motivation of our evaluation is to assess whether performance on Q&A style tasks can predict performance on agentic versions of those tasks. We adapt the ExploreToM framework ( 28 ) , and by presenting agentic and Q&A versions of the same task, we directly compare performance across these two