Reasoning Promotes Robustness in Theory of Mind Tasks
Ian B. de Haan, Peter van der Putten, Max van Duijn · 2026
Read Reasoning Promotes Robustness in Theory of Mind Tasks by Ian B. de Haan, Peter van der Putten, Max van Duijn (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-16853.txt.
Introduction
Ian de Haan, Peter van der Putten, and Max van Duijn test how chatbots read minds in tales. Mind-read tests ask what a tale's folk think or know. Chatbots now score high on such tests. That sparks a row on what the scores mean. Their 2026 preprint asks if deep thought steps make scores more robust.
Thought-trained bots learn by steps with checked rewards. The team pits such bots on mind tests with twists. Twists can break bots that lean on stock cues. Robust scores would mean the bots track minds, not cues. The work helps labs judge social skill in bots with care.
Catalog record
| CREATOR | Ian B. de Haan, Peter van der Putten, Max van Duijn |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-16853
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Reasoning Promotes Robustness in Theory of Mind Tasks Ian B. de Haan, Peter van der Putten, Max van Duijn Abstract . Large language models (LLMs) have recently shown strong performance on Theory of Mind (ToM) tests, prompting debate about the nature and true performance of the underlying capabilities. At the same time, reasoning-oriented LLMs trained via reinforcement learning with verifiable rewards (RLVR) have achieved notable improvements across a range of benchmarks. This paper examines the behavior of such reasoning models in ToM tasks, using novel adaptations of machine psychological experiments and results from established benchmarks. We observe that reasoning models consistently exhibit increased robustness to prompt variations and task perturbations. Our analysis indicates that the observed gains are more plausibly attributed to increased robustness in finding the correct solution, rather than to fundamentally new forms of ToM reasoning. We discuss the implications of this interpretation for evaluating social-cognitive behavior in LLMs. 1. Introduction In recent years, large language models (LLMs) have become powerful and useful enough to become part of our day-to-day lives, and are increasingly being used in more autonomous and agentic settings ( 19 ) . Users tend to attribute human-like intentionality and reasoning to those models, even though the extent to which the models are capable of complex reasoning remains, to a large extent, an open research problem. ( 40 ; 24 ) Due to the complexity of these systems, even if all information about their architecture is known, it is still difficult to determine and predict their actual behavior. Considering this, researchers in a multitude of fields started investigating those systems and their intelligence by interacting with them and understanding their behavior, rather than by analyzing their architecture. ( 24 ) In this context, previous work has debated the extent to which LLMs demonstrate theory of mind (ToM) behavior, that is, the ability to reason about mental states, beliefs, intentions, and desires. Some early claims were optimistic of such a skill emerging to some extent ( 13 ) . However, follow-up criticism ( 30 ) led to the creation of benchmarks testing these abilities more comprehensively ( 32 ; 11 ; 4 ) . Since then, so-called reasoning models, like OpenAI’s GPT-5, Anthropics’s Claude, and DeepSeek R1, have been released. The innovation behind these models is that they are trained, via reinforcement learning, to “think before answering", that is, they are trained to produce a complex chain of thought before answering the query, a form of inference-time scaling ( 16 ; 17 ; 5 ; 20 ) . This new type of model might not only perform significantly better in ToM tasks, but the chain-of-thought itself might yield important insights about what those models are actually doing to answer the queries. The goal of this paper is, therefore, to review the literature around reasoning models and connect this to ToM. Furthermore, additional experiments will be run to shed light on how state-of-the-art reasoning models perform relative to non-reasoning ones. Those experiments involve prompting models with established psychological tests for ToM from the ( 32 ) battery, plus newly designed prompts based on ( 30 ) , to test model robustness. Lastly, benchmark results taken from ( 10 ) are analyzed to further substantiate our findings. The remainder of this paper is structured as follows: Section 2 provides an overview of related work on the subject. Section 3 introduces the materials and methods employed in the experiments, and Section 4 presents the experimental results; Section 5 interprets the obtained results, points out some limitations of the current work, and suggests new directions in which the research can be expanded; Section 6 sums up the findings; Appendix A contains the newly introduced test. 2. Background In this section, a bibliographical review in the context of the research done is presented. The contents covered are 2.1 – a review of what chains of thought are and the recent reinforcement learning with verifiable rewards (RLVR) trained reasoning models, and 2.2 – an introduction on the topic of ToM, how it would be a useful skill for LLMs to have, and the present research investigating to which extent they do. 2.1. Chains of Thought and Reasoning Models Traditional LLM models, based solely on next token prediction, face a series of challenges, among them are: • Their performance increases with the number of parameters and the size of the dataset ( 9 ) , and we may run out of human-generated data between 2026-2032 ( 33 ) . Furthermore, current models are often under-trained ( 8 ) . • By default, they don’t display human-interpretable thoughts • It doesn’t seem like increasing their size alone would yield in satisfactory performance in fields like math and logical reasoning tasks ( 23 ) . In this scenario, ( 34 ) demonstrated that simply feeding LLMs with a few-shot prompts, inducing them to respond in the form of <input, chain of thought, output>, not only generated step-by-step explanations of natural language but also increased performance in math and logical reasoning tasks. Figure 1. Image illustrating the chain-of-thought prompting techniques (a) Traditional prompting, doesn’t elicit CoT (b) Few-shot prompting, elicits CoT at the cost of a few examples (c) Zero shot prompting, elicits CoT for free ( 34 ) also envisioned that, on top of that, in principle, chains of thought (CoTs) could help separate a problem into smaller tasks, allowing models to decompose problems and allocate a different amount of time to each of their sub-problems. Several variants of prompting style were proposed, notoriously simply including ‘let’s think step by step’ in the prompt, lead to LLMs producing CoT with zero-shot training ( 12 ) . Figure 1 illustrates those prompting techniques. With CoT getting the spotlight, many different ideas on how to induce and refine the reasoning demonstrated by LLMs started to appear ( 34 ) . RLVR proved itself to be effective at inducing complex reasoning in models and, using this technique, a new wave of models, refined to produce chains of thoughts, started emerging and were denominated ‘reasoning models’ ( 38 ; 20 ; 19 ) . The implementation details of those models are an important topic, but outside of the scope of this paper. However, although promising results in several fields, particularly in mathematics and programming, ignited hope that RLVR-trained LLMs could achieve a more general form of intelligence, ( 39 ) demonstrated that, in reality, the gained performance of those models comes from a more efficient sampling of answers on problems that are already solvable by the base model, not introducing fundamentally new reason capabilities. Therefore, the reasoning capacity of a reasoning model remains bounded by its base model. Reasoning was also initially viewed as promising in the way towards tracking reward hacking in LLMs, but it has been shown that, at least in scenarios where the CoT is not necessary for such behavior, the verbalization of it is very low ( 3 ) . This finding also makes one conclude, more generally, that reasoning models don’t always include their true reasoning in their think tokens, although the same article also showed that, at least part of the time, they do. 2.2. Theory of Mind and LLMs The term “theory