CoSToM : Causal-oriented Steering for Intrinsic Theory-of-Mind Alignment in Large Language Models
Mengfan Li, Xuanhua Shi, Yang Deng · 2026
Read CoSToM : Causal-oriented Steering for Intrinsic Theory-of-Mind Alignment in Large Language Models by Mengfan Li, Xuanhua Shi, Yang Deng (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-10031.txt.
Introduction
Li, Shi, and Deng present CoSToM, a causal-aimed steering setup matching language models' Theory of Mind acts with their internal knowledge. Standard benchmarks show promise, but models often fail complex set cases, leaning on prompt props to mimic thought. Causal tracing maps where Theory of Mind marks live inside the model, showing how internal layers encode basic social sense. Aimed firing steering within those key layers then lifts human-like social thought and downstream chat quality, moving from gear reading to active action.
Catalog record
| CREATOR | Mengfan Li, Xuanhua Shi, Yang Deng |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45824 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.10031
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CoSToM : Causal-oriented Steering for Intrinsic Theory-of-Mind Alignment in Large Language Models Mengfan Li, Xuanhua Shi, Yang Deng Abstract Theory of Mind (ToM), the ability to attribute mental states to others, is a hallmark of social intelligence. While large language models (LLMs) demonstrate promising performance on standard ToM benchmarks, we observe that they often fail to generalize to complex task-specific scenarios, relying heavily on prompt scaffolding to mimic reasoning. The critical misalignment between the internal knowledge and external behavior raises a fundamental question: Do LLMs truly posses intrinsic cognition, and can they externalize this internal knowledge into stable, high-quality behaviors? To answer this, we introduce CoSToM 1 1 1 Pronounced as “costume”. ( C ausal- o riented S teering for ToM alignment), a framework that transitions from mechanistic interpretation to active intervention. First, we employ causal tracing to map the internal distribution of ToM features, empirically uncovering the internal layers’ characteristics in encoding fundamental ToM semantics. Building on this insight, we implement a lightweight alignment framework via targeted activation steering within these ToM-critical layers. Experiments demonstrate that CoSToM significantly enhances human-like social reasoning capabilities and downstream dialogue quality. 1 Introduction Theory of Mind (ToM), the inherent ability to attribute mental states such as beliefs, desires, and intentions to others, stands as a hallmark of human social intelligence 3 ; 46 . It enables individuals to anticipate others’ motives, knowledge states, and reactions, and thus forms the cognitive basis of complex social communication, such as persuasion 50 ; 34 ; 49 , negotiation 16 ; 61 ; 28 ; 62 and recommendation 30 . With the rapid evolution of Large Language Models (LLMs) 15 ; 17 , there is growing optimism that these models may have begun to exhibit ToM-like reasoning capabilities. Such claims have primarily been supported by recent benchmarks that probe LLMs’ ability to interpret mental states under controlled structured scenarios 24 ; 41 ; 54 ; 63 or social contexts 59 ; 11 ; 6 . Figure 1: A negotiation scenario illustrating the gap between ToM inference and ToM-aligned behavior in LLMs. (Left) The model correctly infers the user’s desire for firewood . (Middle) Under a generic task instruction, the model fails to apply this inferred mental state, producing an incoherent offer ( i.e. , water ). (Right) When explicitly prompted to consider mental states, the model generates a contextually appropriate response. However, a critical gap remains between these promising observations and the reliability of the underlying mechanisms. Although LLMs can infer human intentions to some extent, recent studies 4 ; 31 ; 24 ; 41 reveal that they fail to generalize to task-specific scenarios with genuine ToM reasoning. As illustrated in Figure 1 (Left vs. Middle), a critical misalignment exists between internal knowledge and external behavior: even when LLMs correctly answer ToM questions, their dialogue agents may still fail to negotiate effectively. Moreover, observed ToM-like behaviors often depend on carefully engineered prompts that scaffold perspective-taking 29 ; 26 ; 39 ; 10 ; 21 . As shown in Figure 1 (Middle vs. Right), once the explicit instruction to “infer and respond” replaced by a generic command, the model fails to ground its response in the mental states it implicitly encodes, reverting to incoherent generation. This suggests that current ToM-like behaviors may not reflect stable, intrinsic cognition, but instead ad hoc simulations triggered by instruction. Inspired by recent advances in mechanistic interpretability 35 ; 1 ; 58 ; 9 ; 22 , we move beyond black-box prompt engineering and surface-level behavioral observation. We aim to uncover the intrinsic nature of social reasoning in LLMs, specifically investigating whether LLMs possess ToM-grounded social reasoning, how they are internally represented, and whether this internal knowledge can be effectively translated into stable, high-quality behaviors. Our investigation proceeds in three stages. First, we seek to interpret the ToM reasoning capability within LLMs. We analyze activation patterns using causal tracing to identify whether ToM-specific features exist and locate where they reside within the model stack. This leads to our first research question: (RQ1) In which layers does ToM-related information emerge and persist? Second, identifying where ToM features exist offers a foundation for intervention. We examine whether steering internal activations can modulate the model’s ToM reasoning capabilities, moving from observation to control: (RQ2) To what extent can internal representations be leveraged to steer and improve ToM reasoning? Finally, improvements on ToM benchmarks do not necessarily translate to better ToM-aligned behavior in downstream tasks. As inferring mental states is fundamental to predicting socially appropriate continuations 56 ; 13 , genuine ToM alignment of LLMs should exhibit enhanced conversational performance. We therefore examine the downstream impact directly: (RQ3) Can manipulating these internal representations of LLMs effectively enhance response quality in dialogue tasks? To address these research questions, we introduce a novel and comprehensive framework for C ausal- o riented S teering of ToM alignment in LLMs, named CoSToM . This framework aims to intrinsically align LLMs with ToM-like social reasoning by moving from interpretation to intervention. Specifically, CoSToM operates in two stages: it first identifies ToM-sensitive layers through causal tracing, and then steers these layers using activation manipulation. Given the dialogue history as input, causal tracing interprets the context encoder’s activations by probing them with ToM-focused questions, while activation steering supervises and adjusts these activations to better align the model’s internal representations with ToM-related features. Our contributions are as follows: • ToM Interpretation: We systematically trace ToM-related features across layer-wise activations in LLMs, revealing that these features are predominantly encoded in early layers of LLMs. • Efficient and Lightweight ToM Intervention: We propose CoSToM , a lightweight alignment framework that induces stable, human-like social reasoning via targeted activation steering, requiring updates to only a small subset of parameters in the identified ToM-critical layers. • Enhancement on Dialogue Tasks: Experiments on negotiation and persuasion dialogues demonstrate that internal ToM alignment via CoSToM leads to substantial improvements in dialogue quality. Notably, CoSToM functions as a plug-and-play module that generalizes effectively across diverse social interaction tasks. 2 2 2 https://github.com/CGCL-codes/CoSToM Figure 2: The overview of the CoSToM framework. 2 Related Work ToM in LLMs Recent work on ToM in LLMs has focused on evaluating and enhancing their ability to infer mental states such as beliefs and intentions, often using benchmarks adapted from classical psychological tests 41 ; 24 ; 55 . To address observed performance limitations, existing approaches primarily adopt either prompt-based scaffolding, which elicits ToM reasoning through carefully engineered instructions 52 ; 26 ; 39 ; 10 ; 21 ; 40 , or neuro-symbolic and Bayesian frameworks that integrate LLMs with explicit cognitive models for mental-state inference 7 ; 33 ; 3 ; 24 ; 41 ; 63 . While effective in structured settings, these methods rely on external scaffolding and offer limited insight into or control over ToM representations inside LLMs. ToM in Dialogue Agents Beyond static benchmarks ( e.g. , Sally–Anne tests), recent work has increasingly evaluated ToM within dynamic dialogue settings, where agents must maintain contextually appropriate and socially sensitive interactions, such as persuasion 60 , negotiation 6 , education 38 , stress testing 27 , and recommendation 30 . To improve performance in these settings, several approaches aim to align dialogue responses with inferred internal