Social-R1: Towards Human-like Social Reasoning in LLMs

Jincenzi Wu, Yuxuan Lei, Jianxun Lian, Yitian Huang, Lexin Zhou, Haotian Li, Xing Xie, Helen Meng · 2026

Read Social-R1: Towards Human-like Social Reasoning in LLMs by Jincenzi Wu, Yuxuan Lei, Jianxun Lian, Yitian Huang, Lexin Zhou, Haotian Li, Xing Xie, Helen Meng (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-09249.txt.

Introduction

Jincenzi Wu and colleagues aim at human-like social reasoning in language models, which often lean on surface patterns instead of grasping social cues. They build ToMBench-Hard, an adversarial benchmark of training cases that resist shortcut answers. Their Social-R1 framework then supervises the full reasoning path with rewards for structure, logical integrity, and information density. A small model trained this way surpasses much larger rivals and generalizes across eight diverse benchmarks.

Catalog record

CREATORJincenzi Wu, Yuxuan Lei, Jianxun Lian, Yitian Huang, Lexin Zhou, Haotian Li, Xing Xie, Helen Meng
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE92731
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.09249

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Social-R1: Towards Human-like Social Reasoning in LLMs Jincenzi Wu, Yuxuan Lei, Jianxun Lian, Yitian Huang, Lexin Zhou, Haotian Li, Xing Xie, Helen Meng Abstract While large language models demonstrate remarkable capabilities across numerous domains, social intelligence—the capacity to perceive social cues, infer mental states, and generate appropriate responses—remains a critical challenge, particularly for enabling effective human-AI collaboration and developing AI that truly serves human needs. Current models often rely on superficial patterns rather than genuine social reasoning. We argue that cultivating human-like social intelligence requires training with challenging cases that resist shortcut solutions. To this end, we introduce ToMBench-Hard , an adversarial benchmark designed to provide hard training examples for social reasoning. Building on this, we propose Social-R1 , a reinforcement learning framework that aligns model reasoning with human cognition through multi-dimensional rewards. Unlike outcome-based RL, Social-R1 supervises the entire reasoning process, enforcing structural alignment, logical integrity, and information density. Results show that our approach enables a 4B parameter model to surpass much larger counterparts and generalize robustly across eight diverse benchmarks. These findings demonstrate that challenging training cases with trajectory-level alignment offer a path toward efficient and reliable social intelligence. 1 Introduction Recent advances in Reinforcement Learning from Verifiable Feedback (RLVF) ( 32 ) have significantly improved large language models (LLMs)’ performance on formal reasoning tasks like mathematics and programming. However, genuine social intelligence—the capacity to perceive subtle cues, infer latent mental states, and navigate complex interpersonal dynamics—remains a substantial challenge. Unlike formal reasoning with deterministic execution paths, social reasoning is inherently polysemic and context-dependent, lacking the traceable verification that enables effective reward modeling in objective domains. Despite strong performance on standard benchmarks, current LLMs often rely on shortcut learning rather than authentic social reasoning. Models frequently exhibit a failure mode we term Reasoning Parasitism , characterized by Answer-driven Backfilling —retroactively constructing justifications for predetermined answers rather than deriving inferences through narrative analysis, as illustrated by the example in Figure 1 . The inherent fragility of this parasitic performance becomes particularly evident in adversarial or out-of-distribution scenarios. As highlighted by 23 ; 18 , models that excel on standard benchmarks often suffer catastrophic failures when confronted with trivial narrative perturbations. It reveals that current approaches create only a facade of social intelligence while failing to develop robust reasoning capabilities. Our analysis further identifies a critical Interpretation Bottleneck : while models can perceive surface-level social cues, they struggle to map these cues to latent mental states, leading to a “logic reversal” where final answer correctness exceeds the logical integrity of the reasoning process. Figure 1 : Social-R1 for Human-like and Efficient Social Reasoning. By integrating SIP-guided rewards into reinforcement learning, Social-R1 mitigates reasoning shortcuts and enforces structured human-like social inference, improving both accuracy and efficiency across model scales. Detailed cases are in Appendix 6 . We argue that advancing social intelligence requires aligning models’ reasoning trajectories with the structured stages of human social inference. Thus, we propose process-based trajectory alignment that cultivates social intelligence as an internalized capability rather than a parasitic performance. Human social reasoning is characterized by high-density information distillation and recursive belief modeling—properties we aim to instill through structured supervision of the reasoning process, as illustrated in the SocialR1-8B example in Figure 1 . In this paper, we introduce Social-R1 , a reinforcement learning framework that encourages genuine social reasoning by aligning model trajectories with human cognitive principles: structured , evidence-grounded , and efficient inference. Our approach has two key components. First, we construct ToMBench-Hard , an expert-curated adversarial benchmark designed to expose reasoning shortcuts through socially nuanced perceptual traps. Second, guided by Social Information Processing (SIP) theory ( 20 ) , we develop a multi-dimensional reward system that enforces stage-consistent reasoning progression ( R_{\text{struct}} ), content integrity ( R_{\text{content}} ), and inference efficiency ( R_{\text{len}} ). We demonstrate that this trajectory-level alignment enables more effective and parameter-efficient social intelligence. We conduct comprehensive experiments across both in-domain and out-of-domain benchmarks related to social intelligence. Results demonstrate that our approach substantially improves model performance on genuine social reasoning tasks. Social-R1 enables smaller models to match or surpass the capabilities of models with significantly larger parameter counts, while showing strong generalization across eight diverse social reasoning evaluations (as illustrated in the right part of Figure 1 ). These findings indicate that trajectory-level alignment presents a viable and efficient alternative to reliance on pure model scaling for achieving robust social intelligence. The source code and dataset will be released upon paper acceptance. In summary, our contributions are threefold: • ToMBench-Hard: A rigorous benchmark with difficulty for social reasoning that exposes shortcut learning in LLMs and mandates genuine cognitive engagement. • Social-R1 Framework: A reinforcement learning approach with multi-dimensional rewards that align LLM reasoning trajectories with human social cognition. • Performance Superiority: Demonstration that our method enables small models to achieve large-model performance, proving trajectory quality surpasses parameter scaling for social intelligence. 2 Related Work 2.1 Theory-of-Mind Analysis in LLMs Recent evaluations demonstrate LLMs’ growing proficiency on Theory-of-Mind tasks, with models like GPT-4 achieving near-human performance on false-belief tasks and various social cognition assessments ( 12 ; 28 ; 27 ) . However, broader audits reveal significant limitations in genuine social reasoning capabilities. Studies highlight inconsistent performance across different evaluation frameworks ( 5 ) , systematic failure modes in comprehensive capability assessments ( 2 ) , and particular weaknesses in psychologically complex scenarios compared to physical-world contexts ( 35 ; 7 ; 39 ) . Dynamic evaluation settings further expose models’ difficulties with evolving mental states over time ( 34 ) , while higher-order reasoning tasks reveal sharp performance drops beyond first-level inference ( 9 ) . Current improvement attempts remain limited in scope. Prompt-based interventions ( 7 ) offer task-specific benefits but lack generalizability, while reinforcement learning approaches ( 15 ) show promise but risk overfitting to narrow task patterns without broader training diversity. From this literature, we identify three key limitations motivating our work: (i) over-reliance on outcome-based evaluation rather than reasoning trajectory analysis; (ii) susceptibility to shallow statistical cues instead of recursive mental-state inference; and (iii) limited generalization across social reasoning benchmarks and related tasks ( 19 ; 37 ) . These gaps necessitate harder adversarial evaluations, trajectory-level supervision, and training regimes designed for transferable social intelligence. 2.2 RL for LLM General Reasoning Reinforcement learning has emerged as a pivotal technique for enhancing LLM reasoning capabilities, with RLHF establishing the foundation for alignment ( 17 ) . Recent large-scale implementations demonstrate that outcome-based rewards can significantly strengthen structured reasoning in mathematical and coding domains ( 11 ; 8 ; 29 ; 36 ) . To address sparse reward challenges, process supervision methods provide denser feedback through step-wise trajectory evaluation ( 13 ; 30 ; 38 ) . Despite these advances, RL remains underexplored for social inference tasks, which require empathy and multi-factor reasoning in unstructured scenarios. Preliminary work ( 15 ) shows potential but remains in early development. This highlights two critical gaps: (i) the need for refreshed training materials tailored to social reasoning, and (ii) the opportunity for trajectory-level rewards that guide models toward human-like social inference patterns. 3 The ToMBench-Hard Benchmark Social intelligence remains a persistent bottleneck in LLMs, with current systems often relying on shortcut

Read the complete text