Large Emotional World Model

Changhao Song, Yazhou Zhang, Hui Gao, Chang Yang, Peng ZhangCollege of Intelligence and Computing, Tianjin University, Tianjin, China · 2025

Read Large Emotional World Model by Changhao Song, Yazhou Zhang, Hui Gao, Chang Yang, Peng ZhangCollege of Intelligence and Computing, Tianjin University, Tianjin, China (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-24149.txt.

Introduction

Changhao Song and four colleagues argue that world models, the systems AI uses to predict what happens next, are missing half the story. Physical laws govern how states change, but human actions are steered by feelings. A model that learns only physics can mimic the physical world, not the human one, so the team builds emotion in as a state variable.

They first construct a dataset of more than ten thousand emotion-aware transitions, each recording the situation and feeling before an action, the action, and the feeling and situation after. Their model then predicts in two linked steps: first the future emotion, then the future state given that emotion. Across tests the approach improved world-state prediction, emotion understanding, and general reasoning, with large gains on the new dataset. The authors see emotion-aware prediction as a route to more realistic simulation of human settings.

Catalog record

CREATORChanghao Song, Yazhou Zhang, Hui Gao, Chang Yang, Peng ZhangCollege of Intelligence and Computing, Tianjin University, Tianjin, China
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE19 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-24149

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Large Emotional World Model Changhao Song, Yazhou Zhang, Hui Gao, Chang Yang, Peng ZhangCollege of Intelligence and Computing, Tianjin University, Tianjin, China Abstract World Models serve as tools for understanding the current state of the world and predicting its future dynamics, with broad application potential across numerous fields. As a key component of world knowledge, emotion significantly influences human decision-making. While existing Large Language Models (LLMs) have shown preliminary capability in capturing world knowledge, they primarily focus on modeling physical-world regularities and lack systematic exploration of emotional factors. In this paper, we first demonstrate the importance of emotion in understanding the world by showing that removing emotionally relevant information degrades reasoning performance. Inspired by theory of mind, we further propose a L arge E motional W orld M odel (LEWM). Specifically, we construct the E motion- W hy- H ow (EWH) dataset, which integrates emotion into causal relationships and enables reasoning about why actions occur and how emotions drive future world states. Based on this dataset, LEWM explicitly models emotional states alongside visual observations and actions, allowing the world model to predict both future states and emotional transitions. Experimental results show that LEWM more accurately predicts emotion-driven social behaviors while maintaining comparable performance to general world models on basic tasks. 1 Introduction World Models are designed to understand environments and predict their future states 3 . They function by constructing implicit representations from world knowledge and simulating possible evolutions, thereby supporting reasoning and decision-making 4 . Such models have found broad applications in autonomous driving, robotics, and social simulation, where they enhance perception, planning, and interactive capabilities. Figure 1: World model based solely on physics regularities fails to predict emotion-driven behavior. Current World Models predominantly emphasize capturing physical regularities and environmental dynamics, such as Sora’s ability to generate visually realistic videos that adhere to basic physical principles 1 . However, real-world human behavior is often driven by social and emotional factors that are not fully encapsulated by physical or logical rules 8 . As illustrated in Fig 1 , an individual experiencing low mood may resort to impulsive spending to alleviate emotional distress—a behavior that contradicts rational cost-benefit reasoning and may lead to financial waste. This discrepancy between emotion-driven actions and logic-based predictions reveals a critical gap in existing world models, limiting their capacity to fully simulate the complexities of real-world social systems. As recent studies have demonstrated, Large Language Models (LLMs) contain stable and traceable affective circuits that consistently drive emotional expressions across various contexts 10 . Moreover, these models encompass neuron groups that exert causal influence on emotional recognition and generation 6 . These findings indicate that affective mechanisms are not only present but also functionally active within LLMs. Based on this understanding, we design an emotion-filtering module as a preliminary validation experiment and incorporate it into a general base model. We train the module using a multi-task learning setup that simultaneously learns affective recognition and the rewriting of emotional texts into neutral ones. Our results confirm that affective signals can significantly influence model behavior, highlighting the potential of incorporating affective reasoning into world model. Guided by theory-of-mind principles, we develop the Emotion-Why-How (EWH) dataset, which embeds emotion into structured causal relationships and provides paired state–action–emotion transitions. This design supports reasoning not only about why actions emerge under particular emotional conditions, but also how evolving emotional states influence subsequent world changes. Building on this foundation, we introduce the Large Emotion World Model (LEWM), a novel architectural framework that extends conventional world models by explicitly incorporating affective reasoning. Built upon EWH, LEWM jointly represents emotional states, visual observations, and human actions within a unified modeling paradigm, enabling simultaneous prediction of future states and emotional transitions. In doing so, LEWM strengthens affective reasoning capability while promoting a more coherent integration of emotional knowledge into world understanding. We conducted an empirical evaluation of the proposed method across a series of emotional and non-emotional tasks, and compared its performance with several SoTA general world models. We highlight three key findings: (1) Incorporating an emotion-filtering module causes a marked decline in subjective tasks (up to 8%↓ in Acc), while it leads to a slight drop (approximately 1%↓) in objective reasoning and knowledge tasks, indicating that emotional context acts as a systematic modulator that shapes model behavior across diverse cognitive demands; (2) LEWM achieves promising results in emotion-driven behavior prediction, demonstrating that incorporating emotional reasoning into world models can enhance the accuracy of predicting real-world human actions; (3) LEWM performs comparably to general world models on basic tasks, which suggests that integrating emotional understanding does not compromise the fundamental performance of the model on general tasks. Our main contributions are as follows: • We design an emotion-filtering module and empirically verify that emotional information systematically modulates model behavior across diverse tasks. • We construct EWH dataset, which encodes emotion-driven causal relationships through paired state–action–emotion transitions. • We propose LEWM , a world modeling framework that explicitly integrates affective reasoning, and demonstrate that it improves prediction of emotion-driven human behaviors. 2 Related Work World models are computational frameworks that primarily serving two interconnected purposes: building implicit internal representations of the environment and predicting future states. The concept originates from early AI research on mental models and has been revitalized through model-based reinforcement learning (MBRL) and neural architectures that learn latent dynamics 3 . A significant evolution occurred with the rise of multimodal generative models, such as Sora, which demonstrate an emerging capacity to simulate realistic video sequences and physical interactions 1 . These models are applied across key domains like autonomous driving 2 , task planning 11 , and social simulacra 8 . We propose the Large Emotional World Model (LEWM), which enhances the accurate modeling of emotion-driven human behaviors by integrating emotional reasoning, thereby extending the applicability of world models to the understanding of complex social dynamics. 3 Preliminary As a preliminary validation to demonstrate the influence of affective signals on model decision-making, we design an emotion-filtering module based on multi-task learning. The following subsection details this experiment. This module builds upon a pretrained world model \mathcal{W} with parameters \theta_{\mathcal{W}} and operates through a dual-task learning framework that simultaneously performs affect recognition and affective content transformation , as shown in Fig 2 . Formally, given an input text \mathbf{x}=\{x_{1},x_{2},\ldots,x_{n}\} , the module learns to: • Classify whether \mathbf{x} contains emotional content using an Affect Classifier f_{\phi} , parameterized by \phi , which maps the contextual representations of \mathbf{x} to a binary emotionality label; • Generate a corresponding neutralized version \mathbf{y}=\{y_{1},y_{2},\ldots,y_{m}\} that preserves semantic content while removing affective expressions, facilitated by an Affect Adapter g_{\psi} , parameterized by \psi , which transforms the latent representations to achieve emotional filtering. Figure 2: The world model integrated with an emotion-filtering module is trained using a two-stage approach. The classification task employs a standard cross-entropy loss \mathcal{L}_{cls} , while the neutralization task is formulated as a conditional text generation problem. Given an emotional text \mathbf{x} with emotion label y_{e} , the model learns to generate its neutral counterpart \mathbf{x_{n}} through maximum likelihood estimation: \mathcal{L}_{gen}=-\sum_{t=1}^{T}\log p(y_{t}|y_{<t},\mathbf{x},y_{e}) (1) where T denotes the length of the neutralized sequence, and the generation is guided by g_{\psi} . To support this dual-task learning

Read the complete text