Emergent Communication for Co-constructed Emotion Between Embodied Agents via Collective Predictive Coding

Zehang Zhang, Nguyen Le Hoang, Tadahiro Taniguchi, and Takato Horii · 2026

Read Emergent Communication for Co-constructed Emotion Between Embodied Agents via Collective Predictive Coding by Zehang Zhang, Nguyen Le Hoang, Tadahiro Taniguchi, and Takato Horii (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-09522.txt.

Introduction

Zhang and three colleagues model how two agents come to share emotion groups through talk. Under the theory of built emotion, minds form emotion groups by joining body signals. They then use those groups to guess and make sense of what they sense. How single minds build such groups is well studied. But the shared side is less known: how does a joint grasp of emotion grow between two minds? Their agents talk through a naming game based on joint prediction coding.

Talk improved the match, clarity, and accord of the learned emotion groups over baselines that did not talk. The gain sat mainly at the symbol layer, not in raw sense data. Even when the two agents had quite unlike inner body rhythms, talk still gave a sturdy shared grouping. That pattern backs the view that unlike bodies help make shared emotion sense, rather than merely blocking it.

Catalog record

CREATORZehang Zhang, Nguyen Le Hoang, Tadahiro Taniguchi, and Takato Horii
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.09522

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Emergent Communication for Co-constructed Emotion Between Embodied Agents via Collective Predictive Coding Zehang Zhang, Nguyen Le Hoang, Tadahiro Taniguchi, and Takato Horii Abstract According to the theory of constructed emotion, the brain actively forms emotion categories by integrating multimodal bodily signals, and constructs emotional experiences by using these categories to predict and interpret sensory inputs. While research has advanced in modeling individual emotion construction, the social process of co-construction—how a shared understanding of emotions emerges between individuals—remains computationally underexplored. This study investigates this process by modeling emergent communication between two embodied agents using the Metropolis-Hastings Naming Game (MHNG), grounded in the Collective Predictive Coding (CPC) framework. Our experiments, using visual, auditory, and simulated interoceptive inputs, yield two main findings. First, MHNG-based communication significantly improves the alignment, clarity, and inter-agent agreement of the learned emotion categories compared to non-communicative and non-selective baselines, with the alignment effect concentrated at the symbolic layer rather than the perceptual latent representation. Second, even when the two agents have systematically divergent interoceptive dynamics, communication still produces robust categorical alignment, with distinct, category-specific reshaping patterns of each agent’s emotion categories—consistent with the constructed-emotion view that interoceptive heterogeneity is constitutive of, rather than an obstacle to, shared emotional meaning. These findings provide computational support for the co-constructionist view of emotion and extend the CPC framework from physical to socially-grounded domains. I Introduction Fig. 1 : The process of two agents (Agent A and Agent B) forming and sharing emotion categories after observing the same object through communication. Each agent receives the similar external stimulus (A joint attention object) and responds to it through exteroception and interoception (e.g., heartbeat, visceral state, etc.).Interoception is integrated within the agent to generate core affect, which is further integrated with exteroception to promote the formation of emotion categories. Subsequently, the agents communicate symbolically (language interaction) based on emotion category inference. Through this emotion communication mechanism, the two agents dynamically update their respective emotion categories and achieve the co-construction of emotion. How do we acquire concepts of emotions from our own sensory experiences? And how do we come to be able to share and understand those emotions with others? Emotions are understood as internal psychological states that profoundly affect individual cognition, experience, and behavior, constituting complex responses to environmental stimuli [ 1 ] . Of particular note in the multifaceted nature of emotions is their physical embodiment: emotions encompass not only subjective feelings but also physiological reactions, cognitive evaluations, and behavioral tendencies [ 2 ] . Recent findings emphasize the role of interoception—sensory signals originating within the body—as a crucial determinant in the experience and formation of emotions [ 3 ] . These interoceptions are thought to eventually become integrated into a basic state known as core affect, which represents feelings of valence (pleasure–displeasure) and arousal (high–low activation) [ 4 ] . Unlike specific emotion categories, core affect acts as the continuous physiological basis from which emotions are constructed. Beyond internal mechanisms, emotions are also modulated by external social and cultural contexts — cross-cultural studies have demonstrated that the expression, perception, and regulation of emotions are significantly influenced by cultural frameworks [ 5 , 6 ] . Yet despite emotion’s critical role in cognition and social life, it remains insufficiently understood how emotion categories are constructed and how they come to be shared among individuals [ 7 , 8 , 9 ] . Among theories of emotion, Ekman’s basic emotion theory posits that a small set of emotions—such as joy, sadness, anger, fear, disgust, and surprise—are biologically hardwired, each underpinned by a distinct neural circuit, and universally expressed across cultures [ 10 ] . However, this essentialist view has faced substantial criticism. Meta-analyses of neuroimaging studies have failed to identify consistent, emotion-specific brain signatures [ 11 , 12 ] , and cross-cultural research has revealed significant variation in how emotions are recognized and categorized [ 13 , 14 ] , challenging the assumption of universality. In contrast, the theory of constructed emotion [ 7 ] challenges this essentialist perspective. It argues that humans do not possess biologically hardwired reactions for specific emotions. Instead, the theory distinguishes between emotion categories and emotional experiences. Emotion categories are conceptual knowledge structures formed through the integration of interoception and exteroception, shaped by personal beliefs and memories. Emotional experiences, in turn, are the specific instances constructed when the brain applies these categories to predict and interpret continuous sensory inputs. In Barrett’s framework, the formation of emotion categories is a prerequisite for these experiences; without the corresponding category, an individual would perceive only raw bodily sensations rather than specific emotions. Specifically, this construction unfolds in two conceptual stages. First, the brain acquires emotion categories (e.g., ”anger”, ”joy”) learned from statistical regularities in past interoceptive and exteroceptive experiences. Second, specific emotion are experienced by applying these categories to current sensory inputs to resolve ambiguity. For instance, an accelerated heartbeat (interoception) is merely physiological noise until the brain categorizes it. If the brain predicts this state as ”anxiety” in a stressful context, it is experienced as distress; if categorized as ”excitement” in a positive context, the same physiological state is perceived as thrill. Thus, the emotion category shapes the subjective quality of the experience. This constructionist view begs for a computational explanation of how such category formation and predictive experience might be implemented in the brain. The theory of predictive coding, proposed by Friston [ 15 ] , offers a unifying computational framework that provides a natural explanation for these processes. In this framework, the brain continuously constructs internal models that predict incoming sensory stimuli and strives to minimize the discrepancy between predictions and actual inputs, a discrepancy termed prediction error. Importantly, predictive coding extends beyond exteroceptive signals to interoceptive signals, as argued by Seth et al. [ 16 ] , who proposed that emotional experiences arise from minimizing prediction errors related to internal bodily states. Thus, predictive coding serves as a theoretical foundation that complements and reinforces the mechanisms proposed by the theory of constructed emotion, framing emotional experiences as emergent outcomes of hierarchical predictive processes. Building on this approach, prior research has explored the internal formation of emotion categories based on embodied sensory inputs [ 17 , 18 ] , but did not address how shared structures of emotion categories could emerge between individuals—a key aspect in understanding the social and cultural co-construction of emotion. In contrast, Gendron and Barrett [ 8 ] proposed a framework in which emotion perception is a dynamic process of conceptual synchrony between two individuals, mediated in part by emotion words. While theoretically influential, their proposal has not been instantiated computationally. Addressing this gap requires a computational framework capable of explaining how shared meaning emerges between individuals through interaction. The theory of symbol emergence [ 19 ] provides such a foundation: shared symbols are not predefined but arise through a bottom-up process in which agents form internal categories from their own sensory experiences and gradually align these categories through communicative interaction [ 20 ] . Taniguchi et al. further formalized this process through CPC [ 21 ] , which extends predictive coding from the individual to the social level — agents not only minimize prediction errors within their own sensory models but also coordinate their

Read the complete text