Unveiling the Cognitive Compass: Theory-of-Mind-Guided Multimodal Emotion Reasoning

Meng Luo, Bobo Li, Shanqing Xu, Shize Zhang, Qiuchan Chen, Menglu Han, Wenhao Chen, Yanxiang Huang, Hao Fei, Mong-Li Lee, Wynne Hsu, [0.6em] National University of Singapore · 2026

Read Unveiling the Cognitive Compass: Theory-of-Mind-Guided Multimodal Emotion Reasoning by Meng Luo, Bobo Li, Shanqing Xu, Shize Zhang, Qiuchan Chen, Menglu Han, Wenhao Chen, Yanxiang Huang, Hao Fei, Mong-Li Lee, Wynne Hsu, [0.6em] National University of Singapore (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-00971.txt.

Description

Meng Luo and colleagues argue that emotional insight needs a model of other minds, not surface cues. Their HitEmotion benchmark tests multimodal models across rising levels of cognitive depth, exposing where emotional reasoning breaks down. A theory-of-mind-guided chain tracks mental states and weighs cross-modal evidence for more faithful emotion calls. Their TMPO training method then uses middle mental states as step-level supervision to strengthen that reasoning. Tests show both tools lift task accuracy and yield rationales that are more faithful and more coherent.

Catalog record

CREATORMeng Luo, Bobo Li, Shanqing Xu, Shize Zhang, Qiuchan Chen, Menglu Han, Wenhao Chen, Yanxiang Huang, Hao Fei, Mong-Li Lee, Wynne Hsu, [0.6em] National University of Singapore
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE115447
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602.00971

Browse the full library · About the Tower of Babel