Unveiling the Cognitive Compass: Theory-of-Mind-Guided Multimodal Emotion Reasoning
Meng Luo, Bobo Li, Shanqing Xu, Shize Zhang, Qiuchan Chen, Menglu Han, Wenhao Chen, Yanxiang Huang, Hao Fei, Mong-Li Lee, Wynne Hsu, [0.6em] National University of Singapore · 2026
Read Unveiling the Cognitive Compass: Theory-of-Mind-Guided Multimodal Emotion Reasoning by Meng Luo, Bobo Li, Shanqing Xu, Shize Zhang, Qiuchan Chen, Menglu Han, Wenhao Chen, Yanxiang Huang, Hao Fei, Mong-Li Lee, Wynne Hsu, [0.6em] National University of Singapore (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-00971.txt.
Description
Meng Luo and colleagues argue that emotional insight needs a model of other minds, not surface cues. Their HitEmotion benchmark tests multimodal models across rising levels of cognitive depth, exposing where emotional reasoning breaks down. A theory-of-mind-guided chain tracks mental states and weighs cross-modal evidence for more faithful emotion calls. Their TMPO training method then uses middle mental states as step-level supervision to strengthen that reasoning. Tests show both tools lift task accuracy and yield rationales that are more faithful and more coherent.
Catalog record
| CREATOR | Meng Luo, Bobo Li, Shanqing Xu, Shize Zhang, Qiuchan Chen, Menglu Han, Wenhao Chen, Yanxiang Huang, Hao Fei, Mong-Li Lee, Wynne Hsu, [0.6em] National University of Singapore |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 115447 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602.00971