Modality-Aware Contrastive and Uncertainty-Regularized Emotion Recognition
Yan Zhuang, Minhao Liu, Yanru Zhang, Jiawen Deng, Fuji Ren · 2026
Read Modality-Aware Contrastive and Uncertainty-Regularized Emotion Recognition by Yan Zhuang, Minhao Liu, Yanru Zhang, Jiawen Deng, Fuji Ren (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-06245.txt.
Description
Yan Zhuang and four co-authors build an emotion recognition framework that stays reliable when input channels vary. Multimodal systems read face, voice, and text together, but those channels differ in meaning, quality, and availability from sample to sample. Mixed combinations of present and missing channels make consistent emotion judgments hard for standard fusion designs, the authors note.
Their framework works from representation consistency, with two core parts. A contrastive mechanism pulls together samples that share both emotion category and the same available modality set. A second part assigns each sample an uncertainty based weight during training, damping unreliable examples. Across three standard benchmarks the method beat existing approaches, with the largest average F1 gain, above four points, on the IEMOCAP data set.
Catalog record
| CREATOR | Yan Zhuang, Minhao Liu, Yanru Zhang, Jiawen Deng, Fuji Ren |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 75 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.06245