Benchmarking and Bridging Emotion Conflicts for Multimodal Emotion Reasoning Conference: Proceedings of the 33rd ACM International Conference on Multimedia; October 27–31, 2025; Dublin, Ireland Proceedings of the 33rd ACM International Conference on Multimedia (MM ’25), October 27–31, 2025, Dublin,

Zhiyuan Han, Beier Zhu †, Yanlong Xu, Peipei Song, Xun Yang † · 2025

Read Benchmarking and Bridging Emotion Conflicts for Multimodal Emotion Reasoning Conference: Proceedings of the 33rd ACM International Conference on Multimedia; October 27–31, 2025; Dublin, Ireland Proceedings of the 33rd ACM International Conference on Multimedia (MM ’25), October 27–31, 2025, Dublin, by Zhiyuan Han, Beier Zhu †, Yanlong Xu, Peipei Song, Xun Yang † (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-01181.txt.

Description

Zhiyuan Han, Beier Zhu, Yanlong Xu, Peipei Song, and Xun Yang tackle emotion conflicts in multimodal models in a 2025 paper. A model that reads face, voice, and words to call a mood can be fooled when those cues clash: a smile with a sad tone, say. Past tests of such models near skipped that case.

The team built a benchmark with three sets: one where the video tells the truth, one where the audio does, and one where all cues agree. Top models leaned far too much on sound in a clash, they found. Their fix, MoSEAR, tunes a small part of the model to weigh each stream in balance.

Catalog record

CREATORZhiyuan Han, Beier Zhu †, Yanlong Xu, Peipei Song, Xun Yang †
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE75 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-01181

Browse the full library · About the Tower of Babel