Improving Speech Emotion Recognition Through Cross Modal Attention Alignment and Balanced Stacking Model

Lucas, João, Leonardo, Paula · 2025

Read Improving Speech Emotion Recognition Through Cross Modal Attention Alignment and Balanced Stacking Model by Lucas, João, Leonardo, Paula (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-20007.txt.

Description

Lucas Ueda and co-authors present a 2025 paper on emotion in speech. Emotion shapes human talk, so machines that serve people benefit from hearing it. Natural speech makes the task hard, and emotion classes are uneven in data. The work was built for a 2025 challenge on emotion in natural speech. Their system joins several data modes with cross-modal attention, which lets one mode guide another.

To fight class imbalance, the team used weighted loss and a soft margin loss. Twelve multimodal models were trained in all. A balanced stacking model merges their votes into the final call. The system posts a strong macro score in the challenge, as the authors report. Voice interface teams get a recipe for messy, real-world speech. Balanced merging matters when rare emotions, such as fear, drown in common ones like neutral speech.

Catalog record

CREATORLucas, João, Leonardo, Paula
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE22 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-20007

Browse the full library · About the Tower of Babel