Improving Speech Emotion Recognition Through Cross Modal Attention Alignment and Balanced Stacking Model
Lucas, João, Leonardo, Paula · 2025
Read Improving Speech Emotion Recognition Through Cross Modal Attention Alignment and Balanced Stacking Model by Lucas, João, Leonardo, Paula (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-20007.txt.
Description
Lucas Ueda and co-authors present a 2025 paper on emotion in speech. Emotion shapes human talk, so machines that serve people benefit from hearing it. Natural speech makes the task hard, and emotion classes are uneven in data. The work was built for a 2025 challenge on emotion in natural speech. Their system joins several data modes with cross-modal attention, which lets one mode guide another.
To fight class imbalance, the team used weighted loss and a soft margin loss. Twelve multimodal models were trained in all. A balanced stacking model merges their votes into the final call. The system posts a strong macro score in the challenge, as the authors report. Voice interface teams get a recipe for messy, real-world speech. Balanced merging matters when rare emotions, such as fear, drown in common ones like neutral speech.
Catalog record
| CREATOR | Lucas, João, Leonardo, Paula |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 22 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-20007