Dynamic Graph Neural Ordinary Differential Equation Network for Multi-modal Emotion Recognition in Conversation
Yuntao Shou, Tao Meng, Wei Ai, Keqin Li · 2024
Read Dynamic Graph Neural Ordinary Differential Equation Network for Multi-modal Emotion Recognition in Conversation by Yuntao Shou, Tao Meng, Wei Ai, Keqin Li (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-02935.txt.
Description
Shou and co-authors (2024) propose a network that reads emotions from conversations using text, audio, and video together. Emotion recognition in dialogue is usually built on graph networks that link utterances, but those tend to overfit and miss how a speaker's feelings evolve over time. Their model, DGODE, treats the conversation graph as a system that changes continuously.
An adaptive mixing mechanism spreads information across the graph in a way that generalizes better and resists the over-smoothing that flattens deep graph networks. A graph ordinary differential equation layer then evolves each node's state over time, capturing the temporal drift of emotion. On two public multimodal conversation datasets, the model beat a range of baselines. The authors also report that the design allows deeper graph networks than usual without the usual collapse of signal.
Catalog record
| CREATOR | Yuntao Shou, Tao Meng, Wei Ai, Keqin Li |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-02935