Dynamic Graph Neural Ordinary Differential Equation Network for Multi-modal Emotion Recognition in Conversation

Yuntao Shou, Tao Meng, Wei Ai, Keqin Li · 2024

Read Dynamic Graph Neural Ordinary Differential Equation Network for Multi-modal Emotion Recognition in Conversation by Yuntao Shou, Tao Meng, Wei Ai, Keqin Li (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-02935.txt.

Description

Shou and co-authors (2024) propose a network that reads emotions from conversations using text, audio, and video together. Emotion recognition in dialogue is usually built on graph networks that link utterances, but those tend to overfit and miss how a speaker's feelings evolve over time. Their model, DGODE, treats the conversation graph as a system that changes continuously.

An adaptive mixing mechanism spreads information across the graph in a way that generalizes better and resists the over-smoothing that flattens deep graph networks. A graph ordinary differential equation layer then evolves each node's state over time, capturing the temporal drift of emotion. On two public multimodal conversation datasets, the model beat a range of baselines. The authors also report that the design allows deeper graph networks than usual without the usual collapse of signal.

Catalog record

CREATORYuntao Shou, Tao Meng, Wei Ai, Keqin Li
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-02935

Browse the full library · About the Tower of Babel