A-MESS: Anchor-based Multimodal Embedding with Semantic Synchronization for Multimodal Intent Recognition

Yaomin Shen 1 * , Xiaojian Lin 2 , Wei Fan 3 , 1 XR System Application Research Center, Nanchang Research Institute, Zhejiang University, China 2 Institute for AI Industry Research(AIR), Tsinghua University, China 3 Independent Researcher, China 1 [email protected], 2 [email protected], 3 c · 2025

Read A-MESS: Anchor-based Multimodal Embedding with Semantic Synchronization for Multimodal Intent Recognition by Yaomin Shen 1 * , Xiaojian Lin 2 , Wei Fan 3 , 1 XR System Application Research Center, Nanchang Research Institute, Zhejiang University, China 2 Institute for AI Industry Research(AIR), Tsinghua University, China 3 Independent Researcher, China 1 [email protected], 2 [email protected], 3 c (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-19474.txt.

Description

Yaomin Shen, Xiaojian Lin, and Wei Fan present a framework for multimodal intent recognition, the task of reading what a person means from several signals at once. Their 2025 paper notes that such systems draw on text, body gestures, and tone of voice together. Older methods, they argue, miss the deep links between these channels and ignore the meaning carried by the intent labels themselves.

Their framework, called A-MESS, works in two parts. An anchor-based module fuses the input channels into one shared representation. A second part aligns that representation with label descriptions written by a large language model, using a form of contrastive learning. Tests reported in the paper show the method reaching state-of-the-art results. The authors say the work also sheds new light on how multimodal data can be represented for later tasks.

Catalog record

CREATORYaomin Shen 1 * , Xiaojian Lin 2 , Wei Fan 3 , 1 XR System Application Research Center, Nanchang Research Institute, Zhejiang University, China 2 Institute for AI Industry Research(AIR), Tsinghua University, China 3 Independent Researcher, China 1 [email protected], 2 [email protected], 3 c
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-19474

Browse the full library · About the Tower of Babel