A-MESS: Anchor-based Multimodal Embedding with Semantic Synchronization for Multimodal Intent Recognition
Yaomin Shen 1 * , Xiaojian Lin 2 , Wei Fan 3 , 1 XR System Application Research Center, Nanchang Research Institute, Zhejiang University, China 2 Institute for AI Industry Research(AIR), Tsinghua University, China 3 Independent Researcher, China 1 [email protected], 2 [email protected], 3 c · 2025
Read A-MESS: Anchor-based Multimodal Embedding with Semantic Synchronization for Multimodal Intent Recognition by Yaomin Shen 1 * , Xiaojian Lin 2 , Wei Fan 3 , 1 XR System Application Research Center, Nanchang Research Institute, Zhejiang University, China 2 Institute for AI Industry Research(AIR), Tsinghua University, China 3 Independent Researcher, China 1 [email protected], 2 [email protected], 3 c (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-19474.txt.
Description
Yaomin Shen, Xiaojian Lin, and Wei Fan present a framework for multimodal intent recognition, the task of reading what a person means from several signals at once. Their 2025 paper notes that such systems draw on text, body gestures, and tone of voice together. Older methods, they argue, miss the deep links between these channels and ignore the meaning carried by the intent labels themselves.
Their framework, called A-MESS, works in two parts. An anchor-based module fuses the input channels into one shared representation. A second part aligns that representation with label descriptions written by a large language model, using a form of contrastive learning. Tests reported in the paper show the method reaching state-of-the-art results. The authors say the work also sheds new light on how multimodal data can be represented for later tasks.
Catalog record
| CREATOR | Yaomin Shen 1 * , Xiaojian Lin 2 , Wei Fan 3 , 1 XR System Application Research Center, Nanchang Research Institute, Zhejiang University, China 2 Institute for AI Industry Research(AIR), Tsinghua University, China 3 Independent Researcher, China 1 [email protected], 2 [email protected], 3 c |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-19474