A Unified Spoken Language Model with Injected Emotional-Attribution Thinking for Human-like Interaction

Qing Wang † , Zehan Li † , Yaodong Song † , Hongjie Chen † , Jian Kang, Jie Lian, Jie Li, Yongxiang Li, Xuelong Li ∗ · 2026

Read A Unified Spoken Language Model with Injected Emotional-Attribution Thinking for Human-like Interaction by Qing Wang † , Zehan Li † , Yaodong Song † , Hongjie Chen † , Jian Kang, Jie Lian, Jie Li, Yongxiang Li, Xuelong Li ∗ (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-04960.txt.

Description

Qing Wang and 8 co-authors build a spoken language model that reasons about the emotions behind a user's words in a 2026 paper. Their unified model handles spoken interaction with emotional intelligence rather than treating feelings as an afterthought label. A data strategy called Injected Emotional-Attribution Thinking inserts the user's emotional state and its likely causes into the model's internal reasoning, so emotion-aware thinking is internalized during training.

Training proceeds in two stages: speech-text alignment with emotional attribute modelling through self-distillation, then joint end-to-end tuning across both modes. A voice assistant that grasps why a user sounds upset, not only that they do, could respond more helpfully in support, education, and accessibility settings.

Catalog record

CREATORQing Wang † , Zehan Li † , Yaodong Song † , Hongjie Chen † , Jian Kang, Jie Lian, Jie Li, Yongxiang Li, Xuelong Li ∗
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE10 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-04960

Browse the full library · About the Tower of Babel