The Language of Touch: Translating Vibrations into Text with Dual-Branch Learning

Jin Chen, Yifeng Lin, Chao Zeng, Si Wu, Tiesong Zhao · 2026

Read The Language of Touch: Translating Vibrations into Text with Dual-Branch Learning by Jin Chen, Yifeng Lin, Chao Zeng, Si Wu, Tiesong Zhao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-26804.txt.

Description

Chen and co-authors tackle a new task: turning touch vibrations into written captions. Their method, ViPAC, splits each vibration signal into steady and non-steady parts. Two branches process the parts apart, then a fusion step blends them. This design suits signals that lack the spatial layout of images. The team also built LMT108-CAP, the first paired dataset of vibrations and text. In tests, ViPAC beat adapted audio and image captioning baselines.

Catalog record

CREATORJin Chen, Yifeng Lin, Chao Zeng, Si Wu, Tiesong Zhao
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33796
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.26804

Browse the full library · About the Tower of Babel