The Language of Touch: Translating Vibrations into Text with Dual-Branch Learning
Jin Chen, Yifeng Lin, Chao Zeng, Si Wu, Tiesong Zhao · 2026
Read The Language of Touch: Translating Vibrations into Text with Dual-Branch Learning by Jin Chen, Yifeng Lin, Chao Zeng, Si Wu, Tiesong Zhao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-26804.txt.
Description
Chen and co-authors tackle a new task: turning touch vibrations into written captions. Their method, ViPAC, splits each vibration signal into steady and non-steady parts. Two branches process the parts apart, then a fusion step blends them. This design suits signals that lack the spatial layout of images. The team also built LMT108-CAP, the first paired dataset of vibrations and text. In tests, ViPAC beat adapted audio and image captioning baselines.
Catalog record
| CREATOR | Jin Chen, Yifeng Lin, Chao Zeng, Si Wu, Tiesong Zhao |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33796 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.26804