Tactile Modality Fusion for Vision-Language-Action Models

Charlotte Morissette, Amin Abyaneh, Wei-Di Chang, Anas Houssaini, David Meger, Hsiu-Chin Lin, Jonathan Tremblay, Gregory Dudek · 2026

Read Tactile Modality Fusion for Vision-Language-Action Models by Charlotte Morissette, Amin Abyaneh, Wei-Di Chang, Anas Houssaini, David Meger, Hsiu-Chin Lin, Jonathan Tremblay, Gregory Dudek (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-14604.txt.

Description

Morissette and co-authors add touch sensing to vision-language-action robot models with TacFiLM. Vision alone misses contact forces, friction, compliance and shear. Past touch add-ons lean on token stacking or huge pretraining runs. TacFiLM instead fine-tunes after training with light feature-wise modulation. Pretrained tactile signals reshape mid-level visual features. Insertion and drawer opening tasks test the method. Success rate, task scores, completion time and force stability all improve, they report. Gains hold on both familiar and shifted tasks.

Catalog record

CREATORCharlotte Morissette, Amin Abyaneh, Wei-Di Chang, Anas Houssaini, David Meger, Hsiu-Chin Lin, Jonathan Tremblay, Gregory Dudek
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36411
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.14604

Browse the full library · About the Tower of Babel