CM3T: Framework for Efficient Multimodal Learning for Inhomogeneous Interaction Datasets

Tanay Agrawal, Mohammed Guermal, Michal Balazia, Francois Bremond · 2025

Read CM3T: Framework for Efficient Multimodal Learning for Inhomogeneous Interaction Datasets by Tanay Agrawal, Mohammed Guermal, Michal Balazia, Francois Bremond (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-03332.txt.

Description

Tanay Agrawal and co-authors add plug in adapters that let transformer models learn across mixed video data sets, in work from twenty twenty-five. Data sets differ in setting and may lack some input types, and retraining big models is costly. Their frame, called CM3T, aims to bridge a general model and a specific task.

Two adapter types do the work: vision adapters for transfer and cross attention adapters for mixed inputs. The backbone stays frozen, so only a small share of weights trains. Tests on three action and interaction data sets matched or beat top methods with far fewer trained weights. The frame needs no special pretraining. Gains held across recording setups and tasks.

Catalog record

CREATORTanay Agrawal, Mohammed Guermal, Michal Balazia, Francois Bremond
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-03332

Browse the full library · About the Tower of Babel