CoME-VL: Scaling Complementary Multi-Encoder Vision-Language Learning

Ankan Deria*, Komal Kumar*, Xilin He, Imran Razzak, Hisham Cholakkal, Fahad Shahbaz Khan, Salman Khan · 2026

Read CoME-VL: Scaling Complementary Multi-Encoder Vision-Language Learning by Ankan Deria*, Komal Kumar*, Xilin He, Imran Razzak, Hisham Cholakkal, Fahad Shahbaz Khan, Salman Khan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-03231.txt.

Description

Deria and colleagues fuse two kinds of vision encoders, contrastive and self-supervised, to strengthen vision-language models. Their CoME-VL framework merges the encoders at the representation level, cutting redundancy and aligning token grids before feeding compact visual tokens to a language model. Tests show about 5 percent gains on both visual understanding and grounding tasks, with leading detection results on RefCOCO.

Catalog record

CREATORAnkan Deria*, Komal Kumar*, Xilin He, Imran Razzak, Hisham Cholakkal, Fahad Shahbaz Khan, Salman Khan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47263
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.03231

Browse the full library · About the Tower of Babel