Mosaic : Cross-Modal Clustering for Efficient Video Understanding

Tuowei Wang, He Zhou, Chengru Song, Qiushi Li, Ju Ren* · 2026

Read Mosaic : Cross-Modal Clustering for Efficient Video Understanding by Tuowei Wang, He Zhou, Chengru Song, Qiushi Li, Ju Ren* (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-10060.txt.

Description

Wang and four colleagues present Mosaic, a system for streaming long-video understanding that organizes a vision-language model's cached keys and values into cross-modal clusters instead of single tokens. Retrieved cache states group by visual likeness and meaning, so clusters become the unit for storing, maintaining, and fetching context as video arrives. The design cuts management overhead and fragmented data movement, reaching up to 1.38 times the speed of leading baselines.

Catalog record

CREATORTuowei Wang, He Zhou, Chengru Song, Qiushi Li, Ju Ren*
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE49119
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.10060

Browse the full library · About the Tower of Babel