MMViR: A Multi-Modal and Multi-Granularity Representation for Long-range Video Understanding

Zizhong Li, Haopeng Zhang, Jiawei Zhang · 2026

Read MMViR: A Multi-Modal and Multi-Granularity Representation for Long-range Video Understanding by Zizhong Li, Haopeng Zhang, Jiawei Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-05495.txt.

Description

Zizhong Li and 2 co-authors present MMViR, a 2026 representation designed to help multimodal models understand videos that run from minutes to hours. Long videos contain many events and scenes, and encoding every frame costs too much. Converting video to text alone often leaves redundant or broken-up content.

MMViR finds key turning points to split the video into segments. It then builds a three-level description that joins a global narrative with fine visual detail. That structure supports efficient question-based retrieval across varied scenarios. Across question answering, summarization, and retrieval tests, MMViR beat the prior strongest method, improving hour-long video understanding while cutting processing time to under half.

Catalog record

CREATORZizhong Li, Haopeng Zhang, Jiawei Zhang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-05495

Browse the full library · About the Tower of Babel