ST-SimDiff: Balancing Spatiotemporal Similarity and Difference for Efficient Video Understanding with MLLMs

Bingjun Luo, Tony Wang, Chaoqi Chen, Xinpeng Ding · 2026

Read ST-SimDiff: Balancing Spatiotemporal Similarity and Difference for Efficient Video Understanding with MLLMs by Bingjun Luo, Tony Wang, Chaoqi Chen, Xinpeng Ding (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-22158.txt.

Description

Luo and co-authors present ST-SimDiff, balancing similarity and difference for video understanding with multimodal large language models. Long videos impose heavy overhead from massive token counts, and existing methods prune or merge tokens by importance or similarity. Those methods overlook changes and turning points, lacking a model for static and dynamic content. ST-SimDiff pairs similarity selection for static information with difference selection that locates changing points, preserving static and dynamic content with minimal tokens. Tests show it beats top methods while cutting costs.

Catalog record

CREATORBingjun Luo, Tony Wang, Chaoqi Chen, Xinpeng Ding
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45361
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.22158

Browse the full library · About the Tower of Babel