ST-SimDiff: Balancing Spatiotemporal Similarity and Difference for Efficient Video Understanding with MLLMs
Bingjun Luo, Tony Wang, Chaoqi Chen, Xinpeng Ding · 2026
Read ST-SimDiff: Balancing Spatiotemporal Similarity and Difference for Efficient Video Understanding with MLLMs by Bingjun Luo, Tony Wang, Chaoqi Chen, Xinpeng Ding (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-22158.txt.
Description
Luo and co-authors present ST-SimDiff, balancing similarity and difference for video understanding with multimodal large language models. Long videos impose heavy overhead from massive token counts, and existing methods prune or merge tokens by importance or similarity. Those methods overlook changes and turning points, lacking a model for static and dynamic content. ST-SimDiff pairs similarity selection for static information with difference selection that locates changing points, preserving static and dynamic content with minimal tokens. Tests show it beats top methods while cutting costs.
Catalog record
| CREATOR | Bingjun Luo, Tony Wang, Chaoqi Chen, Xinpeng Ding |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45361 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.22158