FluxMem: Adaptive Hierarchical Memory for Streaming Video Understanding

Yiweng Xie, Bo He, Junke Wang, Xiangyu Zheng, Ziyi Ye, Zuxuan Wu, [0.5em] Institute of Trustworthy Embodied AI, Fudan University, Shanghai Innovation Institute · 2026

Read FluxMem: Adaptive Hierarchical Memory for Streaming Video Understanding by Yiweng Xie, Bo He, Junke Wang, Xiangyu Zheng, Ziyi Ye, Zuxuan Wu, [0.5em] Institute of Trustworthy Embodied AI, Fudan University, Shanghai Innovation Institute (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-02096.txt.

Description

Yiweng Xie, Bo He, Junke Wang, and colleagues compress streaming video memory so models can watch live feeds cheaply. Their 2026 framework, FluxMem, needs no training and adapts its compression to each scene. Streaming understanding piles up visual tokens fast, which inflates latency and memory for multimodal models.

A temporal module first removes redundant tokens across adjacent frames of the stream. A spatial module then merges repetitive regions within each frame into compact representations. Self-adaptive rules set the compression rate from scene statistics, not from manual tuning. Online benchmarks reach new top results under real-time settings in their tests. Latency and peak memory drop sharply on one benchmark, while offline performance stays strong with far fewer visual tokens.

Catalog record

CREATORYiweng Xie, Bo He, Junke Wang, Xiangyu Zheng, Ziyi Ye, Zuxuan Wu, [0.5em] Institute of Trustworthy Embodied AI, Fudan University, Shanghai Innovation Institute
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38361
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.02096

Browse the full library · About the Tower of Babel