FluxMem: Adaptive Hierarchical Memory for Streaming Video Understanding
Yiweng Xie, Bo He, Junke Wang, Xiangyu Zheng, Ziyi Ye, Zuxuan Wu, [0.5em] Institute of Trustworthy Embodied AI, Fudan University, Shanghai Innovation Institute · 2026
Read FluxMem: Adaptive Hierarchical Memory for Streaming Video Understanding by Yiweng Xie, Bo He, Junke Wang, Xiangyu Zheng, Ziyi Ye, Zuxuan Wu, [0.5em] Institute of Trustworthy Embodied AI, Fudan University, Shanghai Innovation Institute (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-02096.txt.
Description
Yiweng Xie, Bo He, Junke Wang, and colleagues compress streaming video memory so models can watch live feeds cheaply. Their 2026 framework, FluxMem, needs no training and adapts its compression to each scene. Streaming understanding piles up visual tokens fast, which inflates latency and memory for multimodal models.
A temporal module first removes redundant tokens across adjacent frames of the stream. A spatial module then merges repetitive regions within each frame into compact representations. Self-adaptive rules set the compression rate from scene statistics, not from manual tuning. Online benchmarks reach new top results under real-time settings in their tests. Latency and peak memory drop sharply on one benchmark, while offline performance stays strong with far fewer visual tokens.
Catalog record
| CREATOR | Yiweng Xie, Bo He, Junke Wang, Xiangyu Zheng, Ziyi Ye, Zuxuan Wu, [0.5em] Institute of Trustworthy Embodied AI, Fudan University, Shanghai Innovation Institute |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 38361 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.02096