Geometry-Aware Implicit Memory for Video World Models
Zhengxuan Wei, Xu Guo, Xinghui Li, Xunzhi Xiang, Min Wei, Yiran Zhu, Qiulin Wang, Xintao Wang, Pengfei Wan, Xiangwang Hou, Qi Fan, [4pt] School of Intelligence Science, Technology, Nanjing University · 2026
Read Geometry-Aware Implicit Memory for Video World Models by Zhengxuan Wei, Xu Guo, Xinghui Li, Xunzhi Xiang, Min Wei, Yiran Zhu, Qiulin Wang, Xintao Wang, Pengfei Wan, Xiangwang Hou, Qi Fan, [4pt] School of Intelligence Science, Technology, Nanjing University (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-02436.txt.
Description
Wei and co-authors give video world models a better kind of memory. Such models simulate scenes that users can steer. Long runs depend on what the model keeps after views leave its context window. Storing frames costs space and can fetch the wrong ones. Rebuilding 3D scenes online adds artifacts. Compact hidden states lack explicit geometry.
Their framework, GIM-World, compresses long histories into fixed-size tokens. A light transformer encoder does the compression. A geometry head distills 3D structure from a frozen teacher model. That head is used only in training. A pruning rule keeps encoding cost bounded as history grows. Tests on MIND show stronger long-run geometry and look. The new memory beats both stored-frame and hidden-state baselines. The teacher drops out at inference, leaving a lean module.
Catalog record
| CREATOR | Zhengxuan Wei, Xu Guo, Xinghui Li, Xunzhi Xiang, Min Wei, Yiran Zhu, Qiulin Wang, Xintao Wang, Pengfei Wan, Xiangwang Hou, Qi Fan, [4pt] School of Intelligence Science, Technology, Nanjing University |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.02436