Back to Parsimonious Latents: Learning Task-Centric World Models from Visual Foundations
Minghao Fu, Fan Feng, Nicklas Hansen, Biwei Huang · 2026
Read Back to Parsimonious Latents: Learning Task-Centric World Models from Visual Foundations by Minghao Fu, Fan Feng, Nicklas Hansen, Biwei Huang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-25620.txt.
Description
Fu and colleagues ask what a world model should remember when an agent must plan from vision alone. Frozen visual embeddings carry rich detail but also much a task does not need. Pixel-trained latents, by contrast, lack semantic structure. Their TC-WM shrinks high-dimensional visual embeddings into a small latent space and aligns part of it with the agent's physical state. It rebuilds embeddings to keep useful visual structure. Tests show better modeling and more precise control than leading rivals.
Catalog record
| CREATOR | Minghao Fu, Fan Feng, Nicklas Hansen, Biwei Huang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 93805 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.25620