Back to Parsimonious Latents: Learning Task-Centric World Models from Visual Foundations

Minghao Fu, Fan Feng, Nicklas Hansen, Biwei Huang · 2026

Read Back to Parsimonious Latents: Learning Task-Centric World Models from Visual Foundations by Minghao Fu, Fan Feng, Nicklas Hansen, Biwei Huang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-25620.txt.

Description

Fu and colleagues ask what a world model should remember when an agent must plan from vision alone. Frozen visual embeddings carry rich detail but also much a task does not need. Pixel-trained latents, by contrast, lack semantic structure. Their TC-WM shrinks high-dimensional visual embeddings into a small latent space and aligns part of it with the agent's physical state. It rebuilds embeddings to keep useful visual structure. Tests show better modeling and more precise control than leading rivals.

Catalog record

CREATORMinghao Fu, Fan Feng, Nicklas Hansen, Biwei Huang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE93805
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.25620

Browse the full library · About the Tower of Babel