Bootstrapping World Models from Dynamics Models in Multimodal Foundation Models
2025
Read Bootstrapping World Models from Dynamics Models in Multimodal Foundation Models (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-06006.txt.
Description
Yifu Qiu and co-authors teach vision-language models to predict future frames by first learning the reverse task, in this 2025 paper. Asked to imagine the next image from a current one plus a written action, such models produce physically implausible changes. The reverse job, naming the action that links two frames, turns out far easier to learn. That asymmetry drives their whole approach.
The reverse model labels actions for raw video frame pairs, growing training data for the forward task without human work. At run time it also scores several forward guesses, guiding search toward the best. On an action-based image editing benchmark, the bootstrapped model matched or beat specialist editors. Human judges rated it best on average across all test subsets.
Catalog record
| YEAR | 2025 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-06006