VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Model
Jingwen Sun, Wenyao Zhang, Zekun Qi, Shaojie Ren, Zezhi Liu, Hanxin Zhu, Guangzhong Sun, Xin Jin, Zhibo Chen · 2026
Read VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Model by Jingwen Sun, Wenyao Zhang, Zekun Qi, Shaojie Ren, Zezhi Liu, Hanxin Zhu, Guangzhong Sun, Xin Jin, Zhibo Chen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-10098.txt.
Description
Pretraining robot policies on internet video is attractive, yet current latent-action objectives often learn pixel variation instead of action-relevant change. A 2026 paper led by Jingwen Sun, with eight co-authors, introduces VLA-JEPA, a pretraining framework built around leakage-free state prediction. A target encoder reads future frames while the student sees only the present observation, so future information supervises but never leaks into inputs.
Forecasting in latent space instead of pixel space yields dynamics abstractions robust to camera motion and irrelevant background change. The recipe is simple: JEPA pretraining, then action-head fine-tuning, without multi-stage pipeline complexity. Tests on simulated benchmarks and real-world manipulation show consistent gains in generalization and robustness.
Catalog record
| CREATOR | Jingwen Sun, Wenyao Zhang, Zekun Qi, Shaojie Ren, Zezhi Liu, Hanxin Zhu, Guangzhong Sun, Xin Jin, Zhibo Chen |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-10098