VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Model

Jingwen Sun, Wenyao Zhang, Zekun Qi, Shaojie Ren, Zezhi Liu, Hanxin Zhu, Guangzhong Sun, Xin Jin, Zhibo Chen · 2026

Read VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Model by Jingwen Sun, Wenyao Zhang, Zekun Qi, Shaojie Ren, Zezhi Liu, Hanxin Zhu, Guangzhong Sun, Xin Jin, Zhibo Chen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-10098.txt.

Description

Pretraining robot policies on internet video is attractive, yet current latent-action objectives often learn pixel variation instead of action-relevant change. A 2026 paper led by Jingwen Sun, with eight co-authors, introduces VLA-JEPA, a pretraining framework built around leakage-free state prediction. A target encoder reads future frames while the student sees only the present observation, so future information supervises but never leaks into inputs.

Forecasting in latent space instead of pixel space yields dynamics abstractions robust to camera motion and irrelevant background change. The recipe is simple: JEPA pretraining, then action-head fine-tuning, without multi-stage pipeline complexity. Tests on simulated benchmarks and real-world manipulation show consistent gains in generalization and robustness.

Catalog record

CREATORJingwen Sun, Wenyao Zhang, Zekun Qi, Shaojie Ren, Zezhi Liu, Hanxin Zhu, Guangzhong Sun, Xin Jin, Zhibo Chen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-10098

Browse the full library · About the Tower of Babel