VideoJAM: Joint Appearance-Motion Representations for Enhanced Motion Generation in Video Models

Hila Chefer, Uriel Singer, Amit Zohar, Yuval Kirstain, Adam Polyak, Yaniv Taigman, Lior Wolf, Shelly Sheynin · 2025

Read VideoJAM: Joint Appearance-Motion Representations for Enhanced Motion Generation in Video Models by Hila Chefer, Uriel Singer, Amit Zohar, Yuval Kirstain, Adam Polyak, Yaniv Taigman, Lior Wolf, Shelly Sheynin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-02492.txt.

Description

Hila Chefer and seven co-authors gave video generators a motion sense in two thousand twenty-five with a frame called VideoJAM. Even strong video models still botch real-world motion and physics, because training rewards pixel likeness over movement coherence. Their fix trains the model to predict both the pixels and their motion from one shared representation.

At generation time, a guidance step steers output toward the model's own motion forecast as it forms. The frame bolts onto any video model with tiny changes, no new data or bigger model needed. Results beat top proprietary rivals on motion coherence and also looked better, the team reports.

Catalog record

CREATORHila Chefer, Uriel Singer, Amit Zohar, Yuval Kirstain, Adam Polyak, Yaniv Taigman, Lior Wolf, Shelly Sheynin
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE74 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-02492

Browse the full library · About the Tower of Babel