VideoJAM: Joint Appearance-Motion Representations for Enhanced Motion Generation in Video Models
Hila Chefer, Uriel Singer, Amit Zohar, Yuval Kirstain, Adam Polyak, Yaniv Taigman, Lior Wolf, Shelly Sheynin · 2025
Read VideoJAM: Joint Appearance-Motion Representations for Enhanced Motion Generation in Video Models by Hila Chefer, Uriel Singer, Amit Zohar, Yuval Kirstain, Adam Polyak, Yaniv Taigman, Lior Wolf, Shelly Sheynin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-02492.txt.
Description
Hila Chefer and seven co-authors gave video generators a motion sense in two thousand twenty-five with a frame called VideoJAM. Even strong video models still botch real-world motion and physics, because training rewards pixel likeness over movement coherence. Their fix trains the model to predict both the pixels and their motion from one shared representation.
At generation time, a guidance step steers output toward the model's own motion forecast as it forms. The frame bolts onto any video model with tiny changes, no new data or bigger model needed. Results beat top proprietary rivals on motion coherence and also looked better, the team reports.
Catalog record
| CREATOR | Hila Chefer, Uriel Singer, Amit Zohar, Yuval Kirstain, Adam Polyak, Yaniv Taigman, Lior Wolf, Shelly Sheynin |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 74 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-02492