Progressive Growing of Video Tokenizers for Temporally Compact Latent Spaces
Aniruddha Mahapatra Long Mai David Bourgin Yitian Zhang Feng Liu · 2025
Read Progressive Growing of Video Tokenizers for Temporally Compact Latent Spaces by Aniruddha Mahapatra Long Mai David Bourgin Yitian Zhang Feng Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-05442.txt.
Description
Aniruddha Mahapatra and four co-authors compress video more tightly in time for AI generation, in a 2025 paper. Video generators work in a squeezed latent space made by a tokenizer. Squeezing time beyond fourfold usually wrecks quality unless the model grows.
The team notices that a gentle tokenizer, fed thinned-out video, rebuilds it better than a strong tokenizer fed the full stream. So they grow the strong tokenizer in stages, stacking heavier compression blocks on trained lighter ones. A mixing module passes features between levels so little is lost. Benchmarks show clearly better rebuilds at high time compression. Sharper tokenizers mean cheaper, faster video generation without giving up detail.
Catalog record
| CREATOR | Aniruddha Mahapatra Long Mai David Bourgin Yitian Zhang Feng Liu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-05442