Progressive Growing of Video Tokenizers for Temporally Compact Latent Spaces

Aniruddha Mahapatra Long Mai David Bourgin Yitian Zhang Feng Liu · 2025

Read Progressive Growing of Video Tokenizers for Temporally Compact Latent Spaces by Aniruddha Mahapatra Long Mai David Bourgin Yitian Zhang Feng Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-05442.txt.

Description

Aniruddha Mahapatra and four co-authors compress video more tightly in time for AI generation, in a 2025 paper. Video generators work in a squeezed latent space made by a tokenizer. Squeezing time beyond fourfold usually wrecks quality unless the model grows.

The team notices that a gentle tokenizer, fed thinned-out video, rebuilds it better than a strong tokenizer fed the full stream. So they grow the strong tokenizer in stages, stacking heavier compression blocks on trained lighter ones. A mixing module passes features between levels so little is lost. Benchmarks show clearly better rebuilds at high time compression. Sharper tokenizers mean cheaper, faster video generation without giving up detail.

Catalog record

CREATORAniruddha Mahapatra Long Mai David Bourgin Yitian Zhang Feng Liu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-05442

Browse the full library · About the Tower of Babel