Diffusion-aided Extreme Video Compression with Lightweight Semantics Guidance
Maojun Zhang, Haotian Wu, Richeng Jin, Deniz Gündüz, Krystian Mikolajczyk · 2026
Read Diffusion-aided Extreme Video Compression with Lightweight Semantics Guidance by Maojun Zhang, Haotian Wu, Richeng Jin, Deniz Gündüz, Krystian Mikolajczyk (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-05201.txt.
Description
At extremely low bitrates, conventional video compression runs out of redundancy to exploit. Maojun Zhang and 4 co-authors take a generative route in this 2026 signal processing paper, accepted at ICASSP 2026. Instead of squeezing pixels, their codec sends a compact description of what the video means, and a diffusion model rebuilds the frames at the other end.
The semantic description is kept lean by splitting motion into two cheap parts. Background movement is summarized by camera trajectory parameters, while the moving foreground is carried by sparse segmentation masks. Conditioned on those semantics, the diffusion model synthesizes frames that preserve the scene's content and layout. The authors report decent reconstruction quality at bitrates where traditional and learned codecs, tied to low-level spatiotemporal redundancy, break down. The work points toward compression built on understanding first and pixels second.
Catalog record
| CREATOR | Maojun Zhang, Haotian Wu, Richeng Jin, Deniz Gündüz, Krystian Mikolajczyk |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 19 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-05201