Diffusion-aided Extreme Video Compression with Lightweight Semantics Guidance

Maojun Zhang, Haotian Wu, Richeng Jin, Deniz Gündüz, Krystian Mikolajczyk · 2026

Read Diffusion-aided Extreme Video Compression with Lightweight Semantics Guidance by Maojun Zhang, Haotian Wu, Richeng Jin, Deniz Gündüz, Krystian Mikolajczyk (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-05201.txt.

Description

At extremely low bitrates, conventional video compression runs out of redundancy to exploit. Maojun Zhang and 4 co-authors take a generative route in this 2026 signal processing paper, accepted at ICASSP 2026. Instead of squeezing pixels, their codec sends a compact description of what the video means, and a diffusion model rebuilds the frames at the other end.

The semantic description is kept lean by splitting motion into two cheap parts. Background movement is summarized by camera trajectory parameters, while the moving foreground is carried by sparse segmentation masks. Conditioned on those semantics, the diffusion model synthesizes frames that preserve the scene's content and layout. The authors report decent reconstruction quality at bitrates where traditional and learned codecs, tied to low-level spatiotemporal redundancy, break down. The work points toward compression built on understanding first and pixels second.

Catalog record

CREATORMaojun Zhang, Haotian Wu, Richeng Jin, Deniz Gündüz, Krystian Mikolajczyk
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE19 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-05201

Browse the full library · About the Tower of Babel