A Self-Supervised Learning Framework for Video Encoding Complexity Clustering
Krishna Srikar Durbha, Hassene Tmar, Ping-Hao Wu, Ioannis Katsavounidis, Alan C. Bovik · 2026
Read A Self-Supervised Learning Framework for Video Encoding Complexity Clustering by Krishna Srikar Durbha, Hassene Tmar, Ping-Hao Wu, Ioannis Katsavounidis, Alan C. Bovik (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-29166.txt.
Description
Durbha, Tmar, Wu, Katsavounidis and Bovik propose a self-supervised way to cluster videos by how hard they are to compress. Adaptive streaming delivers video over the internet at varying quality, and choosing the best encoding settings per video matters for cost and quality. Those settings depend on content, so knowing a video's encoding complexity in advance helps plan the bitrate ladder.
Their framework, Compression Echo Contrastive Learning, uses a video's response to compression itself as the teaching signal. This compression echo reveals underlying encoding traits during pretraining, with no manual labels needed. The learned representations are then used for the downstream task of grouping videos by encoding complexity. Extensive experiments show the method improves on leading general visual encoders at this task. Against a fixed bitrate ladder, the approach also delivered strong bitrate and quality savings, which the authors present as the practical payoff for streaming platforms.
Catalog record
| CREATOR | Krishna Srikar Durbha, Hassene Tmar, Ping-Hao Wu, Ioannis Katsavounidis, Alan C. Bovik |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.29166