OmniZip: Learning a Unified and Lightweight Lossless Compressor for Multi-Modal Data

Yan Zhao, Zhengxue Cheng, Junxuan Zhang, Dajiang Zhou, Qunshan Gu, Qi Wang, Li Song · 2026

Read OmniZip: Learning a Unified and Lightweight Lossless Compressor for Multi-Modal Data by Yan Zhao, Zhengxue Cheng, Junxuan Zhang, Dajiang Zhou, Qunshan Gu, Qi Wang, Li Song (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-22286.txt.

Description

Lossless compression saves storage and bandwidth, but most learned compressors serve one modality, forcing redundant deployments for images, text, speech, and more. Yan Zhao and six co-authors propose OmniZip, a unified lightweight compressor for multi-modal data spanning images, text, speech, touch, databases, and gene sequences. It rests on a lightweight backbone with three key components.

A modality-unified tokenizer reversibly turns diverse data into tokens, while a routing mechanism learns flexible multi-modal context. Multimodal language models could in principle unify compression too, but remain too complex for practical use. OmniZip offers the unification without the bulk, giving edge and archive systems one compressor for every data kind.

Catalog record

CREATORYan Zhao, Zhengxue Cheng, Junxuan Zhang, Dajiang Zhou, Qunshan Gu, Qi Wang, Li Song
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-22286

Browse the full library · About the Tower of Babel