OpenVision 3 : A Family of Unified Visual Encoder for Both Understanding and Generation

Letian Zhang, Sucheng Ren, Yanqing Liu, Xianhang Li, Zeyu Wang, Yuyin Zhou, Huaxiu Yao, Zeyu Zheng, Weili Nie, Guilin Liu, Zhiding Yu, Cihang Xie · 2026

Read OpenVision 3 : A Family of Unified Visual Encoder for Both Understanding and Generation by Letian Zhang, Sucheng Ren, Yanqing Liu, Xianhang Li, Zeyu Wang, Yuyin Zhou, Huaxiu Yao, Zeyu Zheng, Weili Nie, Guilin Liu, Zhiding Yu, Cihang Xie (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-15369.txt.

Description

Letian Zhang, Sucheng Ren, and a large team build one vision encoder that serves two masters. Their 2026 arXiv paper presents OpenVision 3, a family of encoders. Image understanding and image generation usually want different kinds of visual features.

The design is simple at its core. Compressed image latents from a variational autoencoder feed a vision transformer. Its output is trained for two roles at once. It must support reading an image and making one. A single unified representation thus carries both jobs at once, instead of relying on two separate encoders.

Catalog record

CREATORLetian Zhang, Sucheng Ren, Yanqing Liu, Xianhang Li, Zeyu Wang, Yuyin Zhou, Huaxiu Yao, Zeyu Zheng, Weili Nie, Guilin Liu, Zhiding Yu, Cihang Xie
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE25 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-15369

Browse the full library · About the Tower of Babel