Efficient Universal Perception Encoder

Chenchen Zhu, Saksham Suri, Cijo Jose, Maxime Oquab, Marc Szafraniec, Wei Wen, Yunyang Xiong, Patrick Labatut, Piotr Bojanowski, Raghuraman Krishnamoorthi, Vikas Chandra · 2026

Read Efficient Universal Perception Encoder by Chenchen Zhu, Saksham Suri, Cijo Jose, Maxime Oquab, Marc Szafraniec, Wei Wen, Yunyang Xiong, Patrick Labatut, Piotr Bojanowski, Raghuraman Krishnamoorthi, Vikas Chandra (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-22387.txt.

Description

Zhu and co-authors build EUPE, a small vision encoder that still serves many tasks well. Edge devices need one encoder that is tiny yet strong across jobs. EUPE learns by distillation from several expert foundation encoders. The twist is the path: scale up first, then scale down. Earlier methods shrank many teachers straight into one small model. EUPE instead distills the experts into one large proxy teacher. The small encoder then learns from that single teacher. Tests show EUPE matches or beats same-size experts across domains.

Catalog record

CREATORChenchen Zhu, Saksham Suri, Cijo Jose, Maxime Oquab, Marc Szafraniec, Wei Wen, Yunyang Xiong, Patrick Labatut, Piotr Bojanowski, Raghuraman Krishnamoorthi, Vikas Chandra
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50465
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.22387

Browse the full library · About the Tower of Babel