AmorLIP : Efficient Language-Image Pretraining via Amortization

Haotian Sun, Yitong Li, Yuchen Zhuang, Niao He, Hanjun Dai §, Bo Dai · 2025

Read AmorLIP : Efficient Language-Image Pretraining via Amortization by Haotian Sun, Yitong Li, Yuchen Zhuang, Niao He, Hanjun Dai §, Bo Dai (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-18983.txt.

Description

Haotian Sun and co-authors find a cheaper way to train models that link words with images. The standard method, called CLIP, learns by matching each image with its caption against wrong pairs. Good results need huge batches, which can demand hundreds of costly chips. Their 2025 method, AmorLIP, hands the costly steps to small helper networks.

The helpers learn to stand in for the pricey parts of training, based on a new view of how such models store energy. The team adds tricks to keep training stable. Across thirty-eight tests of sorting and finding images, AmorLIP beat the standard method again and again. Gains reached more than twelve percent on some tests, at far lower cost.

Catalog record

CREATORHaotian Sun, Yitong Li, Yuchen Zhuang, Niao He, Hanjun Dai §, Bo Dai
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE82 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-18983

Browse the full library · About the Tower of Babel