AmorLIP : Efficient Language-Image Pretraining via Amortization
Haotian Sun, Yitong Li, Yuchen Zhuang, Niao He, Hanjun Dai §, Bo Dai · 2025
Read AmorLIP : Efficient Language-Image Pretraining via Amortization by Haotian Sun, Yitong Li, Yuchen Zhuang, Niao He, Hanjun Dai §, Bo Dai (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-18983.txt.
Description
Haotian Sun and co-authors find a cheaper way to train models that link words with images. The standard method, called CLIP, learns by matching each image with its caption against wrong pairs. Good results need huge batches, which can demand hundreds of costly chips. Their 2025 method, AmorLIP, hands the costly steps to small helper networks.
The helpers learn to stand in for the pricey parts of training, based on a new view of how such models store energy. The team adds tricks to keep training stable. Across thirty-eight tests of sorting and finding images, AmorLIP beat the standard method again and again. Gains reached more than twelve percent on some tests, at far lower cost.
Catalog record
| CREATOR | Haotian Sun, Yitong Li, Yuchen Zhuang, Niao He, Hanjun Dai §, Bo Dai |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 82 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-18983