T-GEMs: Text-Guided Exit Modules for decreasing clip image encoder
Alberto Presta, Grzegorz Stefanski, Michal Byra, Krzysztof Arendt · 2026
Read T-GEMs: Text-Guided Exit Modules for decreasing clip image encoder by Alberto Presta, Grzegorz Stefanski, Michal Byra, Krzysztof Arendt (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-17499.txt.
Description
Presta and colleagues introduce text-guided exit modules for shrinking CLIP image encoders, letting easy inputs leave the encoder early. They study how semantic content spreads across intermediate layers and whether text descriptions can reveal it. The resulting modules plus a rate-based regularizer control encoder usage cost while preserving cross-modal understanding. The approach cuts compute for image-text pairs without surrendering matching performance.
Catalog record
| CREATOR | Alberto Presta, Grzegorz Stefanski, Michal Byra, Krzysztof Arendt |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21045 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.17499