SAISA: Towards Multimodal Large Language Models with Both Training and Inference Efficiency
Qianhao Yuan, Yanjiang Liu, Yaojie Lu, Hongyu Lin, Ben He, Xianpei Han, Le Sun · 2025
Read SAISA: Towards Multimodal Large Language Models with Both Training and Inference Efficiency by Qianhao Yuan, Yanjiang Liu, Yaojie Lu, Hongyu Lin, Ben He, Xianpei Han, Le Sun (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-02458.txt.
Description
Qianhao Yuan and co-authors present in 2025 SAISA, a build for image text models that cuts both training and use costs. Two past builds split the trade: one trains cheap and runs dear, the other runs cheap and trains dear. The key gap lies in how image bits attend to each other.
A test showed that image to image attention adds near nothing, so the team cut it. Their build feeds image traits straight into lean self attention blocks. At the same size as a known base model, run cost fell by two thirds and training cost by a fourth. Scores held in the same range.
Catalog record
| CREATOR | Qianhao Yuan, Yanjiang Liu, Yaojie Lu, Hongyu Lin, Ben He, Xianpei Han, Le Sun |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-02458