SAISA: Towards Multimodal Large Language Models with Both Training and Inference Efficiency

Qianhao Yuan, Yanjiang Liu, Yaojie Lu, Hongyu Lin, Ben He, Xianpei Han, Le Sun · 2025

Read SAISA: Towards Multimodal Large Language Models with Both Training and Inference Efficiency by Qianhao Yuan, Yanjiang Liu, Yaojie Lu, Hongyu Lin, Ben He, Xianpei Han, Le Sun (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-02458.txt.

Description

Qianhao Yuan and co-authors present in 2025 SAISA, a build for image text models that cuts both training and use costs. Two past builds split the trade: one trains cheap and runs dear, the other runs cheap and trains dear. The key gap lies in how image bits attend to each other.

A test showed that image to image attention adds near nothing, so the team cut it. Their build feeds image traits straight into lean self attention blocks. At the same size as a known base model, run cost fell by two thirds and training cost by a fourth. Scores held in the same range.

Catalog record

CREATORQianhao Yuan, Yanjiang Liu, Yaojie Lu, Hongyu Lin, Ben He, Xianpei Han, Le Sun
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-02458

Browse the full library · About the Tower of Babel