SmolVLM: Redefining small and efficient multimodal models

2025

Read SmolVLM: Redefining small and efficient multimodal models (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-05299.txt.

Description

Andrés Marafioti and a large team of co-authors introduce a family of small vision-language models in a paper from two thousand twenty-five. Big multimodal models are powerful but too heavy for phones and edge devices. Small versions usually copy big designs and waste memory.

The SmolVLM series was engineered from scratch for lean inference. The team tuned architecture, image tokenization, and training data for low overhead. The smallest model runs in under one gigabyte of memory yet beat a model three hundred times larger. The largest, at two point two billion parameters, rivals top models using twice the memory. The models also handle video well. The lesson: careful design beats brute scale for on-device AI.

Catalog record

YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-05299

Browse the full library · About the Tower of Babel