NanoFLUX: Distillation-Driven Compression of Large Text-to-Image Generation Models for Mobile Devices
Ruchika Chavhan, Malcolm Chadwick, Alberto Gil Couto Pimentel Ramos, Luca Morreale, Mehdi Noroozi, Abhinav Mehrotra · 2026
Read NanoFLUX: Distillation-Driven Compression of Large Text-to-Image Generation Models for Mobile Devices by Ruchika Chavhan, Malcolm Chadwick, Alberto Gil Couto Pimentel Ramos, Luca Morreale, Mehdi Noroozi, Abhinav Mehrotra (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-06879.txt.
Description
Ruchika Chavhan and five co-authors shrink a large text-to-image model down to phone size. State-of-the-art image generators keep growing, widening the gap with on-device solutions that must run fast on limited hardware. Their model, NanoFLUX, is a 2.4-billion-parameter flow-matching model distilled from a 17-billion-parameter teacher, built through a progressive compression pipeline designed to preserve quality.
The pipeline prunes redundant parts of the diffusion transformer, cutting it from 12 billion to 2 billion parameters, and adds a downsampling mechanism so middle blocks work on lower-resolution tokens. A new text encoder distillation step uses visual signals from the denoiser's early layers during sampling. The result generates 512 by 512 images in about 2.5 seconds on mobile devices, showing high-quality on-device generation is feasible.
Catalog record
| CREATOR | Ruchika Chavhan, Malcolm Chadwick, Alberto Gil Couto Pimentel Ramos, Luca Morreale, Mehdi Noroozi, Abhinav Mehrotra |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-06879