NanoFLUX: Distillation-Driven Compression of Large Text-to-Image Generation Models for Mobile Devices

Ruchika Chavhan, Malcolm Chadwick, Alberto Gil Couto Pimentel Ramos, Luca Morreale, Mehdi Noroozi, Abhinav Mehrotra · 2026

Read NanoFLUX: Distillation-Driven Compression of Large Text-to-Image Generation Models for Mobile Devices by Ruchika Chavhan, Malcolm Chadwick, Alberto Gil Couto Pimentel Ramos, Luca Morreale, Mehdi Noroozi, Abhinav Mehrotra (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-06879.txt.

Description

Ruchika Chavhan and five co-authors shrink a large text-to-image model down to phone size. State-of-the-art image generators keep growing, widening the gap with on-device solutions that must run fast on limited hardware. Their model, NanoFLUX, is a 2.4-billion-parameter flow-matching model distilled from a 17-billion-parameter teacher, built through a progressive compression pipeline designed to preserve quality.

The pipeline prunes redundant parts of the diffusion transformer, cutting it from 12 billion to 2 billion parameters, and adds a downsampling mechanism so middle blocks work on lower-resolution tokens. A new text encoder distillation step uses visual signals from the denoiser's early layers during sampling. The result generates 512 by 512 images in about 2.5 seconds on mobile devices, showing high-quality on-device generation is feasible.

Catalog record

CREATORRuchika Chavhan, Malcolm Chadwick, Alberto Gil Couto Pimentel Ramos, Luca Morreale, Mehdi Noroozi, Abhinav Mehrotra
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-06879

Browse the full library · About the Tower of Babel