DGQ: Distribution-Aware Group Quantization for Text-to-Image Diffusion Models

Hyogon Ryu, NaHyeon Park, Hyunjung Shim · 2025

Read DGQ: Distribution-Aware Group Quantization for Text-to-Image Diffusion Models by Hyogon Ryu, NaHyeon Park, Hyunjung Shim (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-04304.txt.

Description

Hyogon Ryu, NaHyeon Park, and Hyunjung Shim propose, in 2025, a smarter way to shrink text-to-image diffusion models. These models are heavy, and compressing their numbers to fewer bits cuts memory and cost. Past methods often lost image quality or the match between prompt and picture, especially at very low bit counts.

Their analysis blames extreme activation values for quality loss and attention patterns for prompt drift. The method handles outliers group by group and sets prompt-specific scales for the attention part. Results on two standard datasets were strong, and no extra fine-tuning of the compressed weights was needed. The team claims a first for low-bit success here.

Catalog record

CREATORHyogon Ryu, NaHyeon Park, Hyunjung Shim
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-04304

Browse the full library · About the Tower of Babel