TQ-DiT: Efficient Time-Aware Quantization for Diffusion Transformers

Younghye Hwang, Hyojin Lee, Joonhyuk Kang · 2025

Read TQ-DiT: Efficient Time-Aware Quantization for Diffusion Transformers by Younghye Hwang, Hyojin Lee, Joonhyuk Kang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-04056.txt.

Description

Younghye Hwang, Hyojin Lee, and Joonhyuk Kang present a quantization method that makes diffusion transformers, image-generating models, smaller and faster. Their paper came out in 2025. Quantization stores a model's numbers at lower precision, which cuts computing cost but can hurt image quality.

Their first technique splits each block's values into two regions, because the values are spread unevenly, and gives each region its own scale. Their second technique groups time steps, since activity values shift as generation proceeds, which reduces error from that drift. At moderate compression the image quality score stayed close to the full-precision model. At stronger compression their method beat rival methods, which suits real-time generation.

Catalog record

CREATORYounghye Hwang, Hyojin Lee, Joonhyuk Kang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-04056

Browse the full library · About the Tower of Babel