Can Diffusion Models Disentangle? A Theoretical Perspective

Liming Wang, Muhammad Jehanzeb Mirza, Yishu Gong, Yuan Gong, Jiaqi Zhang, Brian H. Tracey, Katerina Placek, Marco Vilela, James R. Glass · 2025

Read Can Diffusion Models Disentangle? A Theoretical Perspective by Liming Wang, Muhammad Jehanzeb Mirza, Yishu Gong, Yuan Gong, Jiaqi Zhang, Brian H. Tracey, Katerina Placek, Marco Vilela, James R. Glass (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-00220.txt.

Introduction

Liming Wang and co-authors ask whether diffusion models can separate the factors that make up data in two thousand twenty-five. A disentangled code splits apart traits such as shape and color, which aids control and trust. Whether the popular diffusion family learns such splits was open.

Their theory sets terms under which the true factors can be picked out, traces how training moves, and bounds how much data the learning needs. Tests span toy mixtures, image coloring, image cleanup, and voice conversion for speech sorting. Training tweaks drawn from the theory, such as style guidance, steadily improved the split in practice. The work gives a base for building more legible generators.

Catalog record

CREATORLiming Wang, Muhammad Jehanzeb Mirza, Yishu Gong, Yuan Gong, Jiaqi Zhang, Brian H. Tracey, Katerina Placek, Marco Vilela, James R. Glass
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE183 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-00220

Browse the full library · About the Tower of Babel