Modular Customization of Diffusion Models via Blockwise-Parameterized Low-Rank Adaptation

Mingkang Zhu Xi Chen Zhongdao Wang · 2025

Read Modular Customization of Diffusion Models via Blockwise-Parameterized Low-Rank Adaptation by Mingkang Zhu Xi Chen Zhongdao Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-08575.txt.

Description

Mingkang Zhu and co-authors present BlockLoRA, a way to merge many custom image models into one without retraining, in a paper from 2025. Diffusion models can learn a person, object, or style from a few images. But mixing concepts trained by apart users, while keeping each one intact, has stayed hard.

Older instant merges blur who is who and clash when many concepts join. The team traced why the clash happens and built a trick that erases stray output at random to cut it down. A block-by-block layout also guards each concept's look. In tests, the method merged 15 concepts at once, covering people, objects, scenes, and styles, with high fidelity.

Catalog record

CREATORMingkang Zhu Xi Chen Zhongdao Wang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-08575

Browse the full library · About the Tower of Babel