Modular Customization of Diffusion Models via Blockwise-Parameterized Low-Rank Adaptation
Mingkang Zhu Xi Chen Zhongdao Wang · 2025
Read Modular Customization of Diffusion Models via Blockwise-Parameterized Low-Rank Adaptation by Mingkang Zhu Xi Chen Zhongdao Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-08575.txt.
Description
Mingkang Zhu and co-authors present BlockLoRA, a way to merge many custom image models into one without retraining, in a paper from 2025. Diffusion models can learn a person, object, or style from a few images. But mixing concepts trained by apart users, while keeping each one intact, has stayed hard.
Older instant merges blur who is who and clash when many concepts join. The team traced why the clash happens and built a trick that erases stray output at random to cut it down. A block-by-block layout also guards each concept's look. In tests, the method merged 15 concepts at once, covering people, objects, scenes, and styles, with high fidelity.
Catalog record
| CREATOR | Mingkang Zhu Xi Chen Zhongdao Wang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-08575