LoRAShop: Training-Free Multi-Concept Image Generation and Editing with Rectified Flow Transformers

Yusuf Dalva, Hidir Yesiltepe, Pinar Yanardag · 2025

Read LoRAShop: Training-Free Multi-Concept Image Generation and Editing with Rectified Flow Transformers by Yusuf Dalva, Hidir Yesiltepe, Pinar Yanardag (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-23758.txt.

Introduction

Yusuf Dalva, Hidir Yesiltepe, and Pinar Yanardag give a train free way to blend many lone traits in one shot edit, in a 2025 paper. Lone trait packs teach a maker one face or style at a time. Past blends need retrain or hard clamps that oft break scene sense in the base shot.

Trait zones light up in set spots early in the clean steps of the maker. A first pass maps those zones, then trait packs run just in their zones. Face faith beats past blends while light and fine bits hold. Shot tales with many stars can thus be built fast.

Catalog record

CREATORYusuf Dalva, Hidir Yesiltepe, Pinar Yanardag
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-23758

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

LoRAShop: Training-Free Multi-Concept Image Generation and Editing with Rectified Flow Transformers Yusuf Dalva, Hidir Yesiltepe, Pinar Yanardag Abstract We introduce LoRAShop, the first framework for multi-concept image editing with LoRA models. LoRAShop builds on a key observation about the feature interaction patterns inside Flux-style diffusion transformers: concept-specific transformer features activate spatially coherent regions early in the denoising process. We harness this observation to derive a disentangled latent mask for each concept in a prior forward pass and blend the corresponding LoRA weights only within regions bounding the concepts to be personalized. The resulting edits seamlessly integrate multiple subjects or styles into the original scene while preserving global context, lighting, and fine details. Our experiments demonstrate that LoRAShop delivers better identity preservation compared to baselines. By eliminating retraining and external constraints, LoRAShop turns personalized diffusion models into a practical ‘photoshop-with-LoRAs’ tool and opens new avenues for compositional visual storytelling and rapid creative iteration. Figure 1 : LoRAShop. We present LoRAShop, a training-free framework enabling the simultaneous use of multiple LoRA adapters for generation and editing. By identifying the coarse boundaries of personalized concepts as subject priors, we allow the use of multiple LoRA adapters by eliminating the “cross-talk” between different adapters. 1 Introduction The rapid progress in Text-to-image (T2I) generative models [ 28 , 32 , 27 ] has opened new creative avenues such as content generation [ 37 , 4 , 21 ] and editing [ 3 , 38 , 49 , 22 , 6 , 48 , 5 ] , but users often desire customized outputs with specific topics or styles not present in the original training data [ 51 ] . Personalization techniques that fine-tune a pre-trained generative model on a small set of user-provided images have emerged to meet this need. Notably, methods like DreamBooth [ 29 ] and Low-Rank Adaptation (LoRA) [ 12 ] allow T2I models to be customized, capturing user-specific concepts (e.g. a particular pet, a unique face, or a distinct art style) and regenerating them in new contexts with high fidelity. While single-concept personalization is a relatively simple task, multi-concept generation is a challenging problem: Given multiple fine-tuned concept models (e.g. several LoRAs trained on different subjects), how can we compose them to synthesize a coherent image containing all the custom concepts? Achieving such compositions is challenging because independently trained LoRAs can interfere with each other when combined, leading to identity distortions or one concept dominating the other – a phenomenon sometimes called “LoRA crosstalk” [ 10 , 24 , 20 , 35 ] . Simply merging or applying multiple LoRAs naively often causes one concept to vanish or entangle attributes with the other [ 10 ] . Recent research indeed highlights that multi-concept generation remains nontrivial: combining personalized models typically degrades individual concept quality unless special measures are taken [ 35 , 24 , 10 ] . However, these methods still require training a new combined model or a fine-tuning process (e.g., imposing constraints during each LoRA’s training or running a post hoc alignment optimization). While existing techniques can achieve multi-concept generation – i.e. producing a new image containing several personalized concepts – none of these methods addresses the task of multi-concept editing : modifying a given image to insert multiple new concepts. Multi-concept image editing presents a different set of challenges. Here, the goal is not to generate a scene from scratch, but to start from an input image and seamlessly blend in additional personalized elements (each defined by a LoRA model) into that image. A naive approach to this problem might be to apply iterative inpainting: for example, masking a region in the image and prompting the diffusion model (with the LoRA loaded) to generate the new concept in that area. Unfortunately, off-the-shelf inpainting with personalized diffusion models often yields artifacts and inconsistencies. The injected object or character may not blend naturally with the lighting and context of the original image, or the model may unintentionally alter the surrounding content. Another approach could be face-swapping or identity transfer, where a person’s face in the image is replaced with a personalized face (using a LoRA of that person). Although this can handle a single face, it often does not preserve the full appearance of the person, such as body features, and can produce unrealistic results. In this paper, we propose LoRAShop, a novel framework that enables multi-concept image editing with LoRA models, without requiring any additional training, special auxiliary inputs, or external segmentation. Given an input image and a set of LoRA modules (each encoding a different concept), LoRAShop allows the user to insert each concept into the image at a desired location in a disentangled way. One of our key observations is a disentangled mask extraction technique that leverages the internal representations of the rectified-flow model to localize the influence of each subject to be personalized. In essence, as each LoRA is applied during the denoising process, our method extracts a coarse mask that delineates the regions where that concept significantly contributes to the image. By combining these masks with the user’s concept specifications, LoRAShop is able to blend multiple concepts directly into the diffusion latent in a controlled manner (see Fig. 1 ). Our experiments show that LoRA subjects blend naturally into the original scene, and their identities/styles match the LoRA concepts with high fidelity. Our approach does not require training of any new model or ensemble; it directly utilizes existing LoRAs and the base rectified-flow model at inference time, making it efficient and user-friendly. We believe that LoRAShop fills an important gap between personalized generation and image editing, opening the door to new creative workflows (such as “LoRAshopping” with generative models) that were previously impractical. Figure 2 : LoRAShop Framework. LoRAShop enables multi-subject generation and editing over a two-stage training-free pipeline. First, we extract the subject prior \hat{M}_{c^{\prime}} , which gives a coarse-level prior on where the concept of interest, c^{\prime} , is located. Following, we introduce a blending mechanism over the transformer block residuals, which both enables seamless blending of customized features and bounds the region-of-interest for the LoRA adapter utilized. 2 Related Work Personalized Image Generation. Personalized image generation aims to inject a user-defined concept, typically a face, style, or object, into a text-to-image model so it can be used in future generations. Early work relied on Textual Inversion (TI) [ 9 ] , which learns a single embedding that reproduces a user’s concept. TI is lightweight, but struggles to learn concepts involve high level of detail, where it learns to reconstruct the target concept with diffusion loss. DreamBooth (DB) [ 29 ] improves fidelity by fine-tuning selected model weights and reserving a rare token for the new concept, though at a higher compute cost. Later methods seek better quality–efficiency trade-offs: \mathcal{P}{+} [ 40 ] extends TI with a richer token representation; Custom Diffusion [ 19 ] trains only cross-attention layers; and DB-LoRA [ 31 ] applies low-rank adaptation [ 12 ] to store each concept in a small rank-limited update. Recent encoder-based systems such as StyleDrop [ 36 ] , HyperDreamBooth [ 30 ] , Taming Encoder [ 15 ] , IP-Adapter [ 46 ] , MS-Diffusion [ 42 ] , MIP-Adapter [ 13 ]

Read the complete text