CompSlider: Compositional Slider for Disentangled Multiple-Attribute Image Generation
Zixin Zhu, Kevin Duarte, Mamshad Nayeem Rizve, Chengyuan Xu, Ratheesh Kalarot, Junsong Yuan · 2025
Read CompSlider: Compositional Slider for Disentangled Multiple-Attribute Image Generation by Zixin Zhu, Kevin Duarte, Mamshad Nayeem Rizve, Chengyuan Xu, Ratheesh Kalarot, Junsong Yuan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-01028.txt.
Introduction
Zixin Zhu leads a team of six authors on CompSlider for image generation with many attributes. Text-to-image models struggle with fine control of attributes. Age and smile are examples given in the paper. Slider methods offer precise control of single attributes. Existing ones train an adapter per attribute, though. Entanglement among attributes is overlooked as a result.
CompSlider generates a conditional prior for the base model. It controls many attributes at once through that prior. New losses compose multiple changes while keeping image structure. The method works in the latent space of the prior. It does not require retraining the base model at all. That cuts the burden for training and inference both. Tests cover varied attributes and extend to video.
Catalog record
| CREATOR | Zixin Zhu, Kevin Duarte, Mamshad Nayeem Rizve, Chengyuan Xu, Ratheesh Kalarot, Junsong Yuan |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-01028
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CompSlider: Compositional Slider for Disentangled Multiple-Attribute Image Generation Zixin Zhu, Kevin Duarte, Mamshad Nayeem Rizve, Chengyuan Xu, Ratheesh Kalarot, Junsong Yuan Abstract In text-to-image (T2I) generation, achieving fine-grained control over attributes - such as age or smile - remains challenging, even with detailed text prompts. Slider-based methods offer a solution for precise control of image attributes. Existing approaches typically train individual adapter for each attribute separately, overlooking the entanglement among multiple attributes. As a result, interference occurs among different attributes, preventing precise control of multiple attributes together. To address this challenge, we aim to disentangle multiple attributes in slider-based generation to enbale more reliable and independent attribute manipulation. Our approach, CompSlider, can generate a conditional prior for the T2I foundation model to control multiple attributes simultaneously. Furthermore, we introduce novel disentanglement and structure losses to compose multiple attribute changes while maintaining structural consistency within the image. Since CompSlider operates in the latent space of the conditional prior and does not require retraining the foundation model, it reduces the computational burden for both training and inference. We evaluate our approach on a variety of image attributes and highlight its generality by extending to video generation. Figure 1 : (a) Illustration of slider-based generation: text defines the primary object, while sliders enable continuous control over specific attributes in the generated image. (b) Examples of fine-grained attribute control in image generation achieved with our slider model. (c) The comparison between previous individual sliders and our compositional slider. Sequential adjustment in previous methods ignores attribute entanglement, leading to unintended interactions. In contrast, CompSlider enables simultaneous control, ensuring better disentanglement and independent adjustments. Pre-trained diffusion model denotes the T2I foundation model. 1 Introduction Figure 2 : Entanglement in the previous method [ 15 ] cause a fixed smile value to produce varying smile intensities depending on slider order; applying the smile slider before the age slider yields a young person with a closed smile, while the reverse order results in an open smile. The direction of the arrows indicates the sequential addition of control signals, while text and sliders shown below the images denote the corresponding input signals. Text-to-image (T2I) generation [ 8 , 39 , 44 , 9 , 11 , 47 , 21 , 16 , 51 , 17 ] made significant progress in recent years. The main avenue of controlling generated outputs involves adjusting input prompts through prompt engineering [ 30 , 12 ] . Ideally, a user-friendly approach provides directly and precisely control the attribute generation. Although recent methods [ 6 , 26 , 35 , 43 , 37 ] to control image generation allow users to specify attributes through text to refine generated images, they lack precise control over attribute strength, e.g. the intensity of an expression, and concepts that are hard to describe in text, such as the complexity of a scene. Slider-based generation [ 15 , 52 ] addresses this limitation by extending T2I foundation models: text specifies the main concept, while sliders provide auxiliary fine-grained controls, allowing continuous adjustment of various attributes, as shown in Fig. 1 a . Such an approach adds flexible, real-time attribute control in this conditional image generation task. Fig. 1 b illustrates how sliders enable fine-grained control over a specific attribute in a T2I model. Current challenges for slider-based generation include maintaining continuity , where slider values accurately reflect the intensity of changes in intended attributes, and structural consistency such as identity preservation of a person across attribute adjustments. Previous methods [ 15 , 52 ] address these challenges by fine-tuning a unique adapter for each attribute and using a guidance scale [ 20 ] to control slider intensity. However, images possess several attributes of interest, so users prefer to control multiple characteristics simultaneously. Previous methods overlook the entanglement among multiple attributes, making it difficult to precisely control each attribute while not affect other attributes. As shown in Fig. 2 , applying the same smile slider value results in varying smile intensities depending on the age intensities, indicating attribute entanglement. Meanwhile, variations in background and hairstyle further highlight the lack of structural consistency. Moreover, by considering each slider in isolation during training and inference, previous methods face an issue with scalability; for example, if a user wishes to control N attributes in text-to-image generation, then N forward passes would be required, leading to poor user-experience and a large computational burden. To address these issues and ensure effective disentanglement of inherently independent attributes, we propose CompSlider, a scalable compositional slider model that enables training and inference for multiple sliders by processing all attributes in a single forward pass. CompSlider generates conditional priors [ 3 ] , i.e. , conditioning inputs utilized by a pre-trained T2I foundation model, to produce images that align with user-specified attributes. To train CompSlider, we introduce two novel losses: a disentanglement loss and a structure loss. The disentanglement loss enforces that changes in a specific slider attribute do not interfere with other attributes by ensuring the model to generate conditions that accurately represent both commonly occurring and random attribute combinations. The structure loss regularizes the generated conditional priors within local slider value ranges, preserving structural consistency. Notably, CompSlider does not rely on paired data of the same subject with varying attribute intensities (e.g., the same person with both black and red hair), which is costly to obtain. Instead, we leverage random attribute combinations, ensuring robust generalization beyond the biases present in the training data. Unlike previous methods that require fine-tuning or back-propagating gradients through a T2I foundation model, CompSlider operates within the latent space of the conditional priors, which significantly reduces training costs. Our contributions are summarized below: • We present CompSlider, a conditional image generation approach that allows for fine-grained control of multiple attributes via disentanglement, ensuring independent and precise attribute manipulation. • We design a training strategy for multiple attribute learning without paired data. Our proposed disentangling and structure losses allow our model to learn arbitrary combinations of attributes that are not commonly found in the training data. • Quantitative and qualitative results show that CompSlider achieves superior continuity and consistency compared to previous state-of-the-art methods. We also show that the approach is generalizable to other modalities, like video. 2 Related Work Controlling Image Generation. Previous controllable image generation [ 13 , 35 , 25 , 57 , 54 ] models have advanced capabilities in personalization, customization, and task-specific image generation. These models offer some degree of control over image properties, with techniques like image diffusion providing adjustments for color variation [ 33 , 32 ] and inpainting [ 1 , 7 , 25 , 57 , 43 ] . Approaches like SpaText [ 2 ] map segmentation masks to localized token embeddings, enabling more targeted image modifications. Prompt-based image editing [ 6 , 24 , 53 ] offers practical tools for manipulating images directly through prompts. Different from these methods, we use sliders as auxiliary control signals for text, enabling fine-grained control over various object attributes. Slider-based Generation. Prior controlling image generation methods [ 28 , 54 , 46 , 4 , 5 , 34 , 23 , 14 , 27 , 10 ] often lack fine-grained control over edit strength or complex visual concepts that