IMAGGarment-1: Fine-Grained Garment Generation for Controllable Fashion Design DOI: XXXXXXX.XXXXXXX Conference: October; June 03–05, 2025; Dublin, Ireland Price: 15.00 ISBN: 978-1-4503-XXXX-X/18/06 CCS: Human-centered computing Visualization design and evaluation methods
Fei Shen 1 , Jian Yu 1 , Cong Wang 2 , Xin Jiang 1 , Xiaoyu Du 1 , Jinhui Tang 1 · 2025
Read IMAGGarment-1: Fine-Grained Garment Generation for Controllable Fashion Design DOI: XXXXXXX.XXXXXXX Conference: October; June 03–05, 2025; Dublin, Ireland Price: 15.00 ISBN: 978-1-4503-XXXX-X/18/06 CCS: Human-centered computing Visualization design and evaluation methods by Fei Shen 1 , Jian Yu 1 , Cong Wang 2 , Xin Jiang 1 , Xiaoyu Du 1 , Jinhui Tang 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-13176.txt.
Introduction
Fei Shen and five co-authors present a framework for generating clothing images in this two thousand twenty-five paper. Fashion designers want fine control over a garment's shape, color, and logo placement. Earlier generators took only one condition at a time, which limits design work. Their system, IMAGGarment, accepts several conditions at once. It trains in two stages to handle global look and local detail apart.
The first stage models the overall silhouette and color with a mixed attention design. The second stage adds user logos and spatial constraints with care. The two stages join into one end-to-end tool. Output images aim for high fidelity to the brief. The work serves digital apparel and personalized fashion design.
Catalog record
| CREATOR | Fei Shen 1 , Jian Yu 1 , Cong Wang 2 , Xin Jiang 1 , Xiaoyu Du 1 , Jinhui Tang 1 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-13176
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
IMAGGarment-1: Fine-Grained Garment Generation for Controllable Fashion Design DOI: XXXXXXX.XXXXXXX Conference: October; June 03–05, 2025; Dublin, Ireland Price: 15.00 ISBN: 978-1-4503-XXXX-X/18/06 CCS: Human-centered computing Visualization design and evaluation methods Fei Shen 1 , Jian Yu 1 , Cong Wang 2 , Xin Jiang 1 , Xiaoyu Du 1 , Jinhui Tang 1 Abstract . This paper presents IMAGGarment-1, a fine-grained garment generation (FGG) framework that enables high-fidelity garment synthesis with precise control over silhouette, color, and logo placement. Unlike existing methods that are limited to single-condition inputs, IMAGGarment-1 addresses the challenges of multi-conditional controllability in personalized fashion design and digital apparel applications. Specifically, IMAGGarment-1 employs a two-stage training strategy to separately model global appearance and local details, while enabling unified and controllable generation through end-to-end inference. In the first stage, we propose a global appearance model that jointly encodes silhouette and color using a mixed attention module and a color adapter. In the second stage, we present a local enhancement model with an adaptive appearance-aware module to inject user-defined logos and spatial constraints, enabling accurate placement and visual consistency. To support this task, we release GarmentBench, a large-scale dataset comprising over 180K garment samples paired with multi-level design conditions, including sketches, color references, logo placements, and textual prompts. Extensive experiments demonstrate that our method outperforms existing baselines, achieving superior structural stability, color fidelity, and local controllability performance. The code and model are available at https://github.com/muzishen/IMAGGarment-1 . Figure 1. Comparison of (a) existing sketch-to-image and logo insertion tasks with (b) our proposed fine-grained garment generation (FGG) task, which enables precise and controllable synthesis of garment structure, color, logo, and spatial placement. Unlike previous tasks that rely on a single input condition, FGG is tailored for real-world fashion design workflows by integrating multiple conditional controls. 1. Introduction Fine-Grained garment generation (FGG) aims to synthesize high-quality garments with precise control over garment silhouette, color scheme, logo content, and spatial placement. As personalized fashion and the digital apparel market grow rapidly, fine-grained controllability is increasingly crucial for applications in fashion design, brand customization, and personalized e-commerce. Recently, image synthesis ( Podell et al. 2023 ; Lipman et al. 2022 ) has made notable progress in tasks such as sketch-to-image generation ( Voynov et al. 2023 ; Isola et al. 2017 ) and logo insertion ( Kim et al. 2024 ) (as illustrated in Figure 1 (a)), demonstrating basic capabilities in structural and content-level control. However, these tasks provide only coarse guidance and rely on single-condition inputs ( e.g. , sketch or color), lacking the fine-grained controllability needed to model the nuanced interactions between global structure and local details in garment design. Although sequential or modular combinations may offer partial solutions, they fail to explicitly disentangle and jointly model global attributes ( e.g. , silhouette, color) and local appearance details ( e.g. , logo content and spatial placement). Without unified control mechanisms or hierarchical representations, these approaches often suffer from condition entanglement, conflicting objectives, and visual inconsistencies, ultimately falling short of the high standards required in real-world fashion design. In contrast, practical fashion design requires joint control over multiple interdependent factors: designers determine global attributes such as silhouette and color, followed by fine-tuning of local elements like logos and their placement. To support this process, a unified generation task that clearly separates and coordinates global and local attributes is essential for controllable and high-fidelity synthesis. To address these limitations, we propose a new task: fine-grained garment generation (FGG), as illustrated in Figure 1 (b). FGG is formulated as a unified multi-conditional garment synthesis task, taking a textual prompt, garment silhouette, color palette, and spatially constrained logos as joint inputs. It aims to generate garments that faithfully reflect high-level structural intent and fine-grained local styling cues. FGG is specifically designed to mirror real-world fashion workflows, where designers must coordinate diverse input modalities to express creative intent. Unlike conventional approaches that process each condition independently or sequentially, FGG emphasizes joint modeling and hierarchical reasoning across input types. It goes beyond simple task combinations by enforcing consistent integration of global and local attributes within a unified generation framework, enabling nuanced control over the overall structure and detailed appearance. Specifically, FGG task introduces three key challenges: (1) maintaining visual and semantic consistency across heterogeneous input conditions, (2) resolving conflicts between global structures and localized visual elements, and (3) generalizing to unseen condition combinations without retraining (see Figure 1 (c)). FGG thus marks a fundamental shift from single-condition or loosely coupled pipelines toward a unified, design-intent-driven generation paradigm that better reflects the complexity of real-world garment design. To this end, we propose IMAGGarment-1, a two-stage training and end-to-end inference framework tailored for fine-grained garment generation. Unlike prior methods ( Ye et al. 2023 ; Zhang et al. 2023a ; Rombach et al. 2022 ) that rely on single-condition inputs or simple feature fusion, our framework is explicitly designed to achieve fine-grained controllability under multiple, interdependent constraints. In the first stage, we propose a global appearance model with a mixed attention module and a color adapter to jointly encode garment silhouette and color palette, improving overall appearance fidelity and mitigating condition entanglement. In the second stage, we present a local enhancement model equipped with an adaptive appearance-aware module to inject user-defined logos and their spatial constraints, enabling precise logo placement while preserving global consistency. To further promote research in this direction, we release GarmentBench, a large-scale dataset comprising over 180k garment samples annotated with rich multi-level design conditions, including silhouette sketches, color references, logo placements, and textual prompts. Extensive experiments demonstrate that IMAGGarment-1 significantly outperforms existing baselines in terms of structural stability and local controllability. To summarize, the main contributions are listed as follows: • We propose IMAGGarment-1, a controllable garment generation framework that enables precise control over garment structure, color, and logo placement, addressing the challenges of FGG. • We design a mixed attention module, color adapter, and adaptive appearance-aware module to disentangle global structure from local attributes, achieving fine-grained visual control and accurate spatial control. • We release GarmentBench, a large-scale dataset with diverse garments and rich multi-conditional annotations, serving as a valuable benchmark for FGG research. 2. Related Work 2.1. GAN-Based Methods Early approaches ( Chen et al. 2020 ; Chen et al. 2021 ; Wu et al. 2022 ; Ghosh et al. 2019 ; Chen and Hays 2018 ; Ghosh et al. 2019 ; Li et al. 2020 ) to garment generation often employ generative adversarial networks (GANs) ( Creswell et al. 2018 ; Mirza and Osindero 2014 ; Men et al. 2020 ) , focusing primarily on sketch-to-image translation ( Liu et al. 2017 ) by learning spatial mappings from structural cues. For example, DeepFaceDrawing ( Chen et al. 2020 ) and DeepFaceEditing ( Chen et al. 2021 ) decompose sketches into individual facial components and progressively assemble them into photorealistic portraits. Then, DeepPortraitDrawing ( Wu et al. 2022 ) extends this strategy to full-body synthesis using a local-to-global pipeline. Similarly, Interactive frameworks ( Ghosh et al. 2019 ) introduce gating mechanisms to support user-driven editing, while DALColor ( Ci et al. 2018 ) combines WGAN-GP with line-art colorization for refined appearance control. However, these methods ( Chen et al. 2020 ; Chen et al. 2021