Garments2Look: A Multi-Reference Dataset for High-Fidelity Outfit-Level Virtual Try-On with Clothing and Accessories
Junyao Hu, Zhongwei Cheng, Waikeung Wong, Xingxing Zou · 2026
Read Garments2Look: A Multi-Reference Dataset for High-Fidelity Outfit-Level Virtual Try-On with Clothing and Accessories by Junyao Hu, Zhongwei Cheng, Waikeung Wong, Xingxing Zou (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-14153.txt.
Introduction
Hu and co-authors release Garments2Look, a dataset for virtual try-on of full outfits rather than single garments. It holds 80,000 pairs that map three to twelve reference clothing items onto one model photo. Forty major categories and over 300 fine subcategories cover layering and accessories. A synthesis pipeline builds outfit lists, renders try-ons, and filters results by machine checks and human review. Baseline tests show current methods still botch layering order and produce visible artifacts.
Catalog record
| CREATOR | Junyao Hu, Zhongwei Cheng, Waikeung Wong, Xingxing Zou |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56706 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.14153
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Garments2Look: A Multi-Reference Dataset for High-Fidelity Outfit-Level Virtual Try-On with Clothing and Accessories Junyao Hu, Zhongwei Cheng, Waikeung Wong, Xingxing Zou Abstract Virtual try-on (VTON) has advanced single-garment visualization, yet real-world fashion centers on full outfits with multiple garments, accessories, fine-grained categories, layering, and diverse styling, remaining beyond current VTON systems. Existing datasets are category-limited and lack outfit diversity. We introduce Garments2Look, the first large-scale multimodal dataset for outfit-level VTON, comprising 80K many-garments-to-one-look pairs across 40 major categories and 300+ fine-grained subcategories. Each pair includes an outfit with 3-12 reference garment images (Average 4.48), a model image wearing the outfit, and detailed item and try-on textual annotations. To balance authenticity and diversity, we propose a synthesis pipeline. It involves heuristically constructing outfit lists before generating try-on results, with the entire process subjected to strict automated filtering and human validation to ensure data quality. To probe task difficulty, we adapt SOTA VTON methods and general-purpose image editing models to establish baselines. Results show current methods struggle to try on complete outfits seamlessly and to infer correct layering and styling, leading to misalignment and artifacts. Our code and data are open-sourced on https://github.com/ArtmeScienceLab/Garments2Look . 1 Introduction Virtual Try-On (VTON) has demonstrated significant application potential in fields such as e-commerce 37 ; 13 , visual effects 1 , fashion design 39 ; 22 , and human-computer interaction 31 . At present, user’s expectations for VTON are no longer limited to a single garment, but extend to the ability to intuitively and accurately preview more complex outfits. Some research efforts have begun to investigate multiple items 58 ; 6 ; 57 ; 24 , layered garments 10 ; 43 ; 38 ; 54 , fine-grained categories 44 ; 9 , and styling techniques 58 ; 23 ; 20 , but no single method has emerged that focuses all these issues comprehensively. Figure 1 : Comparison of data formats in virtual try-on datasets. Outfit-level dataset is collected and generated from a large-scale set of real images, each paired with diverse clothing and accessories, and including the information of outfit layering and styling. A direct reason for this limitation lies in the structural deficiencies of existing image VTON datasets. As shown in Fig. 1 , representative datasets such as VITON-HD 5 and DressCode 27 have advanced in image quality and scale but were originally designed solely for single-garment try-on tasks. They overlook the role of the accessory, and lack textual annotations such as dressing techniques ( e.g . , whether a shirt is tucked into pants) and inter-garment coordination relationships ( e.g . , layering order in an outfit). Although OmniTry 12 enriches the range of wearable categories, its task remains limited to individual items, while M&M VTO 58 , BootComp 6 and DressCode-MR 57 support multi-reference inputs but suffer from limited garment category diversity. Therefore, there is a clear need for a new virtual try-on dataset that simultaneously supports diverse item categories and coherent outfit-level composition. Compared to single-item VTON, outfit-level VTON introduces new technical challenges. Garments exhibit complex layering and occlusion relationships. For instance, inner-outer ordering varies (a thin knit cardigan may be the outermost layer or worn under a coat), and dressing hacks differ (it can be worn normally, draped over the shoulders, or cinched around the waist). Faithfully capturing such details is vital to the quality and practical utility of the result. To this end, we propose Garments2Look, paving the way for more advanced VTON that meets real-world needs. Our contributions are as follows: • We introduce a large-scale, multimodal, open-source dataset tailored for outfit-level VTON, covering a wide range of fashion items and comprising 80K high-quality item-model image pairs. • We define a new VTON task that leverages rich structured annotations (text descriptions, layering order, dressing techniques) to apply multiple reference items along with their matching relationships to a model, producing flexible and diverse outfit try-on results. • We conduct extensive experiments with state-of-the-art VTON methods and make an in-depth analysis to reveal their shortcomings and offer insights for improvement. Table 1 : Comparisons of image VTON datasets. We focus on outfit-level VTON. Our data is built upon real high-solution real-world garment and model images. Look Resolution = The resolution (height \times width) of target image. \leq / \sim = The number of pixel is less than / approximately equal to the product. R/S = Real/Synthetic data. Layering/Styling = The dataset contains annotation of the garment layering order / styling techniques. VLM = Annotations are generated by visual-language models. Publicity = The dataset is open-sourced. Dataset Name Time Level #Class #Image #Item #Pair #Ref Image/Pair Look Resolution Source Layering Styling Publicity VITON-HD 5 CVPR 21 Item 1 27358 13679 13679 1 1024 \times 768 R ✗ ✗ Link DressCode 27 ECCV 22 Item 3 107584 53792 53792 1-2 (Avg 1.08) 1024 \times 768 R ✗ ✗ Link M&M VTO 58 CVPR 24 Outfit 2 - - 18.8M 2 1024 \times 512 R ✗ 5 Types ✗ Street TryOn 9 WACV 25 Item 13 14453 14453 0 1 512 \times 320 R ✗ ✗ Link Shining Yourself 26 CVPR 25 Item 4 - - 64000 1 512 \times 512 R ✗ ✗ ✗ BootComp 6 CVPR 25 Outfit 7 - - 54000 1-4 512 \times 384 R+S ✗ ✗ ✗ Dresscode-MR 57 arXiv 2508 Outfit 5 99260 71081 28179 1-4 (Avg 2.56) 1024 \times 768 R+S ✗ ✗ Link Nano-Con OOTD 18 arXiv 2508 Outfit 6 - - 19000 2-6 \leq 1024 \times 1024 R+S ✗ VLM ✗ OmniTry-Train 12 arXiv 2508 Item 12 - - 51195 1 \leq 1024 \times 1024 R+S ✗ VLM ✗ OmniTry-Bench 12 arXiv 2508 Item 12 825 360 6975 1 \sim 3000 \times 3000 R ✗ VLM Link GO-MLVTON 54 ICASSP 26 Outfit 2 10629 7091 3528 2 512 \times 384 R 2 Layers ✗ Link Garments2Look CVPR 26 Outfit 40 429054 184367 80041 3-12 (Avg 4.48) \sim 1024 \times 1024 R+S 1-5 Layers VLM Link 2 Related Work 2.1 Image-based Virtual Try-On Dataset As shown in Table 1 , we review the mainstream and recently released datasets for the image-based virtual try-on task. VITON-HD 5 significantly increase the resolution of virtual try-on images to a considerable size, but it only focuses a single gender (female) and a single clothing type (top). DressCode 27 and M&M VTO 58 acknowledge the importance of full-body garments and extend the clothing types to three categories (top, bottom, and full). For accessory try-on, Shining Yourself 26 collects paired images covering four categories: bracelets, rings, earrings, and necklaces. BootComp 6 proposes a try-off-based data synthesizing pipeline and a data filtering strategy. DressCode-MR 57 is built by CatVTON 7 and FLUX 21 , which considers five item categories, newly including shoes and bags. OmniTry 12 further expanded the application scenarios of VTON by considering more wearable types, but its data remains single-item paired images. Nano-Consistent-150K 18 includes a 19K VTON subset, but it ignores pose consistency. GO-MLVTON 54 constructs a dataset to address a specific challenge of handling two upper garments. To address the limitations of existing datasets, we propose a novel outfit-level dataset with multiple key advantages: it contains a large amount of high-quality real-world data, supports outfit-level reference input, provides