Any2AnyTryon: Leveraging Adaptive Position Embeddings for Versatile Virtual Clothing Tasks DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation emai; 2025; Any2AnyTryon report
Hailong Guo, Bohan Zeng, Yiren Song, Wentao Zhang, Chuang Zhang, Jiaming Liu · 2025
Read Any2AnyTryon: Leveraging Adaptive Position Embeddings for Versatile Virtual Clothing Tasks DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation emai; 2025; Any2AnyTryon report by Hailong Guo, Bohan Zeng, Yiren Song, Wentao Zhang, Chuang Zhang, Jiaming Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-15891.txt.
Introduction
Hailong Guo and five co-authors present Any2AnyTryon, a virtual try-on system that follows text instructions instead of rigid inputs. Shoppers want to see a garment on a model, a model wearing a different garment, and other combinations. Paired training data are scarce, and most systems handle only one fixed task, often needing masks or poses.
The team first built LAION-Garment, described as the largest open garment try-on dataset. Their model adds adaptive position embeddings so inputs of varied sizes and categories can be handled in one framework. That design supports mask-free generation with better control. The authors aim at a single tool for the many directions try-on requests take.
Catalog record
| CREATOR | Hailong Guo, Bohan Zeng, Yiren Song, Wentao Zhang, Chuang Zhang, Jiaming Liu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-15891
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Any2AnyTryon: Leveraging Adaptive Position Embeddings for Versatile Virtual Clothing Tasks DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation emai; 2025; Any2AnyTryon report Hailong Guo, Bohan Zeng, Yiren Song, Wentao Zhang, Chuang Zhang, Jiaming Liu Abstract . Image-based virtual try-on (VTON) aims to generate a virtual try-on result by transferring an input garment onto a target person’s image. However, the scarcity of paired garment-model data makes it challenging for existing methods to achieve high generalization and quality in VTON. Also, it limits the ability to generate mask-free try-ons. To tackle the data scarcity problem, approaches such as Stable Garment and MMTryon use a synthetic data strategy, effectively increasing the amount of paired data on the model side. However, existing methods are typically limited to performing specific try-on tasks and lack user-friendliness. To enhance the generalization and controllability of VTON generation, we propose Any2AnyTryon, which can generate try-on results based on different textual instructions and model garment images to meet various needs, eliminating the reliance on masks, poses, or other conditions. Specifically, we first construct the virtual try-on dataset LAION-Garment, the largest known open-source garment try-on dataset. Then, we introduce adaptive position embedding, which enables the model to generate satisfactory outfitted model images or garment images based on input images of different sizes and categories, significantly enhancing the generalization and controllability of VTON generation. In our experiments, we demonstrate the effectiveness of our Any2AnyTryon and compare it with existing methods. The results show that Any2AnyTryon enables flexible, controllable, and high-quality image-based virtual try-on generation. https://logn-2024.github.io/Any2anyTryonProjectPage/ Figure 1. Outfitted model and garment images generated by Any2AnyTryon. Table 1. Comparison of VTON functionalities achieved by our Any2AnyTryon and previous methods. Method Virtual tryon Model-free virtual tryon Garment reconstruction Try-on in layers DiOr ( Cui et al. 2021 ) ✓ ✗ ✗ ✓ TryOffDiff ( Velioglu et al. 2024 ) ✗ ✗ ✓ ✗ StableGarment ( Wang et al. 2024b ) ✓ ✓ ✗ ✗ Magic Clothing ( Chen et al. 2024 ) ✗ ✓ ✗ ✗ GP-VTON ( Xie et al. 2023 ) ✓ ✗ ✗ ✗ CatVTON ( Chong et al. 2024 ) ✓ ✗ ✗ ✗ Any2AnyTryon (Ours) ✓ ✓ ✓ ✓ 1. Introduction Inspired by the breakthroughs brought by Diffusion Models (DMs), the generation of human-related content has seen rapid development, with Virtual Try-On (VTON) being one of the most highly focused applications. Virtual Try-On aims to generate high-fidelity outfitted model images. Specifically, given a model image and a garment image, VTON methods are required to "dress" the model in the specified garment. This functionality has important applications in areas like online virtual try-ons and game design, making it significant for industries such as multimedia games. Previous methods, CatVTON ( Chong et al. 2024 ) and MMTryon ( Zhang et al. 2024a ) , utilize mask obtained by segment model and text as edit guidance, respectively, to achieve rational virtual try-on results. However, these methods are limited by the availability of high-quality garment, model pairs and struggle in complex generation scenarios, such as with "in-the-wild" model images. As a result, they fail to generate high-quality and ideal results. To address this, Stable Garment ( Wang et al. 2024b ) and MMTryon ( Zhang et al. 2024a ) proposed using generative models to replace the model and background in images, thus expanding the dataset. These methods have successfully achieved higher-quality and more generalized virtual try-on generation with the enlarged dataset. However, existing try-on methods often can only perform specific try-on tasks and have strict limitations on the input conditions provided by users. Additionally, the garment styles in datasets of existing methods remain insufficiently diverse, making it difficult for existing VTON methods to produce high-quality outfitted model images for garments in complex scenes. To solve these problems, we propose a new user-friendly mask-free VTON generation framework, Any2AnyTryon. As illustrated in Table 1 , existing VTON methods struggle to support multiple try-on generation tasks. In contrast, Any2AnyTryon can simultaneously fulfill multiple tasks based on user instructions. Firstly, we collect and integrate a large and diverse garment-model pair dataset, LAION-Garment, which includes garment and model images and corresponding user textual editing instructions. The outfitted images of the models include both "in-the-wild" and "in-the-shop" scenarios. Using this extensive dataset, we train a model capable of generating desired outfitted model images and garment images based on user editing instructions in both shop and wild settings. Because the dataset contains a rich set of training samples, the model can generate desired outputs based on user-provided editing instructions, making it more user-friendly compared to previous methods. The architecture of our model ensures that all conditions are provided in a clean latent format within the same representation space as the target latent, as demonstrated in Fig. 1 . This design allows the model to handle a variety of clothing tasks effectively. Additionally, we develop Adaptive Position Embedding, which adjusts the position embedding based on input textual prompts and image conditions, enabling Any2AnyTryon to generate high-quality outfitted model images and garment images simultaneously. Therefore, our Any2AnyTryon not only satisfies the ability to perform different try-on generation tasks within the same framework but also ensures high-quality generation results. To validate the generative capabilities of our method, we conduct experiments and compare our results with existing state-of-the-art methods. The results show that our approach generates outfitted images with better quality, finer details, and a more realistic appearance. In summary, the main contributions of our Any2AnyTryon are as follows: • We propose Any2AnyTryon based on DiT, modeling virtual try-on as a conditional generation task across multiple images. This unified framework integrates three tasks: virtual try-on, model and garment generation. • We design a new model architecture, where all conditions share the same representation space with the output images so that our method can achieve high-fidelity VTON generation in diverse scenarios. Additionally, we introduce Adaptive Position Embedding, which adjusts the position embeddings based on input textual and image conditions. This enhancement allows Any2AnyTryon to seamlessly generate high-quality results for various VTON tasks using flexible and non-fixed conditional inputs. • We collected a large-scale garment-model dataset, LAION-Garment, providing sufficient data for training VTON models to achieve high-quality outfitted model images. Extensive experiments and evaluations demonstrate that Any2AnyTryon outperforms other baseline methods in performance. 2. Related Work 2.1. Diffusion Transformer Recent advancements, particularly the introduction of latent diffusion models ( Song et al. 2020 ; Rombach et al. 2022 ; Lu et al. 2022 ; Luo et al. 2023 ) , have significantly improved both the quality and efficiency of generative tasks ( Zeng et al. 2023b ; Li et al. 2024b ; Li et al. 2024a ; Zeng et al. 2024 ; Zhang et al. 2024c ; Song et al. 2024a ) . To further elevate generative capabilities, large-scale transformer architectures have been incorporated into these frameworks, resulting in cutting-edge models such as DiT ( Peebles and Xie 2023 ) . Building on these foundational innovations, FLUX.1 ( Labs 2024 ) is a powerful flow-based ( Lipman et al. 2022 ) and DiT-based ( Peebles and Xie 2023 ) model. FLUX.1 is critically acclaimed for its excellent prompt understanding, text rendering, and natural image generation. Prompt understanding capability can