OmniStyle: Filtering High Quality Style Transfer Data at Scale

Ye Wang Ruiqi Liu Jiang Lin Fei Liu Zili Yi Yilin Wang Rui Ma · 2025

Read OmniStyle: Filtering High Quality Style Transfer Data at Scale by Ye Wang Ruiqi Liu Jiang Lin Fei Liu Zili Yi Yilin Wang Rui Ma (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-14028.txt.

Introduction

Ye Wang and co-authors build a large data set for image style transfer in a paper from two thousand twenty-five. Style transfer repaints a photo in the look of another image or a text prompt. Training good models needs many high quality examples, which are hard to gather at scale.

Their data set holds over one million triplets of content image, style, and styled result, across one thousand style categories, with text descriptions. A filtering framework scores each triplet on content preservation, style match, and aesthetic appeal. On this base they train a transformer model that follows either text or image guidance and outputs detailed high-resolution results. Tests showed it beat existing approaches.

Catalog record

CREATORYe Wang Ruiqi Liu Jiang Lin Fei Liu Zili Yi Yilin Wang Rui Ma
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-14028

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

OmniStyle: Filtering High Quality Style Transfer Data at Scale Ye Wang Ruiqi Liu Jiang Lin Fei Liu Zili Yi Yilin Wang Rui Ma Abstract In this paper, we introduce OmniStyle-1M, a large-scale paired style transfer dataset comprising over one million content-style-stylized image triplets across 1,000 diverse style categories, each enhanced with textual descriptions and instruction prompts. We show that OmniStyle-1M can not only enable efficient and scalable of style transfer models through supervised training but also facilitate precise control over target stylization. Especially, to ensure the quality of the dataset, we introduce OmniFilter, a comprehensive style transfer quality assessment framework, which filters high-quality triplets based on content preservation, style consistency, and aesthetic appeal. Building upon this foundation, we propose OmniStyle, a framework based on the Diffusion Transformer (DiT) architecture designed for high-quality and efficient style transfer. This framework supports both instruction-guided and image-guided style transfer, generating high resolution outputs with exceptional detail. Extensive qualitative and quantitative evaluations demonstrate OmniStyle’s superior performance compared to existing approaches, highlighting its efficiency and versatility. OmniStyle-1M and its accompanying methodologies provide a significant contribution to advancing high-quality style transfer, offering a valuable resource for the research community. Figure 1 : OmniStyle enables high-quality (a) instruction-guided style transfer and (b) reference image-guided style transfer, covering a diverse range of styles, including but not limited to comics, vector art, oil painting, sketch, and Chinese ancient art. Note that in (a), a style image of the style descriptions is provided for illustration, and our method only takes a text instruction and a content image as input. In (b), results are generated in a traditional manner of style transfer, in which the model takes both the content and style images as input. 1 Introduction Style transfer [ 9 ] , the process of altering the artistic style of an image while preserving its content, has gained significant attention due to its creative potential across various domains, including digital art, advertising and fashion design. This technique has evolved rapidly, progressing from early optimization-based methods [ 9 , 10 , 18 ] to recent diffusion-based approaches [ 34 , 35 , 39 , 17 , 32 ] . While existing methods have shown promising results in transferring styles from reference images to content images, limitations remain in handling truly arbitrary styles. For instance, methods such as [ 9 , 16 , 13 , 18 , 20 ] focus on styles found in traditional artworks, such as oil painting, watercolor and sketches, while more recent methods [ 47 , 46 , 29 , 32 , 23 ] expand style transfer to include diverse styles like photography, cartoons, and illustrations. However, these methods still lack the generalization capability to handle truly arbitrary styles. Additionally, since many of these approaches rely on unsupervised training, they often lack control over the stylization process, e.g., unpredictable artifacts and distortion in stylized images. Moreover, due to the lack of large-scale, high-quality paired datasets, many methods are forced to adopt non-end-to-end architectures, such as optimization-based approaches [ 9 , 10 , 18 ] and recent inversion-based techniques [ 47 , 46 , 29 , 32 ] . These methods are computationally intensive, often requiring hundreds or even thousands of iterations to capture a specific style, or relying on inverting the content image and transferring style features within intermediate diffusion U-net blocks. These challenges substantially limit the efficiency and practicality of current methods for real-world applications. To address these challenges, we first introduce OmniStyle-1M, a large scale and high quality dataset which contains one million content-style-stylized image triplets across 1,000 distinct style categories, each enriched with detailed textual descriptions and instructional prompts. Specifically, we first generate content images in 20 categories using FLUX [ 1 ] and then select 1,000 style images from diverse categories within the Style30K dataset [ 19 ] . Then, we employ six state-of-the-art (SOTA) style transfer models to produce stylized results, ensuring a broad range of data sources and stylized results. Further details on the dataset are provided in Section 3 . A paired dataset provides well-defined target styles for each content image, enabling models to generate stylized images with greater consistency and predictability. To control style transfer outputs, we introduce OmniFilter, a multi-dimensional quality assessment and filtering framework based on CLIP [ 28 ] and a Multimodal Large Language Model (MLLM) [ 5 ] , tailored for customizing the OmniStyle-1M dataset. OmniFilter comprehensively evaluates image quality across three key dimensions: content preservation, ensuring that the original structure and semantics of the content image are retained; style consistency, guaranteeing alignment between the transferred and reference styles; and aesthetic appeal, ensuring that the output is visually engaging. Leveraging the high-quality, diverse data filtered by OmniFilter, we present OmniStyle, an end-to-end framework for high-quality and efficient style transfer based on the Diffusion Transformer (DiT) architecture [ 1 , 38 , 50 , 26 ] . OmniStyle supports both instruction-guided and image-guided style transfer tasks, generating rich, detailed results at high resolution. Experimental results demonstrate that our model achieves superior performance compared to existing style transfer methods. Our contributions are follows: • We propose OmniStyle-1M , the first million-level paired style transfer dataset, containing 1,000 style categories, along with a rich collection of textual and instruction prompt data. Such data paves a way for research community on enhancing supervised model training, controlling predictable stylized results and handling more diverse style references. • We propose OmniFilter , a specialized stylization-driven framework for assessing and filtering high-quality stylized images. OmniFilter evaluates images based on content preservation, style consistency, and aesthetic appeal, allowing models to learn from explicitly filtered high-quality examples for effective style transfer. • We propose OmniStyle , an efficient, flexible, simple feed-forward style transfer framework, which can serve as a strong baseline for future style transfer research and is adaptable for real-world applications through further model distillation. Table 1 : Comparison of style-related datasets. X denotes ‘not included’, \scriptstyle\checkmark denotes ‘few included’ and \checkmark denotes ‘included’. Datasets Main Task Triplet Components Style Category Number Prompt Category Triplet Number content style stylized EditBench [ 36 ] Image Editing \scriptstyle\checkmark X \scriptstyle\checkmark — Instruction — MagicBrush [ 42 ] Image Editing \scriptstyle\checkmark X \scriptstyle\checkmark — Instruction — HQ-Edit [ 14 ] Image Editing \scriptstyle\checkmark X \scriptstyle\checkmark — Instruction — UltraEdit [ 49 ] Image Editing \scriptstyle\checkmark X \scriptstyle\checkmark — Instruction — InstructPix2Pix [ 4 ] Image Editing \scriptstyle\checkmark X \scriptstyle\checkmark — Instruction — Style30K [ 19 ] Style-Related X ✓ X 1,120 Style Category 30K (Only Style Images) WikiArt [ 30 ] Style-Related X ✓ X 27 Style Category 57K (Only Style Images) ArtBench [ 22 ] Style-Related X ✓ X 10 Style Category 60K (Only Style Images) IMAGStyle [ 39 ] Style-Related ✓ ✓ ✓ 14 Text, Image 210K OmniStyle-1M Style-Related ✓ ✓ ✓ 1000 Text, Image, Instruction 1M 2 Related Work Style Transfer. Style transfer has evolved from early handcrafted feature-based methods [ 43 , 33 ] to optimization-driven approaches [ 9 , 10 , 18 ] , followed by arbitrary style transfer models [ 7 , 13 , 21 , 44 , 20 ] , and more recently, diffusion-based methods [ 34 , 35 , 6 , 32 , 47 , 15 , 40 , 17

Read the complete text