DermaFlux : Synthetic Skin Lesion Generation with Rectified Flows for Enhanced Image Classification
Stathis Galanakis, Alexandros Koliousis, Stefanos Zafeiriou · 2026
Read DermaFlux : Synthetic Skin Lesion Generation with Rectified Flows for Enhanced Image Classification by Stathis Galanakis, Alexandros Koliousis, Stefanos Zafeiriou (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-16392.txt.
Introduction
Galanakis, Koliousis, and Zafeiriou generate fake skin lesion images to aid diagnosis. Real clinical datasets are small and skewed toward benign cases. Their DermaFlux system turns text descriptions into lesion images. It fine-tunes a Flux model with low-rank adaptation on curated photo sets. Captions came from a language model, using standard dermatology traits. Adding synthetic images lifted classification by up to 6%. A fine-tuned ViT reached about 78% accuracy, beating rival models.
Catalog record
| CREATOR | Stathis Galanakis, Alexandros Koliousis, Stefanos Zafeiriou |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21890 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.16392
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DermaFlux : Synthetic Skin Lesion Generation with Rectified Flows for Enhanced Image Classification Stathis Galanakis, Alexandros Koliousis, Stefanos Zafeiriou Abstract Despite recent advances in deep generative modeling, skin lesion classification systems remain constrained by the limited availability of large, diverse, and well-annotated clinical datasets, resulting in class imbalance between benign and malignant lesions and consequently reduced generalization performance. We introduce DermaFlux , a rectified flow-based text-to-image generative framework that synthesizes clinically grounded skin lesion images from natural language descriptions of dermatological attributes. Built upon Flux.1 , DermaFlux is fine-tuned using parameter-efficient Low-Rank Adaptation (LoRA) on a large curated collection of publicly available clinical image datasets. We construct image-text pairs using synthetic textual captions generated by Llama 3.2, following established dermatological criteria including lesion asymmetry, border irregularity, and color variation. Extensive experiments demonstrate that DermaFlux generates diverse and clinically meaningful dermatology images that improve binary classification performance by up to 6% when augmenting small real-world datasets, and by up to 9% when classifiers are trained on DermaFlux -generated synthetic images rather than diffusion-based synthetic images. Our ImageNet-pretrained ViT fine-tuned with only 2,500 2{,}500 real images and 4,375 4{,}375 DermaFlux -generated samples achieves 78.04 % 78.04\% binary classification accuracy and an AUC of 0.859 0.859 , surpassing the next best dermatology model by 8 % 8\% . Code, data and pretrained models are available at dermaflux.github.io 1 Introduction Skin cancer is among the most common cancers worldwide, posing a significant global health burden. Globally, approximately 331{,}722 new melanoma cases were reported in 2022 [ 28 ] , while in the United Kingdom alone, approximately 17{,}500 new melanoma cases were reported annually, making melanoma the fifth most common cancer in the country [ 3 ] . Accurate binary classification not only ensures that malignant lesions are identified early, when treatment is most effective, but also reduces unnecessary referrals for benign lesions. Recent advances in deep learning have demonstrated strong potential for skin lesion classification, offering scalable support for clinical decision-making. However, deep learning models require large, well-annotated datasets that are difficult to obtain and share. The collection of dermatological images is subject to strict ethical, legal, and privacy regulations, often requiring informed consent and institutional approval. Consequently, publicly accessible datasets remain limited in size and may fail to capture sufficient variability in skin tone, lesion morphology, and rare malignant subtypes. This scarcity leads to class imbalance and reduced generalization capability in deep learning-based lesion classifiers. Synthetic data generation is a promising solution to mitigate data scarcity. In this context, Stable Diffusion (SD) [ 25 ] has recently been widely adopted to synthesize skin lesion images conditioned on textual descriptions [ 1 , 7 ] . However, two key challenges remain: ( i ) reliable control over clinically meaningful lesion attributes during image synthesis (e.g., asymmetry, border irregularity, or color heterogeneity) and ( ii ) strong semantic alignment between textual descriptions and synthesized visual features. Kim et al. [ 16 ] incorporated visual conditioning embeddings into the diffusion model to improve conditional synthesis, while LesionGen [ 8 ] introduced concept-guided diffusion using structured dermatological captions to improve attribute-level prompting. Despite these enhancements, diffusion-based lesion generators inherently rely on stochastic denoising and CLIP-based text encoders with limited context capacity. These architectural constraints limit the efficiency and determinism of the generation process. We propose DermaFlux , a rectified flow-based framework for synthetic lesion image generation. Unlike diffusion-based generators that rely on stochastic denoising, rectified flows learn a deterministic transport mapping between noise and data distributions, improving sampling efficiency. Specifically, we fine-tune Flux.1 [ 2 ] via Low-Rank Adaptation (LoRA) [ 14 ] , enabling parameter-efficient adaptation to skin lesion synthesis while preserving the pretrained model’s generative capacity. Flux.1 utilizes a CLIP [ 22 ] and a T5-XXL [ 24 ] text encoder, thus enabling richer contextual conditioning and improved text–image alignment. Beyond architectural considerations, the design of open and well-annotated training datasets containing image–text pairs is equally critical for medical image synthesis. PanDerm [ 32 ] and Derm1M [ 30 ] introduced large-scale datasets containing approximately one million dermatology image–text pairs. However, a substantial proportion of PanDerm comprises in-house data that is not fully accessible to the research community, while Derm1M annotations were automatically extracted mainly from medical videos and online forums, potentially introducing noise. In contrast, we construct an open, curated image–text dataset to train DermaFlux , derived exclusively from publicly available dermatology datasets with human-verified annotations. Textual descriptions are generated using Llama 3.2 [ 11 ] and structured around clinically meaningful skin lesion attributes. Combined with the expressive dual text encoders of Flux.1 , this structured supervision enables finer control over skin lesion characteristics such as asymmetry, border irregularity, and color variation. Overall, our main contributions are: 1. We construct a large-scale dermatology dataset of approximately 500k image-text pairs with structured, attribute-level captions that explicitly encode skin lesion asymmetry, border irregularity, and color variation, enabling fine-grained alignment between clinically meaningful lesion descriptors and corresponding visual features. 2. We develop DermaFlux , a rectified flow–based generative framework for synthesizing diverse and semantically consistent skin lesion images, offering a deterministic alternative to diffusion-based skin lesion generation. 3. We experimentally demonstrate that classifiers trained with DermaFlux -generated synthetic lesions improve binary classification performance by up to 6% when augmenting limited real-world datasets, achieve up to 9% higher accuracy than diffusion-based synthetic augmentation under identical training settings, and outperform existing state-of-the-art classifiers by 8%. 2 Method DermaFlux is a rectified flow–based framework for text-conditioned lesion synthesis (Fig. 1 ). We first present our dataset curation efforts (§ 2.1 ), followed by an outline of the backbone model and the adaptation strategy (§ 2.2 ). Figure 1: DermaFlux synthesizes a skin lesion image x_{1} by transporting Gaussian noise z_{0} to a clean latent representation z_{1} , conditioned on the input caption. The Flux.1 [ 2 ] backbone is frozen ( ) and only the injected LoRA parameters are trained ( ). 2.1 Dataset Creation Table 1: Summary of the aggregated dermatology datasets used for training, reporting imaging modality (clinical , dermoscopic , or both), benign and malignant counts, and training resolution. Dataset Type Benign Malignant Resolution MedNode [ 9 ] 100 70 512\times 512 HIBA [ 13 ] , 802 751 512\times 512 Derm12345 [ 33 ] 11{,}120 1{,}167 512\times 512 ISIC 2019 [ 27 , 4 , 12 ] 15{,}991 9{,}340 512\times 512 ISIC 2020 [ 26 ] 32{,}542 584 512\times 512 Milk10k [ 18 ] , 2{,}966 7{,}514 512\times 512 PAD20 [ 21 ] 1{,}209 1{,}089 512\times 512 Kaggle 1 [ 15 ] 5{,}000 4{,}605 256\times 256 Kaggle 2 [ 19 ] 6{,}289 5{,}590 256\times 256 DDI [ 5 ] 485 171 256\times 256 ISIC 2024 [ 17 ] 400{,}666 393 128\times 128 Dataset collection. We curate a large-scale dermatology image corpus by aggregating publicly available datasets for automated skin lesion analysis, including the International Skin Imaging Collaboration (ISIC) challenge datasets (2019-2024) [ 27 , 4 , 12 , 26 , 18 ] , Derm12345 [ 33 ] and PAD20 [ 21 ] . Training dataset statistics are summarized in Table 1 ; sizes are reported before filtering. The collection spans clinical and dermoscopic imagery, capturing substantial variability in lesion appearance, skin tone, and acquisition conditions, and