Synthetic Data Augmentation for Multi-Task Chinese Porcelain Classification: A Stable Diffusion Approach
Ziyao Ling, Silvia Mirri, Paola Salomoni, Giovanni Delnevo · 2026
Read Synthetic Data Augmentation for Multi-Task Chinese Porcelain Classification: A Stable Diffusion Approach by Ziyao Ling, Silvia Mirri, Paola Salomoni, Giovanni Delnevo (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-14791.txt.
Introduction
Ziyao Ling, Silvia Mirri, Paola Salomoni, and Giovanni Delnevo classify Chinese porcelain with AI in this 2026 paper. The scarcity of training data is a fundamental challenge for deep learning on archaeological artifact classification. Rare types of Chinese porcelain have few photographed examples. The team investigates whether synthetic images can effectively augment limited real datasets.
The synthetic images are generated through Stable Diffusion with Low-Rank Adaptation, or LoRA. They feed a multi-task CNN-based porcelain classification. Multi-task means the network learns several judgments at once, such as type and period. Rare things are hard to teach. A class with ten shots can not train a net the way a class with ten thousand can. Readers get a test of whether AI-made training images can rescue a classifier for rare heritage objects.
Catalog record
| CREATOR | Ziyao Ling, Silvia Mirri, Paola Salomoni, Giovanni Delnevo |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 78 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-14791
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Synthetic Data Augmentation for Multi-Task Chinese Porcelain Classification: A Stable Diffusion Approach Ziyao Ling, Silvia Mirri, Paola Salomoni, Giovanni Delnevo Abstract The scarcity of training data presents a fundamental challenge in applying deep learning to archaeological artifact classification, particularly for the rare types of Chinese porcelain. This study investigates whether synthetic images generated through Stable Diffusion with Low-Rank Adaptation (LoRA) can effectively augment limited real datasets for multi-task CNN-based porcelain classification. Using MobileNetV3 with transfer learning, we conducted controlled experiments comparing models trained on pure real data against those trained on mixed real-synthetic datasets (95:5 and 90:10 ratios) across four classification tasks: dynasty, glaze, kiln and type identification. Results demonstrate task-specific benefits: type classification showed the most substantial improvement (5.5% F1-macro increase with 90:10 ratio), while dynasty and kiln tasks exhibited modest gains (3-4%), suggesting that synthetic augmentation effectiveness depends on the alignment between generated features and task-relevant visual signatures. Our work contributes practical guidelines for deploying generative AI in archaeological research, demonstrating both the potential and limitations of synthetic data when archaeological authenticity must be balanced with data diversity. keywords Chinese porcelain identification; synthetic data augmentation; Stable Diffusion; LoRA; multi-task learning; cultural heritage; archaeological artifacts 1 Introduction Chinese porcelain, as a significant component of cultural heritage, embodies profound historical and artistic value. Contemporary porcelain authentication methods remain predominantly dependent on expert connoisseurship, with modern scientific techniques serving merely as auxiliary tools rather than replacement methodologies Wang 2019 . Consequently, the field of porcelain authentication currently faces two primary challenges: first, the time-consuming nature of manual authentication coupled with the inherent subjectivity of expert judgment; second, the prohibitive costs associated with advanced analytical techniques, some of which, such as thermoluminescence dating may cause irreversible damage to the artifacts Portakal et al. 2024 . Within this context, deep learning has demonstrated substantial potential in augmenting Chinese porcelain authentication, primarily through the deployment of Convolutional Neural Networks (CNNs) for artifact classification based on distinctive features including decorative motifs, morphological forms, and chronological periods Han et al. 2023 . Existing approaches encompass both single-feature classification models, which focus on individual attributes, and multi-task learning frameworks that simultaneously classify multiple characteristics Ling et al. 2025 . These methodological choices are grounded in traditional morphological analysis, which emphasizes the tripartite schema of color, form, and pattern as fundamental diagnostic criteria Ma 2008 . However, the fragility and non-renewable nature of porcelain artifacts as cultural heritage objects presents significant challenges for comprehensive data collection Choy et al. 2016 . Current research in this domain is constrained by limited dataset sizes, Weng et al., selected porcelain of the same shape but from five different ages, with only 10 images from each age, a total of 50 images for training Weng et al. 2017 . Niu et al. collected 5000 images, which represents the largest porcelain dataset reported in the literature to date, yet this remains insufficient compared to successful deep learning applications in other domains, where datasets typically contain tens of thousands to hundreds of thousands of images Niu and Zhang 2022 . Given the high degree of intra-class variability exhibited by porcelain artifacts, where individual pieces may display unique characteristics arising from variations in production techniques, raw materials, and firing conditions, this data scarcity causes limitations, including overfitting and poor generalization to unseen porcelain samples Weng et al. 2017 . Consequently, dataset augmentation represents one of the challenges confronting the application of deep learning to porcelain authentication, necessitating innovative approaches to expand training data while maintaining archaeological authenticity Ottoni and Ottoni 2025 . Beyond the issue of limited dataset size, current mitigation strategies using traditional augmentation techniques, including rotation, flipping, and color jittering, while effective for increasing sample counts, are fundamentally constrained by the original image content Shorten and Khoshgoftaar 2019 . They cannot introduce genuinely new visual variations such as alternative viewing angles, varied lighting conditions that reveal different glaze properties, or morphological variations within a porcelain type. For archaeological artifacts, where each piece represents centuries of material culture and craftsmanship, these limitations are particularly acute. Traditional augmentation merely permutes existing pixels rather than synthesizing new visual information that could capture the rich diversity within each porcelain category. For instance, a single type of Song dynasty celadon bowl might exhibit substantial variations in glaze thickness, crackle patterns, color gradients, and surface textures depending on its specific production batch, kiln position, and firing conditions that cannot be recreated through geometric or photometric transformations alone Ma 2008 . Moreover, the limited number of high-quality porcelain photograph available means that traditional augmentation repeatedly recycles the same visual features, potentially leading to overfitting on porcelain-specific characteristics rather than learning generalizable class-level patterns Ying 2019 . This fundamental limitation has motivated researchers to explore generative approaches that can create entirely new, photorealistic images of archaeological porcelains Altaweel and Khelifi 2024 . Recent advances in deep generative models, particularly Generative Adversarial Networks (GANs) Goodfellow et al. 2020 and diffusion models Ho et al. 2020 , offer significant capabilities to synthesize novel visual content that maintains the authentic characteristics of historical porcelains while introducing controlled variations Wang et al. 2025 . These image generation techniques have demonstrated success in addressing multiple challenges simultaneously: expanding limited datasets, balancing class distributions, and generating diverse intra-class variations Rodriguez-Almeida et al. 2022 . By learning the underlying distribution of visual features from existing specimens, generative models can produce synthetic porcelain images that exhibit plausible variations in glaze colours, decorative patterns, and morphological characteristics Bao et al. 2025 In this research, we investigate the application of diffusion-based synthetic image generation to enhance multi-task CNN classification of Chinese porcelain. Building upon our baseline multi-task MobileNetV3 model trained on real images, we explore whether synthetic data augmentation can improve performance across multiple tasks. Three main contributions of this paper can be highlighted: First, we present a comprehensive comparative analysis demonstrating that models trained on mixed real-synthetic datasets (95:5 and 90:10 ratios) using Stable Diffusion with LoRA achieve consistent improvements over the real-data-only baseline when evaluated on the same held-out test set of authentic porcelain images. Second, we provide task-specific performance analysis across four tasks (dynasty, glaze, and type), revealing differential improvements where type classification benefits most significantly from synthetic augmentation (up to 4% improvement). In contrast, dynasty and kiln tasks show more modest gains, indicating that the effectiveness of synthetic data is task-dependent. Third, we demonstrate the practical viability of structured prompt engineering grounded in archaeological documentation for generating training-quality synthetic porcelain images, showing that carefully designed prompts can produce diverse yet archaeologically plausible variations that enhance model generalization without introducing distribution shift in the test phase. The remainder of this paper is structured as follows. Section 2 outlines the related works while Section 3 details the dataset and the experimental design, including strategies for synthetic dataset creation, various mixing configurations between real and synthetic data, and the evaluation framework used to assess impact across multiple dimensions of performance. Section 4 presents comprehensive results addressing each research question, analyzing synthetic image quality, impact on class imbalance, and the effects of different mixing strategies on model performance and generalization. Section 5 concludes with a summary of key findings, contributions to both computer vision and digital heritage fields, and directions for