ICPR 2024 Competition on Domain Adaptation and GEneralization for Character Classification (DAGECC)

Sofia Marino, Jennifer Vandoni, Emanuel Aldea, Ichraq Lemghari, Sylvie Le Hégarat-Mascle, Frédéric Jurie · 2024

Read ICPR 2024 Competition on Domain Adaptation and GEneralization for Character Classification (DAGECC) by Sofia Marino, Jennifer Vandoni, Emanuel Aldea, Ichraq Lemghari, Sylvie Le Hégarat-Mascle, Frédéric Jurie (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-17984.txt.

Introduction

Sofia Marino and co-authors report a 2024 competition on reading characters across shifting domains in a 2024 paper. A classifier trained on one style of characters often fails on another. The DAGECC contest, held at a pattern recognition conference, asked entrants to adapt and generalize anyway. This companion paper sets the scene.

The authors describe the tasks they proposed and the data prepared for them: a high-quality, lightweight, real-world set built for fast prototyping. Results are summarized for the field. The top three winning entries get detailed write-ups, so others can learn their tricks. The stated aim is to spark interest and progress on domain adaptation and generalization. Character classification serves as the test bed, small enough to iterate quickly, real enough to matter. The organizers offer the set as shared ground for future work.

Catalog record

CREATORSofia Marino, Jennifer Vandoni, Emanuel Aldea, Ichraq Lemghari, Sylvie Le Hégarat-Mascle, Frédéric Jurie
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-17984

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

ICPR 2024 Competition on Domain Adaptation and GEneralization for Character Classification (DAGECC) Sofia Marino, Jennifer Vandoni, Emanuel Aldea, Ichraq Lemghari, Sylvie Le Hégarat-Mascle, Frédéric Jurie Abstract In this companion paper for the DAGECC (Domain Adaptation and GEneralization for Character Classification) competition organized within the frame of the ICPR 2024 conference, we present the general context of the tasks we proposed to the community, we introduce the data that were prepared for the competition and we provide a summary of the results along with a description of the top three winning entries. The competition was centered around domain adaptation and generalization, and our core aim is to foster interest and facilitate advancement on these topics by providing a high-quality, lightweight, real world dataset able to support fast prototyping and validation of novel ideas. 1 Introduction In the rapidly evolving field of computer vision, the ability to develop robust and accurate models that can perform well across diverse scenarios is of paramount importance. Two critical concepts that have emerged as cornerstones in achieving this objective are domain adaptation and domain generalization. Domain adaptation is a transfer learning technique that aims to improve the performance of models in a target domain by leveraging knowledge from a different but related source domain. This approach is crucial because traditional machine learning models often struggle to generalize well when the data distribution changes between the training (source) and testing (target) domains. In real-world applications, such as autonomous driving [ 24 ] [ 31 ] [ 17 ] , surveillance systems [ 14 ] [ 5 ] [ 18 ] or industrial quality control [ 20 ] [ 27 ] [ 30 ] , this shift in data distribution is a common occurrence due to factors like varying weather conditions, lighting, or camera angles. Domain adaptation, therefore, plays a vital role in enhancing the model’s resilience and adaptability to these changes, ensuring consistent performance and reliability. On the other hand, domain generalization is a technique that seeks to develop models that can generalize well to any unseen target domain, without requiring access to any target domain data during training. This is a more challenging task than domain adaptation, as it requires the model to learn a universal representation that can capture the underlying data structure across multiple domains. The importance of domain generalization lies in its potential to create models that can truly adapt to any new environment, making them highly valuable for real-world applications where the target domain may be unknown or constantly changing [ 4 ] [ 19 ] [ 3 ] [ 13 ] . The importance of datasets in the context of domain adaptation and domain generalization cannot be overstated. Diverse and representative datasets are crucial for training models that can effectively learn and adapt to different domains. For domain adaptation, the availability of well-labeled source and labeled or unlabeled target domain datasets is essential, as it allows the model to learn the underlying data distributions and map the knowledge from the source to the target domain. On the other hand, domain generalization typically relies on multi-domain datasets, where the model is trained on data from several different but related domains. This exposure to a variety of data distributions during training helps the model to learn a more universal representation, enabling it to generalize better to unseen target domains. Moreover, the quality and diversity of datasets can significantly influence the performance of these techniques, making the curation and selection of appropriate datasets a critical aspect of their success. Thus, the development and availability of comprehensive and diverse datasets are vital for advancing research and applications in domain adaptation and domain generalization. The competition on Domain Adaptation and GEneralization for Character Classification (DAGECC) aims to foster advancements in domain adaptation and domain generalization techniques by introducing a novel dataset comprising real images of digits and characters captured from serial numbers on manufactured objects. In particular, we focus on an image classification task for industrial serial number recognition. In industrial environments, serial part numbers play a critical role in ensuring traceability and streamlining the management of diverse components (e.g., preventive maintenance, analytics, etc.). However, the manual process of reading and recording these serial numbers is both labor-intensive and prone to errors. As a result, the development of an automated serial number recognition system that can work seamlessly across multiple parts holds tremendous potential for improving operational efficiency in industrial environments. To address this challenge, we are introducing Safran-MNIST, a brand new dataset suite that comprises images of serial numbers extracted from diverse avionic parts manufactured by Safran, an international high-technology group and world leader operating in the aviation (propulsion, equipment and interiors), defense and space markets. The content resembles that of the well-known MNIST dataset of handwritten digits [ 16 ] , hence the name, but with a focus on industrial contexts. The Safran-MNIST dataset suite offers a realistic representation of industrial serial number images, encompassing variations in lighting conditions, orientations, writing styles and surface textures. Thus, it represents a good compromise between 1) requiring a low computational cost for processing, in line with other MNIST variants [ 16 ] [ 10 ] , and 2) being highly relevant for real-world applications. 2 Competition overview The competition encompasses two primary tasks: (i) Domain Generalization and (ii) Unsupervised Domain Adaptation. The central objective of this competition is to investigate and foster progress in domain adaptation and domain generalization methodologies, specifically in the context of character recognition. 2.1 Datasets DAGECC competition is based on the brand new Safran-MNIST dataset suite, specially crafted for the application of character recognition. Characters have been extracted from larger images of Safran’s avionic parts acquired from aircraft engines returned from flights, that have to be periodically inspected for predictive maintenance and security reasons. They correspond to product references or serial numbers engraved on metal parts with various techniques which are widely used for traceability (laser, pencil, or micro percussion engraving). The Safran-MNIST dataset suite comprises two datasets, namely Safran-MNIST-D 1 1 1 https://zenodo.org/records/13320997 [ 28 ] and Safran-MNIST-DLS 2 2 2 https://zenodo.org/records/11093441 [ 21 ] , which are used in the two tasks respectively. Specifically: Dataset for Task 1 - Domain Generalization : Target data for this task consists of real-world Safran-MNIST-D dataset containing RGB images of size 128\times 192 pixels representing digits ranging from 0 to 9. Each image in this dataset belongs to a distinct class. We annotated 1684 images for testing and 421 images for validation. Figure 1 shows the class distribution for each set. Since target data is not to be used in this task, the validation and testing datasets and associated ground-truth are released at the end of the competition. Sample examples from this dataset are shown in Figure 3(a) . Figure 1 : Distribution of class samples in Safran-MNIST-D by sets. Dataset for Task 2 - Unsupervised Domain Adaptation : Target data for this task consists of real-world Safran-MNIST-DLS dataset containing variable size 3 3 3 from 18\times 30 pixels to 86\times 79 pixels gray-scale images of 32 characters. Specifically, this dataset includes 10 digits ranging from 0 to 9, 20 letters (A, B, C, D, E, F, G, H, J, K, L, M, N, P,

Read the complete text