FGDCC: Fine-Grained Deep Cluster Categorization - A Framework for Intra-Class Variability Problems in Plant Classification

Luciano Araújo Dourado Filho, Rodrigo Tripodi Calumby · 2025

Read FGDCC: Fine-Grained Deep Cluster Categorization - A Framework for Intra-Class Variability Problems in Plant Classification by Luciano Araújo Dourado Filho, Rodrigo Tripodi Calumby (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-19960.txt.

Introduction

Luciano Araujo Dourado Filho and Rodrigo Tripodi Calumby attack a quiet saboteur of plant image classification: members of one species can look wildly different from each other. High within-class variability, worse when classes are also rare, undermines fine-grained visual categorization. Their framework, FGDCC, responds by finding structure inside each class before classifying across classes.

Clustering is applied class by class, and the resulting cluster assignments become pseudo-labels encoding degrees of similarity among images. A hierarchical classifier then learns from those finer distinctions, picking up subtle features that separate look-alike groups. Early experiments on the PlantNet-300K dataset still reached state-of-the-art performance even with components admittedly unoptimized, and the authors map which pieces need development before the evidence is conclusive.

Catalog record

CREATORLuciano Araújo Dourado Filho, Rodrigo Tripodi Calumby
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-19960

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

FGDCC: Fine-Grained Deep Cluster Categorization - A Framework for Intra-Class Variability Problems in Plant Classification Luciano Araújo Dourado Filho, Rodrigo Tripodi Calumby Abstract Intra-class variability is given according to the significance in the degree of dissimilarity between images within a class. In that sense, depending on its intensity, intra-class variability can hinder the learning process for DL models, specially when such classes are also underrepresented, which is a very common scenario in Fine-Grained Visual Categorization (FGVC) tasks. This paper proposes a novel method that aims at leveraging classification performance in FGVC tasks by learning fine-grained features via classification of class-wise cluster assignments. Our goal is to apply clustering over each class individually, which can allow to discover pseudo-labels that encodes a latent degree of similarity between images. In turn, those labels can be employed in a hierarchical classification process that allows to learn more fine-grained visual features and thereby mitigating intra-class variability issues. Initial experiments over the PlantNet300k enabled to shed light upon several key points in which future work will have to be developed in order to find more conclusive evidence regarding the effectiveness of our method. Our method still achieves state-of-the-art performance on the PlantNet300k dataset even though some of its components haven’t been shown to be fully optimized. Our code is available at https://github.com/ADAM-UEFS/FGDCC . I Introduction Learning visual characteristics from high intra-class variability data can be a challenging task for Deep Learning (DL) models, especially when the datasets have long-tailed distributions. Problems like these are oftenly associated to Fine-Grained Visual Categorization (FGVC) [ 3 ] . In contrast to Coarse-Grained Visual Categorization (CGVC), in FGVC, the goal is to discriminate between distinct classes from the same category (e.g., dog breeds, plant diseases, car brands, bird species, etc). FGVC is inherently challenging because in order to discriminate between similar objects (i.e., inter-class similarity) the models have to account for the minor details in the images, which sometimes can be even harder considering lower resolutions. Another classical example of a challenging FGVC task is plant species recognition. Many plant organisms from different species share common structures (e.g., leaves, flowers, stem, etc), which makes feature overlap between different species very common. Despite inter-class similarity, often times there is also the presence of many underrepresented categories leading to long-tailed distributions and therefore, generalization issues. Besides that, plants are intrinsically prone to intra-class variability as well [ 10 ] . That is because plant individuals commonly suffer the action of predators, diseases, influence of climatic factors, aging, seasonality, etc., all of which can affect its structure and modify their visual appearance. Because of that, visual dissimilarity between morphological characteristics of specimens from the same species is somewhat expected. In such scenarios, a model can fail to account for common patterns present in the data, which may prevent it from learning a generalizable representation. Besides that, many cases of plant species recognition involve multi-organ classification scenarios, in which the dataset classes are composed by images of different views – different organs (i.e., leaves, flowers, fruits) with very distinct morphological features from each other. Figure 1 : Example of intra-class variability for the species Smilax aspera L. Recent works have demonstrated that combining supervised and unsupervised approaches could be helpful in leveraging classification performance in Deep Neural Networks (DNN’s) and minimizing the impact of the variability in the learning process [ 10 , 6 ] . In the work of [ 10 ] , for example, the authors proposed a framework that combines supervised and unsupervised learning to address intra-class variability in plant species recognition tasks. Their idea consists of individually clustering the images that composes each species into subgroups that will replace the pre-existing classes. Through that, the method is capable of redefining the original classes configuration into a new setting of labels that is expected to be composed by more homogeneous samples and therefore to ease the learning process. Despite that, in the authors framework, clustering and feature extraction are performed as sequential steps of different processes, which fails to leverage the advantages of Deep Neural Networks (DNN) in terms of learning capabilities. On the other hand, in [ 6 ] , the authors propose a similar clustering framework but as an end-to-end approach for self-supervised pre-training of DNN’s on non-curated data. However, the authors framework was applied in a Self-Supervised Learning (SSL) context, with a primitive Convolutional Neural Network (CNN) architecture. Besides that, the framework operates by clustering reduced-dimensionality features which fails to explore information that non-linear relationships between the latent variables learned by the CNN model could provide. Following the same line of work employed by the authors of [ 10 , 6 ] , we aim at combining these methods into a reformulated framework in the context of FGVC/intra-class variability mitigation. We reformulate the problem of self-supervised learning of visual features, as posed in the Deeper Cluster framework from [ 6 ] , to propose a new method for leveraging FGVC, based on the method of [ 10 ] . Our method consists of a semi-supervised approach for learning fine-grained image features. We propose an end-to-end framework that integrates K-Means clustering, dimensionality reduction and hierarchical classification to leverage Fine-Grained Visual Categorization. Differently from [ 6 ] , we perform K-Means on every class, allowing the model to discover new class labels conditioned upon the supervised labels originally provided by a dataset. In turn, we then use these labels in a hierarchical classification process, in which the classification model is trained to predict both the parent (species) and subclass labels (K-means cluster assignments). The goal behind this work is to investigate whether the fine-grained features that we enforce a model to develop by training it to predict cluster assignments can be reused by the parent classifier to predict the target labels and improve the classification process as a whole. In order to do this, we conduct our experiments on the Pl@antNet300K dataset, which is a large-scale dataset for plant species identification, primarily used in fine-grained visual categorization (FGVC) tasks [ 11 ] . The dataset includes images of plants taken from different viewpoints and parts (e.g., leaves, flowers, fruits), which increases the intra-class variability and complexity of the task – specially considering the class imbalance –, making it an ideal candidate for testing the robustness of our approach. Our findings indicates that despite sharing the same backbone, features discovered in each classification level seem to be independent. Under this assumption, our findings suggests that because of this, parent classifiers can’t benefit from information learned in lower levels in the hierarchy. Despite that, the method was still capable of matching the state-of-the-art performance on the dataset. The remainder of this paper is organized as follows. Section 2 presents the related work and the core concepts that support this work. Section 3 provides a detailed description of the CNN architectures considered. Section 4 addresses the experimental evaluation process as well as the evaluation protocol and measures. In Sections 5 and 6 we present and discuss the results and conclusions, respectively II Related Work II-A Intra-Class Variability and Deep Clustering Intra-class variability is a challenging adversity, that’s mainly because when its images are way too dissimilar between themselves, a model can fail

Read the complete text