Shallow Deep Learning Can Still Excel in Fine-Grained Few-Shot Learning
Chaofei Qi, Chao Ye, Zhitai Liu, Weiyang Lin, Jianbin Qiu · 2025
Read Shallow Deep Learning Can Still Excel in Fine-Grained Few-Shot Learning by Chaofei Qi, Chao Ye, Zhitai Liu, Weiyang Lin, Jianbin Qiu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-22041.txt.
Introduction
Chaofei Qi and co-authors present a computer vision paper, published in 2025, defending shallow networks for the delicate task of telling similar classes apart from a few examples. Fine-grained few-shot learning asks a model to separate near identical categories, such as bird species, after seeing only a handful. Deep backbones dominate the field, while a classic shallow network was dismissed for grabbing too many surface details.
The authors revisit a four layer convolutional network and add a location aware clustering module that fuses spatial features and hunts for hidden discriminative spots. Extra encoding tricks restore position information that ordinary layers lose. On three standard fine-grained benchmarks the shallow design matched or beat deep rivals, a reminder that depth is not the only route to sharp vision.
Catalog record
| CREATOR | Chaofei Qi, Chao Ye, Zhitai Liu, Weiyang Lin, Jianbin Qiu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-22041
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Shallow Deep Learning Can Still Excel in Fine-Grained Few-Shot Learning Chaofei Qi, Chao Ye, Zhitai Liu, Weiyang Lin, Jianbin Qiu Abstract Deep learning has witnessed the extensive utilization across a wide spectrum of domains, including fine-grained few-shot learning (FGFSL) which heavily depends on deep backbones. Nonetheless, shallower deep backbones such as ConvNet-4, are not commonly preferred because they’re prone to extract a larger quantity of non-abstract visual attributes. In this paper, we initially re-evaluate the relationship between network depth and the ability to fully encode few-shot instances, and delve into whether shallow deep architecture could effectuate comparable or superior performance to mainstream deep backbone. Fueled by the inspiration from vanilla ConvNet-4, we introduce a location-aware constellation network (LCN-4), equipped with a cutting-edge location-aware feature clustering module. This module can proficiently encoder and integrate spatial feature fusion, feature clustering, and recessive feature location, thereby significantly minimizing the overall loss. Specifically, we innovatively put forward a general grid position encoding compensation to effectively address the issue of positional information missing during the feature extraction process of specific ordinary convolutions. Additionally, we further propose a general frequency domain location embedding technique to offset for the location loss in clustering features. We have carried out validation procedures on three representative fine-grained few-shot benchmarks. Relevant experiments have established that LCN-4 notably outperforms the ConvNet-4 based State-of-the-Arts and achieves performance that is on par with or superior to most ResNet12 based methods, confirming the correctness of our conjecture. Our codes are at: https://github.com/ChaofeiQI/LCN-4. Introduction In extremely difficult situations where data is in short supply, fine-grained few-shot learning (FGFSL) has gained an enormous advantage from the power of deep learning, which can extract features with remarkable efficiency. Within the realm of general few-shot learning (FSL), the ResNet ( He et al. 2016 ) and WRN ( Zagoruyko and Komodakis 2016 ) series are well-established as favored options for deep feature extraction. Meta-learning ( Vettoruzzo et al. 2023 ) remains the crucial approach for addressing the challenges posed by limited few-shot datasets, particularly when leveraging deep backbone architectures. Even though shallow deep learning extracts features that are less sophisticated compared to attributes extracted by deep backbone networks, it is crucial to re-evaluate its efficacy in addressing few-shot problems. Shallow deep learning primarily engages with more straightforward features but is vulnerable to enhanced noise interference. Combining the strengths of various deep frameworks may mitigate relevant drawbacks of shallow deep learning. Here, we individually present several few-shot frameworks. Figure 1: Accuracy comparison of our proposed LCN-4 with several representative ConvNet-4-based and ResNet-12-based milestone networks on CUB-200-2011. In addition, C.Net represents ConstellationNet. Obviously, our shallow deep acrchtecture LCN-4 can still achieve superior accuracy among SoTA methods. Multimodal learning algorithms ( Tang et al. 2024 ; Zhang et al. 2024 ; Christopher et al. 2024 ) yield remarkable results in coarse-grained scenarios. However, their limited capacity to discern fine-grained attributes leads to poor performance in FGFSL. Convolutional Neural Networks (CNNs) ( Krizhevsky et al. 2012 ) boast a multitude of advantages, so they remain one of the widely adopted meta-learning architectures with few-shot scenarios. Currently, the main research directions within the scope of architecture focus on data augmentation ( Wang et al. 2020 ) , parameter optimization ( Oh et al. 2021 ) , similarity meta-metric ( Xie et al. 2022 ) , and feature reconstruction ( Wu et al. 2023 ) . The most commonly employed meta-learning backbone is ResNet-12 ( He et al. 2016 ) , renowned for its robust feature extraction capabilities capable of capturing abstract features. In comparison, shallow meta-learning backbone ConvNet-4 lacks the ability to extract numerous abstract features, making it less preferable for few-shot related tasks. Graph neural networks (GNNs) ( Li et al. 2015 ) are particularly adept at processing the graph-structured attributes, effectively leveraging the inter-node connections to formulate models that capture latent intricate dependencies and interactions inherent within features. It can facilitate GNN methods to represent and integrate more knowledge and patterns across domains through graph-based construction, thereby capturing richer contextual information and structural features within the instances. In the domains of FSL and FGFSL, these GNN-based methods often ultilize ResNet12 as backbone for feature extraction and take graph networks as classifiers. Such dominance empowers GNNs to enhance network generalization in few-shot scenarios by harnessing the knowledge gleaned from other domains. Current mainstream research directions encompass Knowledge Transfers ( Chen et al. 2019 ) and Attention Mechanisms ( Satorras and Bruna 2018 ; Ling et al. 2020 ; Cheng et al. 2023 ) . Furthermore,Vision Transformers ( Liu et al. 2021 ) can leverage a self-attention mechanism to handle entire sequences concurrently at relevant position, enabling them to capture both the global and long-term dependencies within instances. In FGFSL, high instance similarity makes it hard for the patch-/token- based approaches to capture class-specific attributes. Thus, transformer-based methods often take ResNet12 as basic feature extracter and then use transformer to explore features potential. Generally, the mainstream research directions are categorized into two following groups: General Representation ( Wang et al. 2023 ) and Transformer Embedding ( He et al. 2022 ; Li et al. 2023 ) . For FGFSL, the integration of CNNs for local region feature extraction and Transformers for global feature structuring signifies an extremely alluring and prospective research avenue. For instance, ConstellationNet ( Xu et al. 2021 ) harnesses CNNs to extract local feature maps and perform feature clustering, and utilizes a transformer to enhance spatial attribute representations. Although this research is meaningful, but it did fail to consider actual loss of location information in feature extraction and clustering. Moreover, the high similarity of high-order features in fine-grained tasks raises few-shot task complexity. Therefore, we attempt to address FGFSL using the innovative shallow deep learning strategy. In this paper, we try to evaluate and alleviate the constraints of the current methodology by upgrading ConvNet-4. Moreover, we substantiate the preeminence of our architecture in fine-grained settings, illustrating that shallow deep learning can achieve remarkable performance in the realm of FGFSL. Our main contributions to FGFSL are outlined as follows: • Introducing first shallow deep meta-learning paradigm: Location-aware Constellation Network (LCN-4), which can surpass most deep meta-learning SoTA algorithms. • Introducing a plug-and-play location-aware feature clustering module, which can significantly make up for the shortcomings of constell module in ConstellationNet. • Proposing a general grid position encoding compensation method to effectively address positional information missing in ordinary convolution-extracted feature maps. • Proposing a general frequency domain location embedding method for location compensation in clustering features, providing effective input for attention mechanism. • Demonstrating that shallow deep learning can also excel in FGFSL by incorporating suitable location compensation. To be precise, we’ve introduced a significant effective solution for fine-grained few-shot image recognition. Figure 2: Illustration of our LCN-4 which consists of four primary modules: two base Stem modules and two Constellation modules. Stem module includes a conv layer and a particular LAFCM module (without FDC), and Constellation module contains a conv layer and a Constell submodule. Constell consists of a complete LAFCM, a cross-attention positional embedding block, and a channel-level feature fusion block. Related Works Fine-Grained Few-Shot Image Classification Compared with coarse-grained situations, fine-grained few-shot task encounters a tougher challenge, which requires enhanced detail