Boosting Meta-Learning for Few-Shot Text Classification via Label-guided Distance Scaling

Yunlong Gao, Xinyue Liu, Yingbo Wang, Linlin Zong, Bo Xu · 2026

Read Boosting Meta-Learning for Few-Shot Text Classification via Label-guided Distance Scaling by Yunlong Gao, Xinyue Liu, Yingbo Wang, Linlin Zong, Bo Xu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-02267.txt.

Introduction

Yunlong Gao, Xinyue Liu, Yingbo Wang, and colleagues help text classifiers learn from few examples in this 2026 paper. Few-shot sorting must label new classes from a handful of labeled texts. Training tricks abound, but test examples are picked at random and may mislead. A badly placed example can drag a new text toward the wrong class.

Their fix uses label words as guides in both training and testing. A training loss pulls each text's code toward its label's code. At test time, a scaler shifts codes using label meaning as well. Shifted examples land closer to their true class centers. Paired with two standard learners, the method beat prior best models by clear margins across many tests.

Catalog record

CREATORYunlong Gao, Xinyue Liu, Yingbo Wang, Linlin Zong, Bo Xu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46966
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.02267

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Boosting Meta-Learning for Few-Shot Text Classification via Label-guided Distance Scaling Yunlong Gao, Xinyue Liu, Yingbo Wang, Linlin Zong, Bo Xu Abstract Few-shot text classification aims to recognize unseen classes with limited labeled text samples. Existing approaches focus on boosting meta-learners by developing complex algorithms in the training stage. However, the labeled samples are randomly selected during the testing stage, so they may not provide effective supervision signals, leading to misclassification. To address this issue, we propose a L abel-guided D istance S caling (LDS) strategy. The core of our method is exploiting label semantics as supervision signals in both the training and testing stages. Specifically, in the training stage, we design a label-guided loss to inject label semantic information, pulling closer the sample representations and corresponding label representations. In the testing stage, we propose a Label-guided Scaler which scales sample representations with label semantics to provide additional supervision signals. Thus, even if labeled sample representations are far from class centers, our Label-guided Scaler pulls them closer to their class centers, thereby mitigating the misclassification. We combine two common meta-learners to verify the effectiveness of the method. Extensive experimental results demonstrate that our approach significantly outperforms state-of-the-art models. 1 Introduction Text classification has been widely applied to various real applications, such as intent detection ( 12 ) , news classification ( 6 ) , and so on. However, a deficiency of supervised data is often experienced in many real-world scenarios, thereby promoting the emergence of few-shot text classification ( 43 ; 33 ) , which aims to detect unseen classes with limited labeled text samples by using knowledge learned from seen classes. Figure 1: Illustration of the problem in the testing stage, the feature space classification diagram of Prototypical Networks and the proposed LDS-PN. Picture (a) shows that, due to the support sample of class blue is at the boundary of class distribution, and Q_{1} is misclassified as class orange because it is closest to the support sample of class orange . Picture (b) shows LDS-PN pulls support samples closer to the center of the corresponding classes by leveraging their label semantics (names), so Q_{1} is classified class blue correctly. Existing methods primarily follow the meta-learning paradigm and focus on learning sample representations to distinguish different classes, and widely combine Prototypical Networks (PN) ( 37 ) , facilitating the classification of query samples by measuring their distances to support samples . DE ( 29 ) and MEDA ( 38 ) leverage data augmentation to expand the number of support samples. ContrastNet ( 8 ) introduces a multistage contrastive loss to reduce the distance between samples of the same class and increase the distance between samples of different classes, thereby creating more distinguishable sample representations. TART ( 26 ) transforms the class prototypes to per-class fixed reference points in task-adaptive metric spaces, making class prototypes distinguishable. Although previous works have achieved certain improvements over PN, there is still a limitation in the testing stage. Specifically, the support samples are randomly selected in the testing phase, so they may not provide effective supervision signals for label prediction. As shown in Fig. 1 (a), in the representation space, if the support sample of the class blue is at the boundary of the distribution of class blue , the query sample Q_{1} will be misclassified as class orange because it is closest to the support sample of class orange . It is worth noting that, existing methods only concentrate on designing powerful models at the training stage, but they neglect this problem in the testing stage. Even though they obtain high-quality representations, they may encounter misclassification caused by the randomly selected support samples in the testing stage. Tackling this misclassification problem requires additional information (e.g., label semantics) in the testing stage. To achieve this, the additional information and samples need to have a correlation, and a guider is needed to exploit the additional information for the classification. However, this solution may face some challenges. Firstly, due to the setting of meta-learning, the guider only can influence support samples in the training stage. Hence, the additional information also needs to be injected through a specific training objective, influencing both support and query samples. Secondly, in the testing stage, a trained guider only can project the support sample representations into another representation space, causing a different distribution for support samples and query samples. Besides, due to the scarcity of support samples, training a guider will trap in overfitting. Consequently, the guider should be a non-parametric method. We propose to leverage label semantics to tackle the above problem and present a L abel-guided D istance S caling (LDS) strategy. We first utilize prompt learning to establish the correlation between samples and label semantics. Then, we design a label-guided loss to inject the label semantics in the training stage, which pulls closer to the sample representations and corresponding label representations. After injecting label semantics into samples and establishing their correlation, we develop a guider in the testing stage to fully exploit the label semantics for the classification. Specifically, we propose a Label-guided Scaler, which scales support sample representations with label semantics, pulling support sample representations further closer to the class centers. Thus, even if labeled samples are far from class centers, our Label-guided Scaler pulls them closer to their class centers, thereby mitigating the misclassification, as shown in Fig. 1 (b). To summarize, our work makes the following contributions: (1) We point out the misclassification caused by the randomly selected support samples and present it should be solved in the testing stage with the additional information. (2) We propose a L abel-guided D istance S caling (LDS) strategy including a label-guided loss and a Label-guided Scaler, making the class distributions more distinguishable. (3) We conduct extensive experiments and results show that our approach significantly outperforms state-of-the-art models. Particularly, it achieves an average improvements of 9.4% and 10.1% in 5-way 1-shot and 10&15-way 1-shot tasks. (4) Our proposed LDS strategy not only boosts the performance of PN (metric-based method) but also could be used to boost other meta-learners, like RRML ( 3 ) for few-shot text classification tasks. 2 Related Work 2.1 Meta-learning Based Methods Meta-learning has achieved remarkable success in few-shot learning ( 21 ; 41 ; 28 ) , and it can be divided into two categories: (1) Optimization-based methods : These methods aim to find an optimal initialization parameter that can adapt to few-shot training examples, such as MAML ( 14 ) and Reptile ( 1 ) . (2) Metric-based methods : These methods focus on learning a metric to measure similarities between samples and classes, including Prototypical Networks ( 37 ) , Relation Networks ( 39 ) and so on. Existing methods mainly fall into the Metric-based method, and focus on getting the distinguishable class distributions through training, like ContrastNet ( 8 ) , SPCNet ( 7 ) , or learning expanding the support samples, like MEDA ( 38 ) , DE ( 29 ) and RPOTAUG ( 12 ) . The key idea of our approach is leveraging label semantics to guide sample representations closer to the class centers in the testing stage, thereby reducing prediction inconsistencies caused by randomly selected support samples. 2.2 Transfer

Read the complete text