Semantic Consistency Regularization with Large Language Models for Semi-supervised Sentiment Analysis
Kunrong Li, Xinyu Liu, Zhen Chen ✉ {}^{\text{{\char 0\relax}}} · 2025
Read Semantic Consistency Regularization with Large Language Models for Semi-supervised Sentiment Analysis by Kunrong Li, Xinyu Liu, Zhen Chen ✉ {}^{\text{{\char 0\relax}}} (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-17598.txt.
Introduction
Kunrong Li and co-authors improve sentiment analysis in 2025 when only a little labeled text is at hand. Labeling large text sets by hand is slow and costly. Their framework uses a large language model to rewrite unlabeled text in two ways: one built around key entities and numbers, the other around the core concept. The rewrites then train a classifier through a consistency rule.
Only samples where the model agrees with confidence are kept as extra training signal. A class re-assembling step makes use of the unsure samples too. Tests showed clear gains over prior semi-supervised methods. The method suits tasks like reading customer feedback where labels are scarce.
Catalog record
| CREATOR | Kunrong Li, Xinyu Liu, Zhen Chen ✉ {}^{\text{{\char 0\relax}}} |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-17598
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Semantic Consistency Regularization with Large Language Models for Semi-supervised Sentiment Analysis Kunrong Li, Xinyu Liu, Zhen Chen ✉ {}^{\text{{\char 0\relax}}} Abstract Accurate sentiment analysis of texts is crucial for a variety of applications, such as understanding customer feedback, monitoring market trends, and detecting public sentiment. However, manually annotating large sentiment corpora for supervised learning is labor-intensive and time-consuming. Therefore, it is essential and effective to develop a semi-supervised method for the sentiment analysis task. Although some methods have been proposed for semi-supervised text classification, they rely on the intrinsic information within the unlabeled data and the learning capability of the NLP model, which lack generalization ability to the sentiment analysis scenario and may prone to overfit. Inspired by the ability of pretrained Large Language Models (LLMs) in following instructions and generating coherent text, we propose a Semantic Consistency Regularization with Large Language Models (SCR) framework for semi-supervised sentiment analysis. We introduce two prompting strategies to semantically enhance unlabeled text using LLMs. The first is Entity-based Enhancement (SCR-EE), which involves extracting entities and numerical information, and querying the LLM to reconstruct the textual information. The second is Concept-based Enhancement (SCR-CE), which directly queries the LLM with the original sentence for semantic reconstruction. Subsequently, the LLM-augmented data is utilized for a consistency loss with confidence thresholding, which preserves high-quality agreement samples to provide additional supervision signals during training. Furthermore, to fully utilize the uncertain unlabeled data samples, we propose a class re-assembling strategy inspired by the class space shrinking theorem. Experiments show our method achieves remarkable performance over prior semi-supervised methods. For example, with 200 labeled data per class, SCR-EE achieves a remarkable performance of 76.13% accuracy, outperforming previous method FixMatch by 3.42%. 1 Introduction One major obstacle in training accurate sentiment analysis models is the lack of large-scale labeled datasets. Manually annotating sentiment corpora is a labor-intensive and time-consuming process, which often requires the domain expertise to capture the subtle distinction of sentiment expression in contexts. This data scarcity has hindered the development of supervised learning models, which typically need abundant labeled data for effective training. To overcome this limitation, semi-supervised learning approaches have emerged as a promising solution. By leveraging a large number of unlabeled data and limited labeled data, semi-supervised methods can potentially learn more generalizable representations and mitigate the reliance on extensive manual annotations of the sentiment data. Semi-supervised learning [ 7 ] have shown notable data efficiency in text classification tasks. They often employ a consistency regularization framework that minimizes the predictions of unlabeled data of different augmentations [ 14 ] . However, the traditional data augmentation techniques in NLP, such as back-translation or simple word replacements, often rely on shallow heuristics or statistical methods that lack a deep understanding of language semantics. While these techniques can introduce some variations in the data, they are insufficent in two aspects: (1) They alter the text at a surface level, potentially introducing noise or inconsistencies that could hinder the model’s ability to learn robust representations. (2) These methods rely solely on the unlabeled data and the learning capability of the model, which may lack the generalization ability required for sentiment analysis and can be prone to overfitting or even performance collapse. Recently, Large Language Models (LLMs) like GPT-3, LLaMA [ 25 ] , PaLM [ 2 ] , and Qwen [ 5 ] have demonstrated very impressive language understanding and generation capabilities, revolutionizing various natural language processing tasks. These LLMs require massive amounts of textual data for training, thus have acquired a deep understanding of language patterns, semantics, and world knowledge. They can not only generate fluent and contextually relevant text but also follow specific instructions and prompts to perform controlled text generation tasks. For example, when prompted with appropriate instructions, the pretrained LLMs can rephrase sentences while preserving the core meaning, adjust the sentiment or tone of a given text, or incorporate specific entities or concepts into the generated output [ 16 ] . Inspired by the capabilities of the LLMs, we are willing to explore their potential in semi-supervised sentiment analysis. Therefore, we propose a S emantic C onsistency R egularization with Large Language Models (SCR) framework that utilizes LLMs to augment unlabeled text data with semantically consistent variations. Specifically, we introduce two approaches for semantic enhancement using LLMs. The first approach is Entity-based Enhancement (SCR-EE), which first prompt the LLM to aware of the keywords and components in the original sentence by extracting entities and numerical information from it, then let the LLM to reconstruct the text based on the extracted key information, which could preserve the core semantics implicitly. The second approach is Concept-based Enhancement (SCR-CE), which directly queries the LLM with the original sentence and instruct the model to generate sentences with semantically consistent variations. Afterwards, we utilize a consistency regularization framework, where a consistency loss with confidence thresholding is employed to selectively incorporate high-quality agreement samples as additional supervision signals during model training. Finally, to further leverage the less-confident data sample, inspired by the class-space shrinking theorem [ 28 ] , we propose a class re-assemble method by removing the confusing sentiment class. By enforcing the consistency between the predictions on the original and semantically enhanced samples, our SCR framework encourages the model to learn robust and generalizable representations. The proposed SCR leverages the power of LLMs of capturing the nuanced sentiment expressions in the social media and customer comment texts, to semantically enhance the unlabeled data. Therefore, more informative and diverse data are generated for effective semi-supervised learning. Our contributions are summarized as below: • We propose a novel Semantic Consistency Regularization with Large Language Models (SCR) framework for semi-supervised sentiment analysis. It leverages the remarkable capabilities of pretrained LLMs to semantically enhance unlabeled data, and use consistency loss for efficient model training. • We introduce two approaches within the SCR framework for semantic data augmentation using LLMs: Entity-based Enhancement (SCR-EE) and Concept-based Enhancement (SCR-CE). SCR-EE extracts entities and numerical information from the text and queries the LLM to reconstruct the textual information while preserving semantics, while SCR-CE directly queries the LLM with the original sentence to generate semantic consistent variations. • We propose a class re-assemble method for sentiment analysis to better leverage the less confident data samples, which further enhances the learning efficiency for unlabeled data. • We conduct comprehensive experiments on two sentiment analysis datasets, our SCR achieves the state-of-the-art performance on varied labeling regimes, and surpasses previous methods remarkably. 2 Related Work 2.1 Semi-supervised Learning SSL aims to leverage a limited set of annotated samples along with a large collection of unlabeled data. The most representative method is Pseudo-labeling [ 11 ] which uses a model trained on the labeled data to predict pseudo-labels for the unlabeled data, and use the pseudo-labels for supervision. However, utilizing hard pseudo-labels individually can potentially cause the confirmation biases of the model [ 3 , 13 ] , which may affect the model capability or even performance collapse. To mitigate this issue, researchers have demonstrated the advantages of employing consistency regularization approaches [ 23 , 1 , 21 , 24 ] . Specifically, these methods enforce the model to make consistent predictions under different perturbations, which can be applied on input level