DS 2 -ABSA: Dual-Stream Data Synthesis with Label Refinement for Few-Shot Aspect-Based Sentiment Analysis
Hongling Xu, Yice Zhang, Qianlong Wang, Ruifeng Xu · 2024
Read DS 2 -ABSA: Dual-Stream Data Synthesis with Label Refinement for Few-Shot Aspect-Based Sentiment Analysis by Hongling Xu, Yice Zhang, Qianlong Wang, Ruifeng Xu (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-14849.txt.
Introduction
Hongling Xu, Yice Zhang, Qianlong Wang, and Ruifeng Xu build a data synthesis framework for few-shot aspect-based sentiment analysis, in a paper from twenty twenty-four. Large language models can generate training samples where data is scarce. Earlier augmentation methods modified existing samples and lacked diversity. In-context learning approaches suffered labels that strayed from task requirements.
Their dual-stream framework synthesizes data from two complementary directions. One stream is key-point-driven; the other works from instances. Together they produce diverse, high-quality sentiment samples in low-resource settings. A label refinement module then cleans up the synthetic labels. Extensive experiments show the method beating previous few-shot solutions. It also outperforms other language-model data generation methods tested. The work targets sentiment tasks where annotated examples are few.
Catalog record
| CREATOR | Hongling Xu, Yice Zhang, Qianlong Wang, Ruifeng Xu |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-14849
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DS 2 -ABSA: Dual-Stream Data Synthesis with Label Refinement for Few-Shot Aspect-Based Sentiment Analysis Hongling Xu, Yice Zhang, Qianlong Wang, Ruifeng Xu Abstract Recently developed large language models (LLMs) have presented promising new avenues to address data scarcity in low-resource scenarios. In few-shot aspect-based sentiment analysis (ABSA), previous efforts have explored data augmentation techniques, which prompt LLMs to generate new samples by modifying existing ones. However, these methods fail to produce adequately diverse data, impairing their effectiveness. Besides, some studies apply in-context learning for ABSA by using specific instructions and a few selected examples as prompts. Though promising, LLMs often yield labels that deviate from task requirements. To overcome these limitations, we propose DS 2 -ABSA, a dual-stream data synthesis framework targeted for few-shot ABSA. It leverages LLMs to synthesize data from two complementary perspectives: key-point-driven and instance-driven , which effectively generate diverse and high-quality ABSA samples in low-resource settings. Furthermore, a label refinement module is integrated to improve the synthetic labels. Extensive experiments demonstrate that DS 2 -ABSA significantly outperforms previous few-shot ABSA solutions and other LLM-oriented data generation methods. 1 1 1 Our code and synthetic data are available publicly at https://github.com/behappyplz/DS2-ABSA 1 Introduction Aspect-based sentiment analysis (ABSA) aims to identify aspect terms and determine their sentiments within user reviews Pontiki et al. (2014) . For example, given the review “ the battery life is great, but the screen resolution is disappointing ,” the output of End-to-End ABSA (E2E-ABSA) would be {( battery life , positive), ( screen resolution , negative)}. Previous studies have proposed various deep learning methods Fei et al. (2022) ; Tian et al. (2023a) ; Scaria et al. (2024) , demonstrating strong performance when trained on extensive manually labeled data. However, annotating sufficient data is extremely time-consuming and labor-intensive in practice, prompting researchers to explore ABSA approaches in low-resource scenarios Varia et al. (2023) ; Wang et al. (2023b) ; Wang et al. (2024d) ; Zhang et al. (2024) . Existing low-resource solutions comprise three main types. The first, data augmentation , produces additional samples by modifying existing ones, which are typically implemented through masked language modeling Li et al. (2020) ; Zhou et al. (2022) or requiring large language models (LLMs) Dai et al. (2023) ; Peng et al. (2024) . Although these methods can yield a large number of new samples, the diversity of them remains limited, thereby providing marginal benefit for subsequent model training. The second type, in-context learning , aligns LLMs with the ABSA task through task-specific instructions and a few examples Zhang et al. (2024) ; Wang et al. (2024c) ; Wang et al. (2024d) . However, even with well-crafted instructions and carefully chosen demonstrations, LLMs tend to deviate from task-specific requirements, frequently generating reasonable, yet incorrect results. Apart from these two types, some researchers explore pre-training techniques Wang et al. (2023b) ; Zhang et al. (2023) to reduce reliance on downstream datasets. Nonetheless, these techniques require vast additional corpora and incur high training costs. Inspired by the recent advances in data synthesis Li et al. (2023) ; Wang et al. (2023a) , we propose DS 2 -ABSA , a dual-stream data synthesis framework for few-shot ABSA. Unlike existing methods, our study employs multi-granularity-guided synthesis targeted to E2E-ABSA. Specifically, we first leverage LLMs to generate data via two distinct strategies: key-point-driven and instance-driven . The former engages LLMs to brainstorm a variety of potential ABSA attributes, which are then composed to create new samples. The latter transforms existing samples through operations including sample combination and selective reconstruction. These two strategies are complementary: the former synthesizes data that covers a broader range of review scenarios and offers greater diversity, while the latter generates data based on existing samples and provides better relevance and quality. Moreover, we integrate a label refinement module to enhance the quality of labels in the synthetic data. This module applies a label normalization process alongside a noisy self-training algorithm that employs a few gold samples to guide the re-estimation of the synthetic labels. Compared to previous methods, our approach offers the following advantages. Firstly, by leveraging key-point-driven and instance-driven strategies, it can generate more diverse data than data augmentation methods, providing greater potential benefits for subsequent model training. Secondly, in contrast to in-context learning methods, our approach introduces a novel way of utilizing LLMs, resulting in better task-specific alignment. The label refinement module further enhances this advantage. Thirdly, unlike pre-training methods, our approach requires no additional corpus, entailing significantly lower training costs and avoiding the potential challenges of data acquisition. Our contributions are summarized as follows: (1) We propose a dual-stream synthesis framework that leverages LLMs to generate ABSA samples from two distinct perspectives. To the best of our knowledge, this is the first exploration of data synthesis for E2E-ABSA. (2) We develop a label refinement module that effectively enhances the label quality of the synthesized data through label normalization and noisy self-training. (3) Experimental results on four public datasets demonstrate that DS 2 -ABSA significantly outperforms existing low-resource ABSA solutions, as well as other LLM-based data augmentation and synthesis methods. Figure 1: Overview of the proposed DS 2 -ABSA. The process begins with parallel dual-stream data synthesis: the key-point-driven stream leverages LLMs to brainstorm a set of critical ABSA attributes for conditional generation, while the instance-driven stream applies a small seed dataset to perform multi-level transformations. The resulting data are then combined and processed through normalization and self-training for noise handling. 2 Related Work 2.1 Few-shot ABSA Current state-of-the-art E2E-ABSA methods primarily rely on fine-tuning text-to-text language models Zhang et al. (2021) ; Yu et al. (2023) ; Scaria et al. (2024) or incorporating syntactic knowledge Fei et al. (2022) ; Tian et al. (2023b) ; Liu et al. (2024) using sufficient labeled data. However, annotating fine-grained sentiments in adequate reviews is expensive. To mitigate data dependency, early methods mainly adopt data augmentation Wei and Zou (2019) ; Li et al. (2020) ; Ding et al. (2020) ; Hsu et al. (2021) ; Zhou et al. (2022) and pre-training Xu et al. (2019) ; Zhou et al. (2020) ; Liu et al. (2023) ; Wang et al. (2023b) ; Zhang et al. (2023) . Recently, the advent of powerful LLMs has inspired new approaches for few-shot ABSA, including (1) LLM-based data augmentation Dai et al. (2023) ; Peng et al. (2024) , which often lacks diversity in low-resource settings; (2) in-context learning Wang et al. (2024d) ; Zhang et al. (2024) ; Wang et al. (2024c) ; Wang et al. (2024b) ; Zhu et al. (2024) , where LLMs often fail to produce task-aligned outputs; and (3) knowledge distillation Zhou et al. (2024) , which similarly requires substantial extra review corpora like pre-training, posing challenges in domains with limited data availability and privacy concerns. To tackle these issues, we propose a novel approach that utilizes LLMs to synthesize samples with rich diversity and high quality, whose labels are then refined to facilitate downstream training. 2.2 Data Synthesis Data synthesis is a pivotal strategy to address challenges like high annotation costs and privacy issues Long et al. (2024) . With the advent of LLMs, it has been applied to various fields, such as text classification Ye