DiffuSent: Towards a Unified Diffusion Framework for Aspect-Based Sentiment Analysis

Shu Long, Yanglei Gan, Xuchuan Zhou · 2026

Read DiffuSent: Towards a Unified Diffusion Framework for Aspect-Based Sentiment Analysis by Shu Long, Yanglei Gan, Xuchuan Zhou (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-01323.txt.

Introduction

Long, Gan, and Zhou unify aspect-based sentiment analysis with diffusion. The field holds seven subtasks on distinct extracted elements. Unified generative tools build answers token by token. That style blurs the edges of multi-word terms. Aspect and opinion spans lose their sharp boundaries. DiffuSent treats each subtask as boundary denoising instead. Noisy span edges get refined step by step.

A contrastive denoising strategy handles near-duplicate outputs. Diffusion can spawn many subtle variants of one answer. Tests span 28 settings, from seven subtasks on four datasets. DiffuSent beats top generative and span-based systems throughout. Gains peak on multi-word triplets, at plus 2 point 48 F1. Inference runs up to 181 times faster than autoregressive rivals.

Catalog record

CREATORShu Long, Yanglei Gan, Xuchuan Zhou
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.01323

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

DiffuSent: Towards a Unified Diffusion Framework for Aspect-Based Sentiment Analysis Shu Long, Yanglei Gan, Xuchuan Zhou Abstract Aspect-Based Sentiment Analysis (ABSA) encompasses seven distinct subtasks, each focusing on different extracted elements. Despite the proven success of generative models in unified aspect sentiment analysis, existing approaches often rely on auto-regressive token-by-token generation without grasping the whole information of the aspect and opinion terms, resulting in boundary insensitivity, particularly in context of multi-word aspect and opinion terms. To address these issues, we present DiffuSent, a non-auto-regressive diffusion framework that systematically formulates all ABSA subtasks as boundary denoising diffusion processes, progressively refining boundaries over noisy states. Furthermore, we introduce a contrastive denoising training strategy which effectively address duplicate predictions with subtle variations introduced by diffusion process. Extensive experiments across 28 settings (7 subtasks × \times 4 datasets) demonstrate that DiffuSent achieves delivers consistent improvements over the strongest generative and span-based systems. DiffuSent exhibits notable gains on multi-word triplets, achieving an average improvement of +2.48 F1, and maintains robust extraction accuracy in sentences containing multiple sentiment triplets. Moreover, the non-auto-regressive decoding enables substantial efficiency benefits, reaching up to 181 × \times faster inference than auto-regressive generative baselines 1 1 1 The source code is anonymous online at: https://anonymous.4open.science/r/DiffuSent . 1 Introduction Aspect-based Sentiment Analysis (ABSA) stands as a fine-grained branch of sentiment analysis that shifts the focus from coarse document- or sentence-level sentiment to sentiment expressed toward specific entities [ 28 ] . An ABSA instance is typically composed of three essential elements: an aspect term ( a ), an opinion term ( o ), and a sentiment polarity ( s ). To illustrate, consider the review sentence from Res 15 shown in Figure 1 , " New hamburger with special sauce is ok – at least better than big mac ". The phrases " New hamburger with special sauce " and " big mac " function as aspect terms, while " ok " and " better than " act as opinions linked to positive/negative sentiment polarities, respectively. Figure 1: Illustration of seven ABSA subtasks Conventional approaches to ABSA have focused on distinct components such as aspect/opinion term extraction [ 23 , 43 ] , sentiment classification for a given aspect [ 32 , 20 ] , or aspect sentiment triplet extraction [ 25 , 42 , 44 ] . While these developments have led to successes in individual subtasks, a unified ABSA framework remains an elusive goal. To bridge this gap, recent research has been shifting towards unified approaches within a pipeline framework [ 24 , 6 ] . However, such paradigms often suffer from error accumulation due to their modular approaches [ 7 ] . Addressing these drawbacks, there is a growing inclination towards employing generative models in ABSA. This shift signifies a move to an end-to-end autoregressive formulation, broadening the scope to include techniques such as word index generation [ 38 ] , label augmented text generation [ 41 ] , and template filling [ 9 , 10 ] . Despite their effectiveness, auto-regressive generative models suffer from two critical drawbacks: • Boundary Ambiguity and Integrity Failure in Multi-Word Extraction. The step-wise, token-focused mechanism of auto-regressive decoding fundamentally compromises the integrity of multi-word aspect and opinion terms. Since the model generates output sequentially, conditioning each token primarily on immediate history [ 1 , 44 ] , it restricts the capacity to capture the holistic context necessary for complete multi-word expressions. This often results in boundary ambiguity, where the decoder prematurely truncates a descriptive phrase, such as truncating " new hamburger with special sauce " to just " hamburger ". This limitation is especially acute for long, syntactically complex, or highly descriptive aspect terms. • Computational Bottleneck Due to Sequential Decoding. The inherent requirement for strictly sequential token generation in auto-regressive models imposes a significant computational inefficiency. The decoding process enforces strict temporal dependencies, which fundamentally precludes parallel computation across the sequence length. Consequently, the inference latency scales linearly with the length of the target structured output [ 7 , 35 ] . This computational cost becomes prohibitive when generating lengthy, structured outputs like multiple aspect–opinion pairs. Ultimately, this bottleneck limits the scalability of generative ABSA systems in real-world applications. To bridge this gap, we propose DiffuSent, a novel unified generative diffusion framework tailored for ABSA. Distinct from traditional token-by-token generation paradigm, DiffuSent is designed to explicitly model boundary indices, and dynamically refines its interpretations based on comprehensive contextual information. Through a non-auto-regressive boundary denoising diffusion process, it delivers predictions for boundary indices in a single step. Specifically, we systematically infuse uncertainty via Gaussian noise into the aspect/opinion term boundaries using a forward diffusion process. The subsequent reverse diffusion process then meticulously refines these term boundaries from their initially indeterminate states. Additionally, we introduce a contrastive denoising training strategy designed to differentiate between accurate and inaccurate boundary predictions. It adeptly manages the duplicate predictions with subtle variations in boundary detection, particularly in distinguishing semantically similar terms such as " hamburger ", " new hamburger ", and " new hamburger with special sauce ". We validate DiffuSent on four benchmarks for seven subtasks and DiffuSent yields state-of-the-art performance. Our contributions are three-fold: • We propose DiffuSent, a unified diffusion-based framework that formulate all ABSA subtasks as boundary denoising diffusion process. • A novel contrastive denoising training strategy is introduced. This strategy is designed to address duplicate predictions with subtle variations in predicted boundary indices introduced by diffusion process. • Extensive experiments are conducted on 28 subtasks (7 \times 4 datasets) to evaluate the effectiveness of our approach. Experimental results demonstrate that our model outperforms the state-of-the-art methods. 2 Related Work Aspect-Based Sentiment Analysis (ABSA) encompasses a suite of interrelated subtasks, each focusing on specific components or their combinations within a text as illustrated in Figure 1 . Previous studies mainly focus on individual subtasks [ 31 , 34 ] , including Aspect Term Extraction (AE), Opinion Term Extraction (OE), Aspect-level Sentiment Classification (ALSC). Subsequent research shifted towards integrated models that simultaneously extract aspects, opinions, and their corresponding sentiments [ 5 , 8 , 12 ] , such as Aspect-oriented Opinion Extraction (AOE), Aspect-Opinion Pair Extraction (AOPE) and Aspect Extraction and Sentiment Classification (AESC). Marking a significant shift in the field, Peng et al. [ 26 ] introduced the Aspect Sentiment Triplet Extraction (ASTE) task, pioneering a unified approach for extracting aspect, opinion, and sentiment triplets. This approach led to the development of advanced techniques in ABSA, such as table filling [ 13 , 42 ] , sequence tagging [ 37 , 44 ] , and span-based methods [ 2 , 19 ] . However, these methods only focus on individual tasks. Recent trends in Aspect-Based Sentiment Analysis (ABSA) have seen the emergence of unified methods, such as two-step MRC approach [ 24 ] . However, this method suffers from error accumulation due to isolated processing. In response, a shift towards end-to-end generative methods has occurred, addressing all ABSA subtasks more effectively. These include approaches like word index generation [ 38 ] , label augmented text generation [ 41 ] , and template filling [ 9 , 10 , 44 ] . However, a notable limitation of these generative models is their reliance on

Read the complete text