Efficient Aspect Term Extraction using Spiking Neural Network Conference: ; ; CCS: Computing methodologies Information extraction CCS: Spiking Neural Networks Neuromorphic computing CCS: Information systems Data mining
Abhishek Kumar Mishra, Arya Somasundaram, Anup Das, Nagarajan Kandasamy · 2026
Read Efficient Aspect Term Extraction using Spiking Neural Network Conference: ; ; CCS: Computing methodologies Information extraction CCS: Spiking Neural Networks Neuromorphic computing CCS: Information systems Data mining by Abhishek Kumar Mishra, Arya Somasundaram, Anup Das, Nagarajan Kandasamy (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-06637.txt.
Introduction
Abhishek Mishra and co-authors extract aspect terms with spiking neural networks in 2026. Aspect Term Extraction identifies aspect terms in review sentences automatically. It is a key subtask of sentiment analysis, they note.
Most existing approaches use energy-intensive deep neural networks for the task. They treat extraction as sequence labeling over the review text. This paper proposes a more energy-efficient alternative using spiking networks. Spiking networks fire sparsely, closer to how real neurons signal. That sparsity is where their energy savings come from in principle. The work tests whether accuracy survives the switch to spikes. Green AI readers get evidence on neuromorphic methods for language tasks. Sentiment pipelines could run cheaper if such results hold broadly.
Catalog record
| CREATOR | Abhishek Kumar Mishra, Arya Somasundaram, Anup Das, Nagarajan Kandasamy |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-06637
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Efficient Aspect Term Extraction using Spiking Neural Network Conference: ; ; CCS: Computing methodologies Information extraction CCS: Spiking Neural Networks Neuromorphic computing CCS: Information systems Data mining Abhishek Kumar Mishra, Arya Somasundaram, Anup Das, Nagarajan Kandasamy Abstract . Aspect Term Extraction (ATE) identifies aspect terms in review sentences, a key subtask of sentiment analysis. While most existing approaches use energy-intensive deep neural networks (DNNs) for ATE as sequence labeling, this paper proposes a more energy-efficient alternative using Spiking Neural Networks (SNNs). Using sparse activations and event-driven inferences, SNNs capture temporal dependencies between words, making them suitable for ATE. The proposed architecture, SpikeATE, employs ternary spiking neurons and direct spike training fine-tuned with pseudo-gradients. Evaluated on four benchmark SemEval datasets, SpikeATE achieves performance comparable to state-of-the-art DNNs with significantly lower energy consumption. This highlights the use of SNNs as a practical and sustainable choice for ATE tasks. 1. Introduction Aspect term extraction (ATE) is an essential subtask of aspect-based sentiment analysis (ABSA) that aims to identify specific aspects terms within a review in which users have expressed their opinions (Fig. 1 ). Detecting and understanding these terms in user-generated content is vital for numerous applications. For example, analyzing customer sentiment from reviews on e-commerce web platforms can offer insights to improve products, brands, and services, and improve marketing strategies for businesses and organizations. Given the vast amount of online content, manually identifying aspect information is impractical. Therefore, an automated ATE system is needed to pinpoint opinions associated with specific aspects within unstructured text. This fine-grained analysis is central to ABSA, as it enables accurate representations of user sentiment and preferences ( 54 ; 82 ) . Over the past two decades, ATE has become a well-studied problem within natural language processing, particularly for recommendation systems and information retrieval. Beyond simply identifying product or domain characteristics, ATE supports related tasks such as aspect co-occurrence analysis, domain profiling, and aspect summarization ( 83 ) . With advances in deep learning, recent approaches treat ATE as a sequence labeling or token classification task, leading to the development of large and complex neural network models designed to capture fine-grained details in text ( 37 ; 77 ; 78 ; 79 ; 45 ; 10 ; 40 ) . Figure 1 . Review sentences illustrate the ATE task where aspect terms are highlighted in purple. Deep neural network (DNN) models have proven highly effective in sequence labeling tasks due to their ability to learn directly from raw data and their strong generalization capabilities. However, as DNNs grow in size and complexity to achieve better performance, they require substantial computational resources for training and inference, raising concerns about environmental sustainability. This limitation becomes particularly challenging when DNNs are deployed on devices with limited energy resources, where high energy consumption can be prohibitive ( 38 ; 5 ; 42 ; 41 ; 50 ; 43 ; 49 ; 3 ) . An alternative solution worth exploring is the use of Spiking Neural Networks ( SNNs ) which are designed using the operational principles of biological neurons where communication between neurons occurs via short impulses or spikes transmitted through synapses. These spiking neurons can be arranged in feedforward layers or in recurrent topologies ( 20 ) . This brain-inspired approach to computing holds considerable promise for spatial and temporal pattern recognition tasks ( 38 ; 8 ; 76 ; 49 ; 47 ; 46 ; 48 ; 41 ; 85 ) . SNNs process information through discrete spikes, which are well-suited to handle high-dimensional spatial patterns. This sparse processing approach also reduces noise and enables the network to capture subtle details and variations within patterns. When paired with neuromorphic hardware ( 13 ; 6 ; 41 ; 44 ; 28 ) , SNNs can achieve improved accuracy with extreme computational efficiency, making them a compelling option for sustainable AI solutions. By developing energy-efficient SNN models for ATE, this work contributes to a more sustainable infrastructure for web-based NLP tasks. ATE, as part of sentiment analysis, is crucial for analyzing web content such as reviews, blogs, and social networks. Low-power SNN models reduce the resource demand for these tasks, which, at scale, lessens the web’s environmental footprint and aligns with the growing demand for sustainable technology practices. Therefore, the SNN-based approach for ATE aims to advance Natural Language Processing (NLP) in an energy-conscious direction while enriching the Web by supporting accessible, scalable, and environmentally sustainable web infrastructure. Although SNNs provide a more sustainable alternative, their adoption and performance in certain tasks still trail behind those of DNNs. This paper presents the first application of SNNs for ATE task and demonstrates that a well-trained SNN can achieve performance comparable to current DNN-based SOTA solutions. To address the unique challenges associated with SNNs—extreme sparsity, non-differentiable operators, reliance on approximate gradients, and single-bit activations—we propose a novel architecture designed to support effective training and convergence. Our approach includes specialized input encoding, innovative network design with two-bit activations, and tailored training strategies that together address these challenges. The contributions of this work are the following. • We develop an SNN-based approach for ATE that advances NLP in an energy-conscious direction and enriches the Web by supporting accessible, scalable, and environmentally sustainable infrastructure. • We develop SpikeATE, a domain-specific SNN for accurate recognition of aspect terms. The sparse spiking mechanism of the network and simplified calculations result in notable computational efficiency. • We develop a convolutional spike encoding layer that transforms token-based embeddings into spike representations while preserving the spatial and temporal dependencies in the original embeddings. Backpropagation is also customized to support training within SNN. • We develop a ternary spiking neuron model that outputs values of \{-1,0,1\} instead of the traditional \{0,1\} , to serve as the fundamental processing unit within the SNN. Doing so significantly increases the neuron’s information capacity. It also improves the model’s control over the influence of each type of spike on the membrane potential, preventing excessive activation, and maintaining stability by balancing excitatory and inhibitory signals. SpikeATE’s performance in terms of token-classification accuracy is evaluated on the Semantic Evaluation benchmark dataset ( 56 ; 57 ; 58 ) . The results show that it achieves competitive performance compared to DNNs while achieving significant computational efficiency, as estimated through a widely-used power consumption model. SpikeATE achieves a reduction in power consumption of up to 41x over traditional DNN models. The SpikeATE code repository and the dataset used to obtain these results are available publicly at https://github.com/abhishekkumarm98/SpikeATE . This paper is structured as follows. Section 2 discusses related work on aspect-term extraction. Section 3 provides an overview of sequence labeling and the foundational concepts of SNNs, including training methods for these networks. Section 4 describes the proposed ternary spiking neuron model, and Section 5 develops the SpikeATE architecture. Section 6 describes the experimental setup and key results, and Section 7 concludes the paper. 2. Related Work Aspect term extraction has been well studied over the past two decades. Early approaches relied on predefined rules, hand-crafted features, or prior knowledge to address ATE ( 60 ; 36 ) . With advances in deep learning, neural network methods such as LSTM, CNN, and BERT have become dominant, allowing richer feature representations for