An Aspect Extraction Framework using Different Embedding Types, Learning Models, and Dependency Structure

Ali Erkan, Tunga Güngör · 2025

Read An Aspect Extraction Framework using Different Embedding Types, Learning Models, and Dependency Structure by Ali Erkan, Tunga Güngör (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-03512.txt.

Introduction

Ali Erkan and Tunga Gungor wrote a 2025 paper on pulling aspect words out of text. Aspect based sentiment work reads how people feel about single traits of a thing, such as the screen of a phone. The first step is to find those trait words in each sentence.

Their framework mixes several word code types and several learning models. A new position code, built from the grammar tree of each sentence, helps mark where an aspect sits. The team also built a fresh Turkish data set by machine translation of an English one under tight control. On two Turkish sets, their models beat most past work, and the tree code raised scores further.

Catalog record

CREATORAli Erkan, Tunga Güngör
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-03512

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

An Aspect Extraction Framework using Different Embedding Types, Learning Models, and Dependency Structure Ali Erkan, Tunga Güngör Abstract Aspect-based sentiment analysis has gained significant attention in recent years due to its ability to provide fine-grained insights for sentiment expressions related to specific features of entities. An important component of aspect-based sentiment analysis is aspect extraction, which involves identifying and extracting aspect terms from text. Effective aspect extraction serves as the foundation for accurate sentiment analysis at the aspect level. In this paper, we propose aspect extraction models that use different types of embeddings for words and part-of-speech tags and that combine several learning models. We also propose tree positional encoding that is based on dependency parsing output to capture better the aspect positions in sentences. In addition, a new aspect extraction dataset is built for Turkish by machine translating an English dataset in a controlled setting. The experiments conducted on two Turkish datasets showed that the proposed models mostly outperform the studies that use the same datasets, and incorporating tree positional encoding increases the performance of the models. August 24, 2026 Introduction Aspect-based sentiment analysis (ABSA) is a subfield of natural language processing (NLP) that aims to identify the sentiment expressed towards specific aspects or features of a product, service, or entity. The task involves analyzing the text to identify the various aspects or attributes being discussed and determining the sentiment expressed towards each aspect. ABSA is an essential area of research as it has many practical applications in industries such as e-commerce, social media monitoring, and customer service. ABSA is a rapidly evolving field with new techniques and approaches being proposed regularly. As businesses continue to place increasing importance on customer feedback and sentiment analysis, ABSA is likely to play an increasingly important role in the e-commerce and customer service industries. ABSA is a featured subfield of sentiment analysis that has received significant attention in recent years [ 1 , 2 ] . Traditional sentiment analysis focuses on determining the overall polarity of a piece of text, classifying it as positive, negative, or neutral. However, in many real-world scenarios, this global sentiment classification does not provide a comprehensive view of the different kinds of opinions expressed in the text. ABSA addresses this limitation by offering a more granular approach to sentiment analysis. Instead of treating the entire text as a single unit, ABSA aims to analyze sentiments concerning specific aspects or features of the discussed entities. Aspects can refer to particular attributes, components, or elements associated with entities such as products, services, or experiences. In a product review, for instance, ABSA enables us to observe the sentiments expressed about individual features of the product, such as its design, performance, battery life, and customer service. This fine-grained analysis provides companies and researchers with more detailed information and reflects the nuanced nature of human opinions. Table 1 shows some examples of customer restaurant reviews and the aspects of the reviews. Table 1: Examples of Turkish customer restaurant reviews and aspects in the reviews. Review Turkish (English) Aspects gördüğüm en güzel dekorasyonlu simit sarayı diyebilirim. (I can say that it is Simit Palace with the most beautiful decoration I have ever seen.) dekorasyonlu (decoration) lokumu tavsiye ederim. (I recommend Turkish delight.) lokumu (Turkish delight) kahvaltı tabağının 12.5 tl den 18.5 ye çıkması gerçekten çok komik. (It’s really funny that the breakfast plate goes from 12.5 TL to 18.5 TL.) kahvaltı tabağının (breakfast plate) tüm hardallı balığı denedim ardından elmalı yeşil çay ikisi de enfesti. (I tried all the fish with mustard and then the green tea with apple, both were delicious.) hardallı balığı (fish with mustard) elmalı yeşil çay (green tea with apple) The fundamental challenge in ABSA lies in accurate aspect extraction, which aims to identify and extract the aspect terms present in the text. This step forms the basis for subsequent sentiment analysis, as sentiments are linked to specific aspects. The extraction of aspects involves identifying keywords, phrases, or syntactic patterns that refer to the aspects under consideration. In this paper, we focus on aspect extraction, which is a pivotal task in understanding the fine-grained nuances of sentiments. Using the synergy of cutting-edge techniques, we propose a comprehensive model that integrates BERT (Bidirectional Encoder Representations from Transformers) [ 3 ] , BiLSTM (Bidirectional Long Short-Term Memory) [ 4 ] , CRF (Conditional Random Fields) [ 5 ] , tree positional encoding (TPE), and different types of embeddings for enhanced aspect extraction. By integrating different types of models, we aim to handle the different requirements in aspect extraction. BERT, renowned for its contextualized word representations, allows the model to capture intricate semantic relationships within the text. BiLSTM, with its ability to model long-term dependencies, addresses the hierarchical and sequential nature of aspects, which is essential for accurate extraction. Incorporating CRF as a final layer augments the model’s performance by considering the sequential dependencies between the terms and thus imposing constraints between adjacent aspect predictions. Furthermore, exploring pre-trained word embeddings and tree positional encoding in conjunction with the neural network architecture enhances the model’s sensitivity to linguistic subtleties, contributing to a more nuanced understanding of aspects. The motivation for this research stems from the recognition that existing ABSA models, while successful to varying degrees, often face challenges in handling the complexity of real-world textual data. By combining state-of-the-art techniques, our approach seeks to push the boundaries of aspect extraction precision and contribute to a more nuanced understanding of sentiments in textual information. The main contributions in this paper are as follows: • We develop a novel tree positional encoding model that is based on dependency parse trees. • We combine different types of learning algorithms (BERT, BiLSTM, and CRF) that contribute to different aspects of the task. As input to the models, we use word and part-of-speech (POS) embeddings and tree positional encodings. • We obtain state-of-the-art results for extracting aspects from Turkish review datasets. • We release and make publicly available 1 1 1 https://github.com/alierkan/Turkish-ABSA a new aspect-based sentiment analysis dataset for Turkish. It can serve as a benchmark dataset for Turkish ABSA studies. We also share our Python codes. The rest of the paper is organized as follows: Section 1 briefly reviews the literature on aspect extraction. Section 2 presents the datasets used in this work and the processes involved in translating the English reviews dataset into Turkish. Section 3 explains in detail the proposed models, the input schema used in the models, and the evaluation metrics. Section 4 describes the experimental settings and presents the results. Finally, Section 5 concludes the paper. 1 Literature Review In recent years, there has been a significant amount of research in aspect-based sentiment analysis and several different approaches and methods have been proposed. In this section, we review some of the key works and developments in this domain. Early ABSA studies employed rule-based methods for aspect extraction. Various techniques and resources, such as pattern matching, syntactic parsing, and domain-specific lexicons, were used. Hu and Liu [ 6 ] proposed a method for identifying the sentiment of product reviews based on the presence of specific keywords and phrases. They introduced a rule-based approach using POS tagging and dependency parsing to extract aspects from reviews.

Read the complete text