Document-Level Sentiment Analysis of Urdu Text Using Deep Learning Techniques

A Irum, M Ali Tahir, S Latif · 2025

Read Document-Level Sentiment Analysis of Urdu Text Using Deep Learning Techniques by A Irum, M Ali Tahir, S Latif (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-17175.txt.

Introduction

Ammarah Irum and Ali Tahir test in 2025 deep learning methods that judge the mood of full Urdu documents. Urdu has few digital resources, and long texts mix many views, which makes whole-document mood calls hard. The team tried five known network designs on Urdu movie reviews and on a customer support set.

Their own hybrid design, which pairs a two-way memory network with a multi-filter convolutional layer, beat all the baselines. It reached accuracies in the high seventies to mid nineties across the sets, with the top score on the support data. The work shows deep methods can serve a language with scarce training material.

Catalog record

CREATORA Irum, M Ali Tahir, S Latif
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-17175

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Document-Level Sentiment Analysis of Urdu Text Using Deep Learning Techniques A Irum, M Ali Tahir, S Latif Abstract Document level Urdu Sentiment Analysis (SA) is a challenging Natural Language Processing (NLP) task as it deals with large documents in a resource-poor language. In large documents, there are ample amounts of words that exhibit different viewpoints. Deep learning (DL) models comprise of complex neural network architectures that have the ability to learn diverse features of the data to classify various sentiments. Besides audio, image and video classification; DL algorithms are now extensively used in text-based classification problems. To explore the powerful DL techniques for Urdu SA, we have applied five different DL architectures namely, Bidirectional Long Short Term Memory (BiLSTM), Convolutional Neural Network (CNN), Convolutional Neural Network with Bidirectional Long Short Term Memory (CNN-BiLSTM), Bidirectional Encoder Representation from Transformer (BERT). In this paper, we have proposed a DL hybrid model that integrates BiLSTM with Single Layer Multi Filter Convolutional Neural Network (BiLSTM-SLMFCNN). The proposed and baseline techniques are applied on Urdu Customer Support data set and IMDB Urdu movie review data set by using pretrained Urdu word embeddings that are suitable for (SA) at the document level. Results of these techniques are evaluated and our proposed model outperforms all other DL techniques for Urdu SA. BiLSTM-SLMFCNN outperformed the baseline DL models and achieved 83%, 79%, 83% and 94% accuracy on small, medium and large sized IMDB Urdu movie review data set and Urdu Customer Support data set respectively. [type=editor, ] [orcid=0000-0002-2335-2776 ] keywords Low-resource language,Deep Learning,Sentiment Analysis,Natural Language Processing,Opinion Mining,Text Processing. † † titlenote: This work is not sponsored/supported by any organization. † † credit: Methodology, Data curation, Writing - Original draft preparation, Visualization † † credit: Formal analysis, Supervision, Writing – review & editing, Project administration, Validation † † credit: Review & editing, Validation 1 Introduction With the tremendous increase in the availability of textual data in recent years, wide interest of the research community has been seen in different new and relatively more demanding areas in the field of Natural Language Processing (NLP). One such active research area of NLP is Sentiment Analysis (SA). SA tends to analyze a wide range of opinions regarding various subjects that are expressed by humans on different platforms. The objective of SA is to identify the sentiment and assign it a label in accordance with the particular subject Liu 2012 . SA has gained massive attention recently as sentiment is considered the key component in maintaining the reputation of organizations associated directly with public. English language has gained much attention for global-level research since the birth of NLP. In the last two decades, wide-scale research regarding each aspect of NLP has mostly been conducted in English language as it is computationally inexpensive to conduct experimentation in a resource-rich language. As compared to resource-rich languages, morphologically rich yet resource-scarce languages like Urdu, Arabic, Turkish, Hindi and Persian, etc. have been least utilized by researchers for NLP tasks as it is hard to cater word-level complex morphological structure of such languages Abdul-Mageed and Korayem 2010 . The unique characters, complex morphology, and scarcity of linguistic resources of Urdu language have played a vital role in limited research regarding Urdu SA Daud et al. 2017 . Most of the traditional work done in Urdu SA domain is based on Machine Learning (ML) models. ML models do not achieve the best results on large data sets and tend to learn only directed text features. The significant challenge regarding ML models is the selection of efficient features from the high-dimensional feature space [4]. Among the numerous feature selection methods available, there is no single method that works well with all types of ML classifiers Zia et al. 2015 . The performance of Deep Learning (DL) models have improved on a large scale with a considerable amount of data compared to traditional ML models Mathew et al. 2021 . Moreover, DL models have the ability to learn complex features directly from high-dimensional feature space and they are faster than ML models because in DL models, parallel processing of data is done by using Graphic Processing Units (GPUs) Khan et al. 2019 . Unfortunately, the potential of DL models has not yet been explored in the field of Urdu SA. In the last few years, DL models have proved to show the best results, particularly in the domain of sentiment analysis. Among these models, Convolutional Neural Network (CNN) and Recurrent Neural Network (RNN) have been widely implemented as CNN responds very well to the problem of dimensionality reduction and a type of RNN, the BiLSTM network, handles sequential data with success Goularas and Kamis 2019 . In this study, we present a hybrid Bidirectional Long Short Term Memory with Single Layer Multifilter Convolutional Neural Network (BiLSTM-SLMFCNN) that combines BiLSTM and multifilter CNN architecture to classify sentiments in Urdu documents. The major advantage of integrating BiLSTM and CNN is to utilize the potential of BiLSTM that fully understands the meanings of individual words in the context from both directions and the capability of the multifilter CNN architecture to extract local features in high-dimensional feature space. Moreover, CNN ignores the contextual meaning of words in text-based classification, hence, BiLSTM is integrated to improve the accuracy of the hybrid model for Urdu sentiment classification. The proposed scheme takes advantage of sequential text processing and extraction of global features simultaneously. The novelty of our proposed technique lies in the use of SLMFCNN layer as it contains multiple filters of different sizes which are applied to extract variable length features, i.e. n-grams from text documents. 1.1 URDU AND ITS ATTRIBUTES: Urdu is the national language of Pakistan and it is world-wide notable language with 300 million speakers all across the globe Riaz 2012 . It is 21 st most spoken language in the world. It has a character set of 38 characters shown in Figure 1. Along with the complex morphological structure, it has the following distinctive features that make it a challenging language for computational tasks Syed et al. 2011b : • It is a mixture of different languages and has a lot of loan words from languages like Turkish, Arabic, Persian, Sanskrit, and even English. It has significant influence from other languages. • It has morphological variations, i.e., many words have a common root word. • Urdu has Nastalique writing style as shown in Figure 1. Nastalique writing style is complex in its nature. Figure 1 : Alphabets and Diacritics of Urdu Language in Nastalique Font Style • Urdu script is context-sensitive. Context-sensitivity outcomes in problems related to word segmentation as the space between complete words does not always indicate word boundaries. Such words can be misidentified. • There is no concept of capitalization in Urdu language. Hence, due to this feature, beginning of the sentence and proper nouns cannot be easily identified Akhter et al. 2022 . • In Urdu, case markers are considered as parts of speech. Case markers are lexically independent units, hence they determine the sentence structure, resulting into grammar related ambiguities. • Use of diacritics also change the meaning of words having same spelling or pronunciation Akhter et al. 2020 . 1.2 CATEGORIZATION OF SENTIMENT ANALYSIS LEVELS: SA

Read the complete text