Sentiment Analysis of Mobile Legends App Reviews Using Machine Learning and LSTM-Based Deep Learning Models
Vira Putri Maharani, Kharisa Harvanny, Daris Samudra, Luluk Muthoharoh, M.S, Ardika Satria, M.Si, Martin Clinton Tosima Manullang, Ph.D · 2026
Read Sentiment Analysis of Mobile Legends App Reviews Using Machine Learning and LSTM-Based Deep Learning Models by Vira Putri Maharani, Kharisa Harvanny, Daris Samudra, Luluk Muthoharoh, M.S, Ardika Satria, M.Si, Martin Clinton Tosima Manullang, Ph.D (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-01317.txt.
Introduction
Vira Putri Maharani and five co-authors compare older machine learning tools with a deep learning model on reviews of the Mobile Legends game app. Their data set holds 10,000 reviews, each tagged as positive, negative, or neutral in tone.
The older tools use word counts and an automated model search, while the deep model, an LSTM, reads each review as a sequence so word order counts. The LSTM wins, reaching about 92 percent correct labels and a strong score across all three tone classes. The authors argue that deep learning copes better with the slang and loose, context-based wording that players use in app reviews.
Catalog record
| CREATOR | Vira Putri Maharani, Kharisa Harvanny, Daris Samudra, Luluk Muthoharoh, M.S, Ardika Satria, M.Si, Martin Clinton Tosima Manullang, Ph.D |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.01317
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Sentiment Analysis of Mobile Legends App Reviews Using Machine Learning and LSTM-Based Deep Learning Models Vira Putri Maharani, Kharisa Harvanny, Daris Samudra, Luluk Muthoharoh, M.S, Ardika Satria, M.Si, Martin Clinton Tosima Manullang, Ph.D Abstract Mobile game reviews often contain informal language, slang, abbreviations, and mixed-language expressions, making sentiment classification a challenging task. This study compares Machine Learning (ML) models and Deep Learning (DL) using Long Short-Term Memory (LSTM) for sentiment analysis on Mobile Legends app reviews. The dataset consists of 10,000 user reviews categorized into positive, negative, and neutral sentiments. The ML approach uses TF-IDF and PyCaret AutoML to evaluate multiple models, while the DL approach uses an LSTM architecture to capture sequential dependencies. The results show that LSTM achieves an accuracy of 92 and a weighted F1-score of 91, outperforming traditional ML models. These findings highlight the effectiveness of deep learning in handling sequential text data. Source code is publicly available at https://github.com/Viramhrani/pba2026-Kelompok16 Keywords: Sentiment Analysis; LSTM; Machine Learning; NLP; Text Classification 1 Introduction The global mobile gaming industry has experienced rapid growth over the past decade, with Southeast Asia emerging as one of the fastest-growing markets. Among the most popular titles in this region is Mobile Legends: Bang Bang (MLBB), developed by Moonton. As a multiplayer online battle arena (MOBA) game, MLBB attracts millions of active players and generates a continuous stream of user reviews on platforms such as the Google Play Store. These reviews cover diverse aspects, including gameplay experience, graphical improvements, server performance, cheating issues, and feature requests. This large volume of user-generated content represents a valuable yet underutilised source of user feedback. Manually analysing thousands of reviews on a daily basis is impractical for development teams. Therefore, sentiment analysis—defined as the automated process of identifying and classifying opinions expressed in text—provides a scalable and efficient solution. Recent studies highlight that sentiment analysis enables organisations to systematically extract insights from large-scale textual data and monitor user satisfaction trends over time Sentiment Analysis (Jim et al., 2024; Alharbi et al., 2024). By categorising reviews into positive, neutral, and negative sentiments, developers can prioritise bug fixes, evaluate feature updates, and improve overall user experience. However, performing sentiment analysis on Indonesian-language reviews presents unique challenges compared to English-based natural language processing tasks. The Indonesian language exhibits rich morphological structures, where a single root word can generate multiple surface forms through affixation, including prefixes (e.g., me-, ber-, di-) and suffixes (e.g., -kan, -an, -i). In addition, user-generated reviews often contain informal expressions, slang, abbreviations, and code-switching between Indonesian and English. These characteristics significantly increase vocabulary variability and can negatively impact classification performance if not handled properly. Recent research emphasises the importance of language-specific preprocessing techniques, such as stemming and stopword removal, to address these challenges and improve model accuracy (Islam et al., 2024). Previous studies have explored various approaches for sentiment analysis in Indonesian text, ranging from classical machine learning algorithms such as Logistic Regression, Naive Bayes, and Random Forest to deep learning models including Long Short-Term Memory (LSTM) and Transformer-based architectures like IndoBERT. While these approaches have shown promising results, many studies primarily focus on maximising accuracy without considering practical deployment constraints. In real-world applications, models must be computationally efficient, lightweight, and reproducible, especially when deployed on limited-resource environments such as free-tier cloud platforms. Moreover, there is still limited research that directly compares automated machine learning frameworks, such as PyCaret, with custom deep learning implementations under consistent preprocessing settings on the same dataset. This gap highlights the need for a systematic and fair comparison between classical and deep learning approaches in practical sentiment analysis scenarios. This study addresses the gap by conducting an end-to-end comparison between classical machine learning (ML) and LSTM-based deep learning (DL) methods for three-class sentiment classification of Indonesian MLBB reviews. The proposed preprocessing pipeline incorporates Indonesian-specific text normalisation, including stemming and stopword filtering. Classical models are evaluated using PyCaret AutoML with 5-fold cross-validation, while the deep learning model is implemented as a compact LSTM in PyTorch with fewer than 10 million parameters. Both approaches are further deployed as interactive applications using Gradio on Hugging Face Spaces to ensure accessibility and reproducibility. This study aims to answer the following research questions: • H ow do classical ML classifiers perform on Indonesian MLBB sentiment classification using an AutoML framework? • C an a compact LSTM model outperform classical baselines under identical preprocessing conditions? • W hich approach is more suitable for lightweight and interactive deployment? The main contributions of this paper are: • Preprocessing pipeline: A reproducible Indonesian text cleaning pipeline combining case folding, regex-based noise removal, NLTK stopword filtering, and Sastrawi morphological stemming, with token truncation at 100 tokens. • ML benchmark: A PyCaret AutoML comparison of three classifiers (LR, NB, RF) with TF-IDF features and 5-fold stratified cross-validation. • DL model: A custom PyTorch LSTM with an embedding layer, single LSTM layer (64 hidden units), dropout regularisation, and a fully-connected head—totalling approximately 690K parameters. • Deployment: Two publicly accessible interactive demos on Hugging Face Spaces built with Gradio. • Open source: All code, data, and notebooks are publicly available at https://github.com/Viramhrani/pba2026-Kelompok16 . 2 Related Work 2.1 Machine Learning Models Machine Learning (ML) models have been widely adopted in sentiment analysis tasks due to their simplicity and computational efficiency. Classical approaches such as Naive Bayes, Logistic Regression, and Support Vector Machine (SVM) rely on feature extraction techniques such as Bag of Words (BoW) and Term Frequency-Inverse Document Frequency (TF-IDF) to represent text as numerical vectors. These methods treat each word independently, which limits their ability to capture sequential or contextual relationships between words. Studies on Indonesian-language text classification have demonstrated that Logistic Regression and SVM produce competitive results when combined with appropriate preprocessing and feature engineering [Setyani et al., 2026;Pangestu et al., 2025]. PyCaret, an AutoML framework, has been used to streamline model comparison and evaluation across multiple classifiers in a reproducible manner. Among evaluated models, Random Forest has been shown to achieve the best results in several text classification benchmarks [Ningsih et al., 2024]. 2.2 Deep Learning Approach Deep learning models, particularly Long Short-Term Memory (LSTM) networks, have demonstrated superior performance in sentiment analysis of sequential text data. LSTM is a variant of Recurrent Neural Network (RNN) designed to overcome the vanishing gradient problem and to capture long-term dependencies between words in a sentence [11]. Its memory cell, input gate, forget gate, and output gate allow the model to selectively retain or discard information across time steps. Several studies have confirmed that LSTM outperforms traditional ML models in text classification tasks involving informal and context-dependent language. For instance, research on Indonesian social media comments has shown that LSTM more effectively handles slang, abbreviations, and code-switching compared to Naive Bayes or Logistic Regression [9]. Furthermore, LSTM-based models have been applied to review classification on platforms such as Google Play Store and YouTube, consistently achieving high accuracy and F1-scores [7, 8]. 2.3 Comparison Between ML and DL Approaches Machine Learning and Deep Learning approaches have been widely applied in sentiment analysis tasks, each offering different advantages depending on the characteristics of the data. Traditional Machine Learning models such as Naive Bayes, Logistic Regression, and Random Forest rely on feature extraction techniques like TF-IDF and treat text data