ENHANCING GAME REVIEW SENTIMENT CLASSIFICATION ON STEAM PLATFORM WITH ATTENTION-BASED BILSTM

Abit Ahmad Oktarian, Fadhil Fitra Wijaya, Dhafin Razaqa Luthfi, Luluk Muthoharoh, M.S, Ardika Satria, M.Si, Martin Clinton Tosima Manullang, Ph.D · 2026

Read ENHANCING GAME REVIEW SENTIMENT CLASSIFICATION ON STEAM PLATFORM WITH ATTENTION-BASED BILSTM by Abit Ahmad Oktarian, Fadhil Fitra Wijaya, Dhafin Razaqa Luthfi, Luluk Muthoharoh, M.S, Ardika Satria, M.Si, Martin Clinton Tosima Manullang, Ph.D (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-01315.txt.

Introduction

Abit Ahmad Oktarian and five co-authors investigate sentiment classification of Steam game reviews with an attention-based bidirectional LSTM model. Their dataset samples tens of thousands of reviews from a larger Steam corpus. A traditional baseline using TF-IDF features with automated machine learning is compared against a deep learning approach implemented in PyTorch, trained to address class imbalance in the review labels.

The BiLSTM with attention model, trained with class-weighted loss, achieves solid accuracy and weighted F-score on the test set, with high recall for negative reviews. Attention visualizations highlight sentiment-bearing words, adding interpretability to the predictions. The authors conclude the model is effective for analyzing player sentiment and useful for helping developers understand player feedback at scale.

Catalog record

CREATORAbit Ahmad Oktarian, Fadhil Fitra Wijaya, Dhafin Razaqa Luthfi, Luluk Muthoharoh, M.S, Ardika Satria, M.Si, Martin Clinton Tosima Manullang, Ph.D
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE13 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.01315

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

ENHANCING GAME REVIEW SENTIMENT CLASSIFICATION ON STEAM PLATFORM WITH ATTENTION-BASED BILSTM Abit Ahmad Oktarian, Fadhil Fitra Wijaya, Dhafin Razaqa Luthfi, Luluk Muthoharoh, M.S, Ardika Satria, M.Si, Martin Clinton Tosima Manullang, Ph.D Abstract The rapid growth of the online gaming industry has increased the importance of user reviews as a source of information for players and developers. On the Steam platform, millions of reviews contain opinions about gameplay quality, performance, and user experience. However, the large number of reviews and the use of informal language make manual analysis inefficient. This study aims to classify the sentiment of Steam game reviews using a Deep Learning model based on Bidirectional Long Short-Term Memory (BiLSTM) with an Attention Mechanism. A total of 50,000 review samples were used, with preprocessing steps including text cleaning, tokenization, and sequence padding. The model was trained using Adam optimizer and class-weighted loss to handle data imbalance. Experimental results show that the proposed model achieved 83% accuracy and 85% weighted F1-score. In addition, the model reached 90% recall for negative reviews, showing strong performance in detecting critical feedback. The Attention mechanism also improved interpretability by identifying important sentiment-related words. These results indicate that the BiLSTM+Attention model is effective for analyzing sentiment in Steam reviews and can help developers understand user feedback efficiently. Keywords Sentiment Analysis \cdot Steam Reviews \cdot Deep Learning \cdot BiLSTM \cdot Attention Mechanism 1 Introduction The online gaming industry has become one of the sectors that has experienced rapid growth over the past few decades [ 6 ] . Steam also provides a user review feature that contains players’ opinions regarding game quality, performance, gameplay, and overall gaming experience. This feature allows users to share their experiences after playing a game, both in the form of positive and negative evaluations. In addition, the large number of available reviews can serve as an important source of information for potential players before deciding to purchase or play a particular game. In this digital era, the role of user reviews has become increasingly significant in shaping consumer perceptions of a product or service [ 2 ] . With the growing dependence of consumers on reviews and user opinions, sentiment analysis has become a vital tool for understanding customer perceptions in real-time toward certain games [ 3 ] . Therefore, sentiment analysis is considered one of the methods for making decisions from reviews without having to read all reviews in their entirety [ 7 ] . Therefore, sentiment analysis can help companies and users understand opinion trends emerging from thousands of reviews more quickly and efficiently. However, the main challenge in sentiment analysis lies in data preprocessing, which often involves inconsistent, messy, and redundant text, requiring significant resources and frequently consuming considerable time [ 10 ] . This condition makes the text classification process more complex, so a preprocessing stage is needed to clean the data before modeling. The preprocessing stage generally includes cleaning special characters, removing stopwords, normalizing informal words, stemming, and tokenization so that the text data becomes more structured and ready to be used in the model training process. In this project, a comparison was conducted between two approaches, namely Machine Learning using TF-IDF and PyCaret AutoML, and Deep Learning using a BiLSTM + Attention architecture based on PyTorch. This comparison was carried out to examine the advantages of each method in handling diverse and dynamic Steam review data. The main objective of this study is to determine the best model for performing Steam review sentiment classification accurately and efficiently. 2 Methodology This section describes the dataset construction, preprocessing pipeline, model design, and evaluation protocol used in this study. The workflow is organized to support a fair comparison between a conventional machine learning baseline and the proposed deep learning model. 2.1 Dataset The dataset consists of user reviews collected from the Steam platform. The original corpus contains more than 6.4 million entries in tabular format, where each row includes a review text and a binary recommendation label [ 8 ] . To balance computational cost and dataset diversity, this study uses a subset of 50,000 reviews while preserving variation across multiple game titles, including Counter-Strike and Call of Duty . 2.2 Dataset Overview Table 1 summarizes the dataset configuration used in this study. Table 1: Dataset Characteristics Attribute Value Source Steam Reviews (Kaggle) Total Original Data 6,417,106 reviews Sample Used 50,000 reviews Data Format CSV (text + label) Classes Binary (Positive, Negative) Positive Label 1 Negative Label -1 Train (DL) 38,744 Validation (DL) 4,843 Test (DL) 4,843 Test Distribution 776 Negative, 4067 Positive Each review is mapped into one of two classes. Label 1 denotes recommended content, whereas label -1 denotes not recommended content. Review length varies substantially, ranging from short comments to multi-sentence feedback. Informal language, mixed-language expressions, and game-specific vocabulary further increase linguistic variability and make sentiment classification more challenging [ 1 ] . 2.3 Text Preprocessing Before modeling, each review is normalized through a sequential preprocessing pipeline. First, all text is converted to lowercase to reduce vocabulary size. Next, URL and mention patterns are removed using regular expressions. Non-alphabetic characters are then discarded, preserving only characters in the range a–z, followed by whitespace normalization. These steps reduce noise in user-generated content and produce more consistent inputs for both sparse feature extraction and neural sequence modeling. 2.4 Machine Learning Baseline As a baseline approach, the reviews are represented using term frequency–inverse document frequency (TF-IDF). Under this representation, each document is converted into a sparse vector whose weights reflect both term frequency within a document and inverse document frequency across the corpus [ 11 ] . Model selection is conducted using PyCaret under a uniform experimental configuration. Stratified 3-fold cross-validation is applied to compare five classifiers: Logistic Regression, Ridge Classifier, Gradient Boosting, AdaBoost, and LightGBM. Among these candidates, LightGBM achieves the best F1-score of 0.9448 with an average training time of 11.47 seconds per fold. Ridge Classifier attains an F1-score of 0.9401 but requires substantially longer training time. These results are consistent with prior findings that gradient boosting methods perform well on high-dimensional sparse TF-IDF features [ 5 ] . The selected baseline model is exported as a .pkl file for inference. 2.5 Proposed BiLSTM-Attention Model 2.5.1 Word Embedding Layer For the deep learning pipeline, each tokenized review is converted into a sequence of token indices. Given a vocabulary size of |V|=20{,}000 and a maximum sequence length of L\leq 100 , each token index x_{i} is mapped to a dense vector e_{i}\in\mathbb{R}^{d_{e}} through an embedding matrix E\in\mathbb{R}^{|V|\times d_{e}} , where the embedding dimension is set to d_{e}=128 . A dropout rate of 0.3 is applied to the embedding output to reduce overfitting. 2.5.2 Sequence Encoder The contextual representation is learned using a bidirectional long short-term memory (BiLSTM) network implemented in PyTorch. A forward LSTM processes the sequence from left to right, while a backward LSTM processes it in reverse order. The hidden state at time step t is defined as the concatenation of the two directional outputs [ 4 ] : h_{t}=[\overrightarrow{h_{t}};\overleftarrow{h_{t}}] (1) The hidden dimension is set to 256, resulting in 4,929,027 trainable parameters in the full model. 2.5.3 Attention Mechanism Because not all tokens contribute equally to review polarity, an attention mechanism is introduced to

Read the complete text