Towards Extracting Software Requirements from App Reviews using Seq2seq Framework
Aakash Sorathiya, Gouri Ginde · 2025
Read Towards Extracting Software Requirements from App Reviews using Seq2seq Framework by Aakash Sorathiya, Gouri Ginde (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-09039.txt.
Introduction
Aakash Sorathiya and Gouri Ginde tackle the mining of app reviews for software requirements in this 2025 paper. Reviews are a huge source of user feedback, but they are informal, full of errors, and padded with remarks of no use to developers. Earlier extraction methods struggle with that mess.
The authors recast the job as a named entity recognition task handled by a sequence-to-sequence model. Their setup pairs a two-direction LSTM encoder with an LSTM decoder, adds self-attention, word vectors trained on large text, and a CRF layer to tidy the output. On a large crowdsourced set of reviews the system beat earlier methods clearly. On a smaller hand-labeled set of one thousand reviews it only matched them, a gap the authors report openly. The work points toward review mining that feeds real needs into software updates.
Catalog record
| CREATOR | Aakash Sorathiya, Gouri Ginde |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-09039
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Towards Extracting Software Requirements from App Reviews using Seq2seq Framework Aakash Sorathiya, Gouri Ginde Abstract Mobile app reviews are a large-scale data source for software improvements. A key task in this context is effectively extracting requirements from app reviews to analyze the users’ needs and support the software’s evolution. Recent studies show that existing methods fail at this task since app reviews usually contain informal language, grammatical and spelling errors, and a large amount of irrelevant information that might not have direct practical value for developers. To address this, we propose a novel reformulation of requirements extraction as a Named Entity Recognition (NER) task based on the sequence-to-sequence (Seq2seq) generation approach. With this aim, we propose a Seq2seq framework, incorporating a BiLSTM encoder and an LSTM decoder, enhanced with a self-attention mechanism, GloVe embeddings, and a CRF model. We evaluated our framework on two datasets: a manually annotated set of 1,000 reviews (Dataset 1) and a crowdsourced set of 23,816 reviews (Dataset 2). The quantitative evaluation of our framework showed that it outperformed existing state-of-the-art methods with an F1 score of 0.96 on Dataset 2, and achieved comparable performance on Dataset 1 with an F1 score of 0.47. I Introduction Context. The rise of mobile apps has changed the way software developers address users’ needs. In recent years, the Requirements Engineering (RE) landscape has evolved significantly with the emergence of large-scale user feedback, especially app reviews, serving as a key source of actionable insights [ 1 , 2 , 3 , 4 , 5 , 6 , 7 ] . However, popular apps generate large amounts of reviews, making manual analysis impractical [ 5 ] . Therefore, various tools have been developed over the past decade to aid this analysis [ 6 ] . Among several review-based RE tasks, accurately extracting requirements is a crucial step because the quality of the extracted requirements directly influences other essential tasks, such as clustering of requirements to organize similar requirements and sentiment analysis of requirements to identify the sentiment of user feedback [ 8 ] . Problem. Recent research has highlighted several challenges in automated requirements extraction including (i) the inherent linguistic complexity of user-generated content, characterized by informal language, grammatical variations, and contextual nuances [ 5 ] ; (ii) the multi-faceted nature of reviews, where a single text may contain opinions about multiple app aspects [ 2 ] ; (iii) the significant noise and irrelevant information present in large review datasets [ 9 ] ; and (iv) the domain-specific variations in terminology and user expectations [ 10 ] . Efforts such as RE-BERT [ 8 ] and T-FREX [ 11 ] have made notable progress by redefining requirements extraction as a Named Entity Recognition (NER) task, a specific type of token classification in which tokens referring to a particular entity type (e.g., dates, geopolitical entities, requirements, etc.) are labeled as such. RE-BERT leveraged context-dependent language models and cross-domain training to improve requirements extraction, while T-FREX experimented with different language models with a newly created crowdsourced user-annotated app reviews dataset. These methods represent advancements in moving beyond traditional rule-based techniques, which often struggle with semantic complexity and generalizability [ 9 , 2 , 10 ] . However, these studies have still achieved a low F1 score in the range of 0.4-0.5, which shows the scope for further improvement and motivates this study. Solution. In this study, we aim to improve requirements extraction by redefining it as an NER task based on a sequence-to-sequence (Seq2seq) generation problem instead of a traditional token classification problem. To achieve this, we propose a Seq2seq framework in which we first use GloVe word embeddings to transfer the words in reviews to low-dimensional vectors [ 12 ] . Next, we leverage a Bidirectional Long Short-Term Memory (BiLSTM) model [ 13 ] as an encoder to process the input sequence in two directions, as past and future information is equally important for the current output. Then, we adopt a self-attention mechanism [ 14 ] to help our model focus on the significant part, such as the named entity, in the input sequence. Next, we use a Long Short-Term Memory (LSTM) model [ 15 ] as a decoder to obtain the final hidden representations of the words in the input sequence. Finally, we use the condition random fields (CRF) model [ 16 ] to tag the sequence using the BIO ( B eginning, I nside, and O utside) tags corresponding to the NER task. A CRF model is more sensitive to position logic [ 17 ] ; hence, we do not directly use the decoder to generate the BIO tags. Rationale. The Seq2seq framework is based on the encoder-decoder architecture that produces a target sequence of any length from a source sequence. In the context of the NER, it generates the sequence of BIO tags for the given input sequence of app reviews. The Seq2seq framework is widely used for various tasks like machine translation [ 18 ] and, recently, for domain-specific NER, where it has shown remarkable performance [ 19 ] . Thus, taking inspiration from these examples, in this study, we explore the utility of the Seq2seq framework for RE domain-specific NER to extract the requirements from app reviews. In our framework, we used GloVe embeddings to capture the semantic and syntactic information of the input because it is derived from large-scale corpora, resulting in semantically richer and more stable representations compared to other embeddings [ 20 ] . Next, we chose LSTMs as an encoder and decoder in our framework, which has been a standard choice for similar problems [ 21 ] ; however, we used a BiLSTM as an encoder to process the input sequence, considering both future and past information to get better results. Furthermore, we integrated the self-attention mechanism and a CRF model to focus on contextually relevant elements and generate coherent and accurate outputs. Our study excluded GPT models that use decoder-only architectures due to their inherent limitations in performing domain-specific NER tasks [ 22 ] . GPT has been extensively employed across various RE tasks, such as requirements classification [ 23 ] and requirements elicitation [ 24 ] , demonstrating advantages in terms of increased productivity and cost efficiency [ 25 ] . However, in the context of the domain-specific NER task, zero-shot or few-shot GPT has exhibited subpar performance and has been computationally expensive compared to the Seq2seq and traditional NER methods that utilize fine-tuning on the labeled datasets [ 22 , 26 ] . Contributions. We propose a novel reformulation of the requirements extraction task as an NER task utilizing the sequence-to-sequence generation approach and introduce a Seq2seq framework that integrates a BiLSTM encoder and a LSTM decoder, complemented by the self-attention mechanism, GloVe embeddings, and a CRF model for enhanced performance. We conduct a comparative analysis of our framework against existing state-of-the-art models, demonstrating performance on par with RE-BERT while significantly surpassing T-FREX. To our knowledge, this study is the first to apply the proposed set of techniques for requirements extraction from app reviews. We have made our source code publicly available 1 1 1 https://doi.org/10.5281/zenodo.15185900 . Structure. In Section II and Section III , we outline the preliminaries and