LLM-Driven Cost-Effective Requirements Change Impact Analysis

Romina Etezadi, Sallam Abualhaija, Chetan Arora, Lionel Briand · 2025

Read LLM-Driven Cost-Effective Requirements Change Impact Analysis by Romina Etezadi, Sallam Abualhaija, Chetan Arora, Lionel Briand (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-00262.txt.

Introduction

Romina Etezadi, Sallam Abualhaija, Chetan Arora, and Lionel Briand target a costly chore in software projects: when one requirement changes, which others are affected? Doing this by hand is slow and error-prone, and missed links can cause serious downstream failures, above all in regulated fields. Their tool, ProReFiCIA, uses large language models to flag affected requirements automatically.

Across several models and prompt designs, the best setup recovered most affected items on an unseen industrial dataset, while engineers only had to review a tiny share of all requirements. Adding domain knowledge through retrieval raised recall further, at slightly higher cost. The study shows language models can cut the price of change analysis without flooding engineers with false leads.

Catalog record

CREATORRomina Etezadi, Sallam Abualhaija, Chetan Arora, Lionel Briand
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE99 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-00262

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

LLM-Driven Cost-Effective Requirements Change Impact Analysis Romina Etezadi, Sallam Abualhaija, Chetan Arora, Lionel Briand Abstract . Requirements are inherently subject to changes throughout the software development lifecycle. Within the limited budget available to requirements engineers, manually identifying the impact of such changes on other requirements is both error-prone and effort-intensive. That might lead to overlooked impacted requirements, which, if not properly managed, can cause serious issues in the downstream tasks. Inspired by the growing potential of large language models (LLMs) across diverse domains, we propose ProReFiCIA , an LLM-driven approach for automatically identifying the impacted requirements when changes occur. We conduct an extensive evaluation of ProReFiCIA using several LLMs and prompts variants tailored to this task. Using the best combination of an LLM and a prompt variant, ProReFiCIA achieves a recall of 93.3% on a benchmark dataset and 95.8% on a newly created industry dataset, demonstrating its strong effectiveness in identifying impacted requirements. Further, the cost of applying ProReFiCIA remains small, as the engineer only needs to review the generated results, which represent between 2.1% and 8.5% of the entire set of requirements. 1. Introduction Software systems today are increasingly complex, distributed, and tightly coupled, making even seemingly minor changes potentially risky and costly. In this context, Change Impact Analysis (CIA) plays a critical role in Requirements Engineering (RE) by systematically identifying, evaluating, and managing the effects of proposed modifications ( Jönsson and Lindvall 2005 ) . The primary objective of CIA is to determine which components—ranging from requirements and design artifacts to source code and documentation—are likely to be affected by a change in requirements. Accurate impact assessment is essential not only for minimizing unintended side effects but also for supporting cost estimation, prioritization, and strategic decision-making in software maintenance and evolution ( Arora et al. 2015a ) . Throughout the software development lifecycle, requirements are often subject to rapid changes due to evolving project needs, stakeholder input, or external factors. When a requirement is modified, it is thus essential to assess the potential impact of this change on other related requirements. This process is known as inter-requirement change impact analysis ( Pohl 2016 ) . The process of identifying, assessing, and incorporating these changes across the entire requirements specification can be both time-consuming and costly. Traditionally, CIA has relied on manual inspections, expert judgment, and syntactic dependency analysis. While effective in small systems, these approaches often struggle to scale to large, evolving software landscapes and may fail to capture implicit or semantic dependencies. To address the challenges of manually identifying the impacted requirements, automated approaches have been proposed ( Nejati et al. 2016 ; Abualhaija et al. 2024 ) . However, research on the impact analysis of inter-requirement changes has been limited ( Arora et al. 2015b ) . Other studies on traceability link recovery (TLR), which focus on predicting trace links between different software artifacts, have proposed techniques that can also be applied to CIA tasks through the use of requirement traceability ( Hey et al. 2025 ; Vogelsang et al. 2025 ; Mucha et al. 2024 ; Li et al. 2023 ; Abbas et al. 2023 ) . These approaches leverage semantic similarity, dependency graphs, and machine learning to infer relationships between artifacts. Despite their utility, the primary challenges of CIA cannot be fully addressed through general TLR techniques alone. One key limitation lies in the nature and variability of change requests. In practice, a change may be triggered either by an updated requirement that modifies existing functionality or by a descriptive explanation, often expressed in natural language (NL), outlining how the change should be implemented across related artifacts ( Arora et al. 2015a ) . General TLR techniques, operating at the requirements level, are typically designed to recover relationships or links between requirements using the same NL style rather than focusing on complex change descriptions. Consequently, they may fail to capture implicit dependencies, indirect impacts, or nuanced semantic relationships that are critical for accurately predicting change propagation. Figure 1. Example of three change rationales and their impact on requirements. C_{i} denotes a change request submitted by the user, and REQ_{i} represents the i^{th} requirement in the documentation. To illustrate this concept, consider the example in Figure 1 . The requirements pertain to the functionality and operations of a satellite data link management system (referred to as SAT-DLink , in this paper). As we discuss later in the paper, these requirements are drawn from a real satellite industry requirements document and have been marginally altered to preserve confidentiality. There are three distinct change requests from the user, namely C1, C2, and C3. In C1, the user intends to modify the SAT-DLink program’s functionality by replacing or augmenting the legacy networking protocol SNMP (Simple Network Management Protocol) with SDN (Software-Defined Networking) technology. Following this request, requirements REQ1 and REQ2 are impacted as they directly refer to the use SNMP in the internal operations of the system. REQ3 is also impacted, as it refers to network management functions that will be impacted by SDN technology. REQ4, on the other hand, despite talking about SNMP is not impacted as its intent is interoperability of the system and not internal management. In C2, the user requests that all documents referencing Ref-D1 (defined within the requirements document) be updated to a newer version (Ref-D2) based on the new project guidelines. Consequently, any requirements mentioning Ref-D1 documents, such as REQ5, are impacted by this change. In C3, the user requests the removal of the dual-launch configuration. Therefore, all requirements associated with launch operations that depend on or reference the dual-launch setup, such as REQ6, will be affected. The advent of LLM models has opened new avenues for RE tasks ( Zadenoori et al. 2025 ) . LLM models can capture subtle semantic relationships between NL texts and, more importantly, infer indirect dependencies, which is an essential objective in CIA tasks. Building on the capabilities of LLMs and prompt engineering, we introduce ProReFiCIA , an approach that leverages LLMs’ reasoning and contextual understanding to identify potential change propagation. By doing so, ProReFiCIA enhances the completeness of detected impacts while maintaining high accuracy in predicting which requirements are truly affected. Contributions. This paper makes the following contributions: • We design a set of 64 distinct prompt variations and perform an extensive evaluation to analyze how the level of detail in the prompt, as well as its structure, influences the performance of LLM models on the CIA task. • We conduct a comprehensive evaluation across five distinct LLMs to assess their relative effectiveness at addressing the CIA task. • We present ProReFiCIA , an automated approach for CIA that combines refinement and filtering stages with advanced prompt engineering techniques to enhance overall performance and compare it with baseline techniques. Note that ProReFiCIA does not require a pre-existing training dataset, making our approach adaptable across domains without extensive data collection or preparation. • We evaluate ProReFiCIA . On an existing dataset, we show that, on average, it successfully identifies 93.3% of the impacted requirements while retrieving only 8.5% of the total requirements for inspection by the analyst. Furthermore, on a newly created and more complex industry dataset, ProReFiCIA identifies 95.8% of the impacted requirements while retrieving

Read the complete text