Exploring the Use of LLMs for Requirements Specification in an IT Consulting Company

Liliana Pasquale, Azzurra Ragone, Emanuele Piemontese §, Armin Amiri Darban · 2025

Read Exploring the Use of LLMs for Requirements Specification in an IT Consulting Company by Liliana Pasquale, Azzurra Ragone, Emanuele Piemontese §, Armin Amiri Darban (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-19113.txt.

Introduction

Liliana Pasquale and three co-authors report a trial of language models for writing software requirements in a paper from 2025. In an IT consulting firm, analysts build a formal design document from scattered notes, emails, and product sketches, a slow and fragmented task. The team fed models a summary of source material plus document templates and asked for draft sections and user stories.

Three top models were compared with human analysts on correctness and quality. The models sped up drafting and made documents more uniform. Quality hinged on the inputs, and human revision was still needed. The authors favor a pairing: models draft, analysts oversee.

Catalog record

CREATORLiliana Pasquale, Azzurra Ragone, Emanuele Piemontese §, Armin Amiri Darban
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-19113

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Exploring the Use of LLMs for Requirements Specification in an IT Consulting Company Liliana Pasquale, Azzurra Ragone, Emanuele Piemontese §, Armin Amiri Darban Abstract In practice, requirements specification remains a critical challenge. The knowledge necessary to generate a specification can often be fragmented across diverse sources (e.g., meeting minutes, emails, and high-level product descriptions), making the process cumbersome and time-consuming. In this paper, we report our experience using large language models (LLMs) in an IT consulting company to automate the requirements specification process. In this company, requirements are specified using a Functional Design Specification (FDS), a document that outlines the functional requirements and features of a system, application, or process. We provide LLMs with a summary of the requirements elicitation documents and FDS templates, prompting them to generate Epic FDS (including high-level product descriptions) and user stories, which are subsequently compiled into a complete FDS document. We compared the correctness and quality of the FDS generated by three state-of-the-art LLMs against those produced by human analysts. Our results show that LLMs can help automate and standardize the requirements specification, reducing time and human effort. However, the quality of LLM-generated FDS highly depends on inputs and often requires human revision. Thus, we advocate for a synergistic approach in which an LLM serves as an effective drafting tool while human analysts provide the critical contextual and technical oversight necessary for high-quality requirements engineering (RE) documentation. § § footnotetext: This author conducted a student internship at Fincons group. I Introduction The requirements specification process remains a significant bottleneck and critical challenge across many industries. In practice, the knowledge needed to define requirements is often extensive [ 1 ] and scattered across various sources [ 2 ] , such as meeting minutes, email correspondence, high-level product descriptions, and other elicitation artifacts. As a result, requirements analysts need to examine fragmented and large sets of information to identify and specify the system requirements, which can be cumbersome and time-consuming. This challenge highlights the need for automated approaches to streamline the requirements specification process. Large Language Models (LLMs) have the potential to address this challenge. They can quickly process and analyze lengthy, diverse and unstructured natural language content to extract system requirements specified in a pre-defined format [ 3 ] . In this paper, we report our experience on using LLMs to automate the specification of requirements in an international IT consulting company, focusing on a project related to digital rights management. The requirements are documented using a custom template-Functional Design Specification (FDS)- which outlines the system’s functional requirements, features, and behavior. We explore the feasibility and effectiveness of utilizing LLMs to automate the generation of FDS documents, aiming to reduce manual effort while preserving the quality of the specification. Additionally, We investigated the practical application of three state-of-the-art LLMs (specifically GPT-3.5-turbo, GPT-4o, and Llama-3-70B) within the requirements specification workflow of the company. The methodology involved providing these LLMs with summarized requirements elicitation documents (such as presentations and meeting minutes) and predefined FDS templates. The LLMs were prompted to generate key components of the FDS, including Epic FDS providing high-level product descriptions and user stories, which were subsequently compiled into complete FDS documents. To evaluate this approach, we systematically compared the correctness, quality, and structure of the LLM-generated FDS documents against those produced during the traditional, analyst-driven requirements specification process used within the company. We assessed the plausibility of the created user stories by evaluating whether they semantically covered those crafted by the analysts. In addition, We also qualitatively examined the structure and content of the entire FDS. We assessed the syntactic and semantic qualities of the user stories using the Quality User Stories framework [ 4 ] , and qualitative feedback obtained by interviewing an experienced requirements analyst involved in the project. Our findings indicate that LLMs can automate and standardize the requirements documentation, offering tangible time savings compare to the manual effort typically required. However, the study also highlights critical limitations. The completeness and precision of LLM-generated requirements highly depend on the quality and comprehensiveness of the input information and often necessitate human review, refinement, and contextual information. This research contributes empirical insights into the practical application of LLMs in industrial requirements engineering (RE) settings, advocating for a synergistic human-AI collaboration where LLMs act as efficient drafting assistants, augmented by the indispensable contextual understanding and critical oversight provided by human analysts to ensure high-quality, reliable requirements documentation. The remainder of the paper is organized as follows: Section II reviews relevant related work on LLM-powered approaches in requirements engineering. Section III describes the industrial context of the study, while Section IV delves into the experimental setup, designed to replicate the company’s requirements specification workflow. Section V presents the evaluation of the quality of the LLM-generated artifacts. Section VI discusses key findings and limitations. Finally, Section VII concludes the paper. II Related Work LLMs hold promise for improving the efficiency and accuracy of requirements-related tasks. Arora et al. [ 3 ] envisioned an LLM-driven RE process in which LLMs automate different RE activities (elicitation, specification, analysis and validation). They claim that LLMs can streamline the specification process by converting the unstructured material collected during the elicitation stage into structured templates like user stories. Recent work has leveraged deep learning models and LLMs to automate the elicitation of software requirements. Gudaparthi et al. [ 5 ] proposed a novel approach that uses adversarial examples to identify new requirement candidates. By applying small perturbations to existing requirements via a deep neural network, their method generates traceable variations that facilitate stakeholder discussions while maintaining transparency to the original features. Wei et al. [ 6 ] employed LLMs for app feature elicitation, using one approach inspired by LLMs and another based on existing app descriptions from app stores. Their results show that while both methods produce relevant and clearly described features, LLMs can handle novel, previously unseen app scopes. However, some features produced by LLMs may be unrealistic or unclear regarding feasibility, requiring human analysis. Bencheikh and Hoglund [ 7 ] conducted a study exploring the efficacy of AI tools, particularly ChatGPT, in efficiently generating software requirements. They compared ChatGPT-generated requirements with human-authored ones under identical domain descriptions. ChatGPT matched human performance in both functional and non-functional requirements without additional context, while offering superior time efficiency. Although this study acknowledged the time efficiency of ChatGPT, it also recognized that experienced human participants tend to produce more comprehensive requirements. Similarly, Ronanki et al. [ 8 ] used a set of standardized questions to elicit requirements from both ChatGPT and five RE experts. The LLM-generated requirements were more abstract, atomic, and consistent, though their practicality in real-world prioritization scenarios remains an open question. Zhang et al. [ 9 ] explore the use of LLMs to enhance the quality of user stories in agile software development. In particular, they used LLMs to automate the refinement of user stories, demonstrating improvements in clarity, completeness, and alignment with business goals. While these enhancements were generally well-received, concerns were raised regarding the increased complexity and length of some user stories, particularly with the GPT-4 model. The study highlights the importance of human oversight to ensure that AI-generated stories remain relevant and accurate. Similarly to our study,

Read the complete text