UserTrace : User -Level Requirements Generation and Trace ability Recovery from Software Project Repositories DOI: XXXXXXX.XXXXXXX Journal: PACMSE Volume: 37 4 111 8 CCS: Software and its engineering Requirements analysis
Dongming Jin, Zhi Jin, Yiran Zhang, Zheng Fang, Linyu Li, Yuanpeng He, Xiaohong Chen, Weisong Sun · 2025
Read UserTrace : User -Level Requirements Generation and Trace ability Recovery from Software Project Repositories DOI: XXXXXXX.XXXXXXX Journal: PACMSE Volume: 37 4 111 8 CCS: Software and its engineering Requirements analysis by Dongming Jin, Zhi Jin, Yiran Zhang, Zheng Fang, Linyu Li, Yuanpeng He, Xiaohong Chen, Weisong Sun (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-11238.txt.
Introduction
Dongming Jin and 7 co-authors present UserTrace, a system that writes user-level requirements from code, in this 2025 paper. Software stays maintainable when its requirements are clear and linked to the code that implements them. Existing tools mostly summarize code for developers, unit by unit, and ignore how projects evolve. What end users need — plain statements of what the software does for them — is rarely generated.
UserTrace runs four cooperating agents, reviewing, searching, writing, and verifying, through a three-stage process over a repository. In comparative tests it produced requirements judged more complete, correct, and helpful than a known baseline, and it recovered links between requirements and code more precisely than five rival methods. A user study backed the approach.
Catalog record
| CREATOR | Dongming Jin, Zhi Jin, Yiran Zhang, Zheng Fang, Linyu Li, Yuanpeng He, Xiaohong Chen, Weisong Sun |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 60 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-11238
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
UserTrace : User -Level Requirements Generation and Trace ability Recovery from Software Project Repositories DOI: XXXXXXX.XXXXXXX Journal: PACMSE Volume: 37 4 111 8 CCS: Software and its engineering Requirements analysis Dongming Jin, Zhi Jin, Yiran Zhang, Zheng Fang, Linyu Li, Yuanpeng He, Xiaohong Chen, Weisong Sun Abstract . Software maintainability critically depends on high-quality requirements descriptions and explicit traceability between requirements and code. Although automated code summarization (ACS) and requirements traceability (RT) techniques have been widely studied, existing ACS methods mainly generate implementation-level ( i.e., developer-oriented) requirements (IRs) for fine-grained units ( e.g., methods), while RT techniques often overlook the impact of project evolution. As a result, user-level ( i.e., end user-oriented) requirements (URs) and live trace links remain underexplored, despite their importance for supporting user understanding and for validating whether AI-generated software aligns with user intent. To address this gap, we propose UserTrace , a multi-agent system that automatically generates URs and recovers live trace links (from URs to IRs to code) from software repositories. UserTrace coordinates four specialized agents ( i.e., Code Reviewer, Searcher, Writer, and Verifier) through a three-phase process: structuring repository dependencies, deriving IRs for code units, and synthesizing URs with domain-specific context. Our comparative evaluation shows that UserTrace produces URs with higher completeness, correctness, and helpfulness than an established baseline, and achieves superior precision in trace link recovery compared to five state-of-the-art RT approaches. A user study further demonstrates that UserTrace helps end users validate whether the AI-generated repositories align with their intent. 1. Introduction In the era of AI-assisted software development, a multitude of products ( e.g., Claude Code ( Anthropic 2025 ) and Kiro ( Amazon 2025 ) ) can generate an entire software project from only a simple user requirements description. In this context, the maintainability attributes of software become increasingly vital, as they determine the long-term sustainability, evolution, and alignment of the generated systems with user intents. The alarming statistics from TechRadar Pro’s AI Speed Trap Report ( Pro 2025 ) reveal that nearly 66% of organizations face critical challenges in maintainability, and SlashData notes that 46% of developers report missing or insufficient requirements documentation ( Team 2025b ) . Furthermore, reports by Verified Market underscore an expanding trend in the software maintenance service market and may reach 180 billion USD by 2033 ( Team 2025c ) . Against such a backdrop, ensuring software maintainability has become a critical concern, commanding attention in both academia and industry ( Schnappinger et al. 2020 ; Jin et al. 2022 ; Jolak et al. 2025 ) . In practice, ensuring maintainability critically depends on producing high-quality requirements descriptions and establishing explicit traceability links between requirements and code. Despite this, writing requirements descriptions and maintaining traceability in software projects remains manual and labor-intensive. To alleviate human effort, the software engineering community has proposed various automated code summarization (ACS) ( Steidl et al. 2013 ; Zhang et al. 2022 ) and requirements traceability (RT) techniques ( Torkar et al. 2012 ) . Specifically, ACS approaches employ deep learning techniques ( Wan et al. 2018 ; Wang et al. 2020 ) or recent LLMs ( Sun et al. 2024 ; Geng et al. 2024 ; Sun et al. 2023 ) to generate textual descriptions for fine-grained code units ( e.g., functions or classes), while RT approaches establish links between requirements and code based on information retrieval ( Gao et al. 2022 ; Kuang et al. 2019 ) , deep learning ( Guo et al. 2017 ; Lin et al. 2021a ) , and recent LLMs ( Fuchß et al. 2025 ) . However, existing ACS methods primarily produce implementation-level requirements (IRs), which are developer-oriented and describe what the code does rather than why it is needed. Meanwhile, RT methods often construct static trace links and overlook the impact of project evolution, which restricts their ability to preserve valid and meaningful trace links as systems evolve. These leave a critical gap in summarizing user-level ( e.g., end user-oriented) requirements (URs) and maintaining live trace links. Beyond IRs, producing URs is crucial for supporting user-level understanding and ensuring that software projects remain aligned with user goals ( Spijkman et al. 2022 ) , especially in the era of AI-assisted software development, where end users with limited programming expertise can develop software using AI products with simple user intents. The key differences between URs and IRs lie in their abstraction level, target audience, and descriptive focus. IRs describe fine-grained units from the perspective of implementation, whereas URs capture higher-level system objectives from the perspective of end users. For example, an IR may state that “ the function checkPassword() verifies a user’s password hash against the stored hash in the database ” while the corresponding UR would state that “ the system shall allow users to securely log into their accounts by verifying their credentials ”. As this example illustrates, IRs emphasize how the system is implemented, while URs articulate what the system is expected to achieve. Besides, to fully support maintainability, it is also necessary to establish live trace links that connect URs to IRs and ultimately to code, thereby enabling consistent evolution and user-aligned validation of software systems. Advanced Large Language Models (LLMs) like GPT-4 ( Achiam et al. 2023 ) have demonstrated remarkable capabilities in natural language requirements generation ( Jin et al. 2024a ; Jin et al. 2024b ; Jin et al. 2025 ) and project repositories understanding ( Wang et al. 2025 ; Yang et al. 2025 ) . While they can produce contextually fluent requirements texts ( Lian et al. 2025 ) and recover basic traceability links across artifacts ( Fuchß et al. 2025 ) , our research reveals a notable shortfall: in repository-level ( i.e., long context) scenarios and without domain-specific business knowledge, the LLMs tend to hallucinate non-existent code units and to generate descriptions that resemble IRs rather than URs. As demonstrated by three cases in Figure 1 , when tasked with code units from different software systems, GPT-4 regularly produces implementation-oriented descriptions. Although technically sound, these descriptions often fail to articulate the underlying purpose, focusing on how the code works rather than why the system exists, and include many implementation details that are difficult for end users to understand and validate. For example, in the first case study, GPT-4 describes the password verification process at the function level but overlooks the broader user-level requirement that the system must provide secure authentication for account access. We identify three primary challenges that drive these shortcomings. (1) Context Identification and Dependency Navigation. Large software repositories contain many interdependent components, making it non-trivial for LLMs to accurately identify relevant context and capture relationships among code units. It requires strategic context and dependency management. (2) Domain-specific Business Information Integration. User-level requirements typically involve business rules, user workflows, or application specific semantics that are not explicitly encoded in source code. In practice, engineers often guarantee the user-level requirements by utilizing related business information. (3) User Intent Abstraction. Moving from code to IRs and further to URs requires abstraction from low-level implementation details to higher-level system objectives. Current LLMs struggle with this abstraction process, lacking sufficient generalization capability to capture user intent beyond technical descriptions. Figure 1. Three illustrative