An ML-based Approach to Predicting Software Change Dependencies

Ali Arabat, Mohammed Sayagh, Jameleddine Hassine · 2025

Read An ML-based Approach to Predicting Software Change Dependencies by Ali Arabat, Mohammed Sayagh, Jameleddine Hassine (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-05034.txt.

Introduction

Ali Arabat, Mohammed Sayagh, and Jameleddine Hassine predict which software changes depend on each other in a 2025 study. In big systems like OpenStack, one patch often needs another patch that adds a function it calls. Missing that link breaks builds and ships half-finished features.

Studying ten years of OpenStack history, they found over half the dependencies surface only during code review, hours after the change was filed. Developers spent a median of 57 hours hunting links among hundreds of candidates. Two machine learning models now flag likely dependency pairs early, scoring well on ranking tests. The goal is proactive warnings at filing time.

Catalog record

CREATORAli Arabat, Mohammed Sayagh, Jameleddine Hassine
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE91 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-05034

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

An ML-based Approach to Predicting Software Change Dependencies Ali Arabat, Mohammed Sayagh, Jameleddine Hassine Abstract As software systems grow in complexity, accurately identifying and managing dependencies among changes becomes increasingly critical. For instance, a change that leverages a function must depend on the change that introduces it. Establishing such dependencies allows CI/CD pipelines to build and orchestrate changes effectively, preventing build failures and incomplete feature deployments. In modern software systems, dependencies often span multiple components across teams, creating challenges for development and deployment. They serve various purposes, from enabling new features to managing configurations, and can even involve traditionally independent changes like documentation updates. To address these challenges, we conducted a preliminary study on dependency management in OpenStack, a large-scale software system. Our study revealed that a substantial portion of software changes in OpenStack over the past 10 years are interdependent. Surprisingly, 51.08% of these dependencies are identified during the code review phase—after a median delay of 5.06 hours—rather than at the time of change creation. Developers often spend a median of 57.12 hours identifying dependencies, searching among a median of 463 other changes. To help developers proactively identify dependencies, we propose a semi-automated approach that leverages two ML models. The first model predicts the likelihood of dependencies among changes, while the second identifies the exact pairs of dependent changes. Our proposed models demonstrate strong performance, achieving average AUC scores of 79.33% and 91.89%, and Brier scores of 0.11 and 0.014, respectively. Indeed, the second model has a good top-k recall across all types of pairs, while the top-k precision has room for improvement. Furthermore, this study provides actionable recommendations for practitioners, researchers, and tool builders working with large-scale software systems. Insights from an Empirical Study on OpenStack keywords Empirical Study, Dependency Prediction, Machine Learning, Modularity 1 Introduction Large-scale software systems employ various techniques and solutions to enable parallel development and feature addition without disrupting the development, integration, or deployment pipelines. For instance, the OpenStack 1 1 1 https://www.openstack.org/ system undergoes continuous changes, with a median of 136 changes per day. Similarly, other large-scale systems such as Google Chromium 2 2 2 https://github.com/chromium/chromium experience a high volume of changes, with new submissions occurring every few minutes. The vast number of continuously submitted changes to the pipeline must be synchronized and ordered correctly to prevent breaking the integration and deployment pipelines or even introducing incomplete features and bugs into production. This process is facilitated by various tools, such as OpenStack’s Zuul 3 3 3 https://zuul.openstack.org/builds CI/CD platform. In this platform, developers must tag their changes when they depend on other changes by using specific tags in the description of their changes. Typical examples of such tags include the “Depends-On” and “Needed-By” tags as illustrated in Figures 2 and 3 . These tags indicate dependencies between changes, ensuring that a failure in an earlier step automatically excludes the dependent change from the integration and deployment pipelines. This approach helps prevent potential bottlenecks, build failures, and even the inadvertent deployment of bugs. While a large body of research focuses on the maintenance and evolution of software systems, little attention has been given to the dependencies among software changes. Existing studies primarily examine software dependencies at the file or class level Xia et al. 2015 , but none specifically investigate dependencies from the perspective of software changes. The closest related work is a recent study by Arabat et al. Arabat and Sayagh 2024 , which empirically analyzed dependencies among changes across different components. Yet, their focus is on cross-component change relationships, which do not necessarily imply dependencies, such as changes addressing the same bug or sharing the same change ID. Furthermore, their study did not propose any solutions for predicting dependencies among software changes, particularly changes in large-scale software systems. In this paper, we present the first empirical study on dependencies among software changes by analyzing 49,357 dependent changes in OpenStack. We define dependencies as interrelated changes linked through two key tags: “Depends-On” and “Needed-By” Arabat and Sayagh 2024 . Our focus on OpenStack aligns with a significant body of prior research Foundjem et al. 2022 ; Bessghaier et al. 2023 ; Arabat and Sayagh 2024 , including the work of Arabat et al. Arabat and Sayagh 2024 . We focus on OpenStack because it is a widely used and actively maintained software system, making it an ideal subject for studying the synchronization of concurrent changes. Moreover, to the best of our knowledge, OpenStack is the only system that provides a systematic mechanism for declaring dependencies among changes, offering a unique opportunity for structured analysis. Our study is conducted in two phases. The first phase focuses on gaining both quantitative and qualitative insights into the dependencies among changes, while also assessing the challenges associated with identifying these dependencies. The second phase introduces two prediction models designed to assist practitioners in effectively identifying dependent changes. As our work aims to study and predict dependencies among software changes in OpenStack, the key contributions of this research are four-fold as follows: • We conduct both quantitative and qualitative investigations into the dependencies among OpenStack’s software changes, providing insights into the challenges and characteristics of dependency management in large-scale systems. • We propose a semi-automated approach that leverages two ML models to assist practitioners in identifying dependencies among software changes, offering a practical solution to improve efficiency in dependency detection. • To facilitate the replication of our study, we have made the replication package available at the following link: https://github.com/aliarabat/change-predictor . • We present a comprehensive discussion of the findings, offering actionable recommendations for practitioners, researchers, and tool builders to enhance dependency-based detection tools and further the understanding of dependency management in complex software systems. The paper is structured as follows. Section 2 presents our motivational example. Section 3 presents the closest work to our study. Section 4 presents our data collection process. Section 5 provides our preliminary study on dependent changes. Section 6 examined the research questions and an overview of our methodology design. Section 7 presents the evaluation results of the proposed models. Section 8 provides a detailed implication of this work. Section 9 presents our threats to validity before concluding the paper in Section 10 . 2 Motivating Example Figure 1: A typical example of a code change with a missed dependency link. To better motivate the need for a mechanism to identify dependencies among software changes using state-of-the-art ML classifiers, it is valuable to examine a real-world scenario where a missed dependency caused significant delays and posed risks to the CI/CD pipeline and deployment process. This example underscores the importance of accurately and timely identifying software change dependencies, which is the primary goal of this paper. In this scenario, a developer submitted a change, identified as 676421, for review. The purpose of the change was to add metadata for a new OpenStack project, “ansible-plugin-container-connection” , to the “project-config” repository. The project-config repository contains essential configuration files that are crucial for setting up and deploying OpenStack infrastructure 4 4 4 https://github.com/openstack/project-config . The submitted change involved modifications to two CI tools, Zuul and Gerrit . However, Zuul failed to deploy such a change. Since the introduced changes pertained to an official OpenStack project, one of

Read the complete text