Towards an Interpretable Analysis for Estimating the Resolution Time of Software Issues Conference: The 29th International Conference on Evaluation and Assessment in Software Engineering; 17–20 June, 2025; Istanbul, Turkey CCS: Software and its engineering Maintaining software CCS: Software and its
Dimitrios-Nikitas Nastos, Themistoklis Diamantopoulos, Davide Tosi, Martina Tropeano, Andreas L. Symeonidis · 2025
Read Towards an Interpretable Analysis for Estimating the Resolution Time of Software Issues Conference: The 29th International Conference on Evaluation and Assessment in Software Engineering; 17–20 June, 2025; Istanbul, Turkey CCS: Software and its engineering Maintaining software CCS: Software and its by Dimitrios-Nikitas Nastos, Themistoklis Diamantopoulos, Davide Tosi, Martina Tropeano, Andreas L. Symeonidis (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-01108.txt.
Introduction
Dimitrios-Nikitas Nastos and co-authors build in this 2025 paper a readable way to forecast how long software issues take to fix. Teams plan around such guesses, but older tools read only issue text or blur real work with waiting time in queues and reviews. Their system first extracts true fixing effort per project.
Topic modeling captures what an issue is about, while metadata like priority, labels, and assignee skill feed the estimate, keeping the reasoning open to inspection. An aggregated model issues the forecast. Across several projects, the system estimated resolution times well and handed contributors insight they could act on, the authors report. Project leads see the reasons, not just the number.
Catalog record
| CREATOR | Dimitrios-Nikitas Nastos, Themistoklis Diamantopoulos, Davide Tosi, Martina Tropeano, Andreas L. Symeonidis |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-01108
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Towards an Interpretable Analysis for Estimating the Resolution Time of Software Issues Conference: The 29th International Conference on Evaluation and Assessment in Software Engineering; 17–20 June, 2025; Istanbul, Turkey CCS: Software and its engineering Maintaining software CCS: Software and its engineering Programming teams CCS: Software and its engineering Software maintenance tools Dimitrios-Nikitas Nastos, Themistoklis Diamantopoulos, Davide Tosi, Martina Tropeano, Andreas L. Symeonidis Abstract . Lately, software development has become a predominantly online process, as more teams host and monitor their projects remotely. Sophisticated approaches employ issue tracking systems like Jira, predicting the time required to resolve issues and effectively assigning and prioritizing project tasks. Several methods have been developed to address this challenge, widely known as bug-fix time prediction, yet they exhibit significant limitations. Most consider only textual issue data and/or use techniques that overlook the semantics and metadata of issues (e.g., priority or assignee expertise). Many also fail to distinguish actual development effort from administrative delays, including assignment and review phases, leading to estimates that do not reflect the true effort needed. In this work, we build an issue monitoring system that extracts the actual effort required to fix issues on a per-project basis. Our approach employs topic modeling to capture issue semantics and leverages metadata (components, labels, priority, issue type, assignees) for interpretable resolution time analysis. Final predictions are generated by an aggregated model, enabling contributors to make informed decisions. Evaluation across multiple projects shows the system can effectively estimate resolution time and provide valuable insights. 1. Introduction Nowadays, developers host their projects online in code hosting facilities and manage them with issue tracking systems like Bugzilla or Jira. These services enable developers to co-manage projects, implement new features, fix issues, plan sprints, craft product releases and generally keep track of all the management aspects of their project. This collaborative paradigm has also brought forth an abundance of data, which can be used to automate certain tasks with the goal of reducing the time and effort required by the developers. Indeed, several researchers have sought to confront challenges related to issue monitoring and assignment, including e.g. the problem of finding the most suitable developer for fixing an issue ( Murphy and Cubranic 2004 ; Anvik et al. 2006 ; Matsoukas et al. 2020 ; Alkhazi et al. 2020 ) or determining the priority/severity of an issue ( Sharma et al. 2012 ; Tian et al. 2015 ; Kanwal and Maqbool 2012 ; Diamantopoulos et al. 2021 ; Lamkanfi et al. 2010 ; Yang et al. 2012 ) . These efforts are often coupled with the challenge of bug-fix time prediction , i.e. the problem of determining how much time is needed in order to fix an issue. Practically, one could even argue that all these problems are connected, considering that knowing the effort required to resolve an issue is necessary for determining the most suitable assignee or even for prioritizing it ( Giger et al. 2010 ) . In fact, several approaches have lately been proposed for the challenge of issue resolution time prediction ( Weiss et al. 2007 ; Panjer 2007 ; Giger et al. 2010 ; Bhattacharya and Neamtiu 2011 ; Marks et al. 2011 ; Lamkanfi and Demeyer 2012 ; Zhang et al. 2013 ; Habayeb et al. 2018 ) . Certain methods are based on textual data and machine learning models ( Weiss et al. 2007 ; Panjer 2007 ) , while others employ also information on the contributors/components involved ( Giger et al. 2010 ; Bhattacharya and Neamtiu 2011 ; Marks et al. 2011 ; Lamkanfi and Demeyer 2012 ) . There are also several interesting approaches using Markov models ( Zhang et al. 2013 ; Habayeb et al. 2018 ) or even deep learning ( Sepahvand et al. 2020 ; Lee et al. 2020 ) . Although efficient, most of these approaches suffer from important limitations. Most of them focus on past issue data taking into account only the text (titles, descriptions), disregarding the metadata of issues, such as their priority or labels. Furthermore, they do not always employ semantics to unveil correlations among the issues and the components of the project. Moreover, the estimates are black-box, i.e. they are not interpretable under the prism of expected effort, expertise and priority. The time required to resolve an issue is often estimated without taking into account its severity (i.e. prioritize critical issues against others), whether the issue is hard to fix (and thus it requires more effort), or if the developer undertaking it is experienced in the relevant component/topic (and thus it may demand less/more of his/her time). In this work, we present an interpretable issue monitoring approach that goes beyond black-box predictions by leveraging both textual and metadata-driven insights. Unlike prior methods that rely primarily on textual data, our approach incorporates issue priority, component, and assignee history to provide a structured and explainable resolution time estimate. By using BERTopic ( Grootendorst 2022 ) for semantic analysis and integrating historical metadata, we enable informed decision-making for issue and sprint planning. The rest of this paper is organized as follows. Section 2 reviews the related work in the challenge of issue resolution time prediction and further discusses the limitations of existing approaches. Our methodology for building a new issue resolution time assessing mechanism is presented in Section 3 . Section 4 evaluates our approach using a set of software projects and illustrates its interpretability. The implications of our methodology and the relevant insights are discussed in Section 5 . Finally, Section 6 concludes this work and provides ideas for future work. 2. Related Work Issue resolution time prediction has emerged as a key research challenge in software engineering, attracting a variety of approaches. Giger et al. ( Giger et al. 2010 ) used decision tree analysis to predict whether issues would be fixed quickly or slowly, relying on both static issue attributes and early post-submission changes; while their models outperform random classification, the binary fast/slow categorization and moderate interpretability leave finer-grained questions unanswered. Weiss et al. ( Weiss et al. 2007 ) adopted text mining techniques to match new issue reports with similar past reports for effort estimation, yet their reliance on report text quality limits insight into how different features contribute to predictions. Panjer ( Panjer 2007 ) investigated Eclipse bug lifetimes using various data mining techniques and basic attributes such as cc lists and comments, but his single-project focus and lack of broader interpretability limit its applicability. Bhattacharya and Neamtiu ( Bhattacharya and Neamtiu 2011 ) compared different bug-fix time models and demonstrated incremental improvements in prediction accuracy; however, their work does not offer a holistic explanation of critical factors influencing fix time. Marks et al. ( Marks et al. 2011 ) studied resolution times across open source projects using a random forest classifier to capture interactions among fixing time, component information, and other features, yet the ensemble nature of their approach obscures the underlying decision logic. Lamkanfi and Demeyer ( Lamkanfi and Demeyer 2012 ) focused on filtering bug reports to enhance fix-time analysis, reducing noise but yielding models that remain opaque regarding feature contributions. Zhang et al. ( Zhang et al. 2013 ) conducted an empirical study on commercial projects