What About Our Bug? A Study on the Responsiveness of NPM Package Maintainers
Mohammadreza Saeidi, Ethan Thoma, Raula Gaikovina Kula, Gema Rodríguez-Pérez · 2025
Read What About Our Bug? A Study on the Responsiveness of NPM Package Maintainers by Mohammadreza Saeidi, Ethan Thoma, Raula Gaikovina Kula, Gema Rodríguez-Pérez (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-04986.txt.
Introduction
Mohammadreza Saeidi and co-authors study how fast the keepers of npm software packages reply to bug reports. The npm web of shared code is core to modern software, yet a bug in one package can spread harm to many that depend on it.
The team mined 30,340 bug reports across 500 of the most used npm packages, and coded why some reports went unmet. Keepers were in fact quite responsive, with a middle project score near seven in ten reports met. The paper maps the main reasons the rest stall, from scope calls to lack of detail.
Catalog record
| CREATOR | Mohammadreza Saeidi, Ethan Thoma, Raula Gaikovina Kula, Gema Rodríguez-Pérez |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-04986
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
What About Our Bug? A Study on the Responsiveness of NPM Package Maintainers Mohammadreza Saeidi, Ethan Thoma, Raula Gaikovina Kula, Gema Rodríguez-Pérez Abstract Background: Widespread use of third-party libraries makes ecosystems like Node Package Manager (npm) critical to modern software development. However, this interconnected chain of dependencies also creates challenges: bugs in one library can propagate downstream, potentially impacting many other libraries that rely on it. We hypothesize that maintainers may not always decide to fix a bug, especially if the maintainer decides it falls out of their responsibility within the chain of dependencies. Aims: To confirm this hypothesis, we investigate the responsiveness of 30,340 bug reports across 500 of the most depended-upon npm packages. Method: We adopt a mixed-method approach to mine repository issue data and perform qualitative open coding to analyze reasons behind unaddressed bug reports. Results: Our findings show that maintainers are generally responsive, with a median project-level responsiveness of 70% (IQR: 55%–89%), reflecting their commitment to support downstream developers. Conclusions: We present a taxonomy of the reasons some bugs remain unresolved. The taxonomy included contribution practices, dependency constraints, and library-specific standards as reasons for not being responsive. Understanding maintainer behavior can inform practices that promote a more robust and responsive open-source ecosystem that benefit the entire community. I Introduction Third-party packages play a crucial role in modern software development by reducing implementation effort and providing reusable functionalities that would otherwise be time-consuming to develop from scratch [ 7 ] . Package managers simplify the integration of these packages into projects. In the JavaScript ecosystem, the Node Package Manager (npm) serves as a vital infrastructure component [ 16 ] . As of 2019, 72% of npm packages relied on at least one third-party package [ 39 ] , and by 2023, the most depended-upon package, body-parser, had over 850,000 direct dependents [ 43 ] , highlighting the deeply interconnected nature of the npm ecosystem. However, this interconnectedness also introduces challenges. Bugs in widely used packages can cascade through the dependency chain, causing crashes, vulnerabilities, or performance issues for numerous downstream systems [ 5 , 23 ] . Addressing such issues often requires effective collaboration between upstream developers (who maintain the packages) and downstream developers (who consume them) . Despite the importance of this collaboration, we still lack a clear understanding of how—and to what extent—upstream developers engage in fixing bugs. Do maintainers actively attempt to resolve reported issues? Why do some bug reports go unaddressed? Who is ultimately responsible for fixing the bug? These questions are especially critical for highly depended-upon npm packages, where unresolved bugs can compromise the reliability of the broader ecosystem [ 17 , 31 ] . Evaluating upstream engagement is not straightforward. While upstream developers are ideally expected to respond to GitHub issues submitted by users, this expectation is complicated by the fact that issues often include feature requests or performance suggestions [ 21 , 20 ] , not just bug reports. One key challenge is determining bug ownership, whether the upstream or downstream developer is ultimately responsible for resolving an issue. Not all reported bugs are actual defects; some result from misunderstandings, environment-specific factors, or unrealistic expectations [ 21 , 33 , 30 ] . Another challenge is assessing bug resolution, as the closure of an issue does not necessarily indicate that the problem has been fixed [ 40 , 24 , 27 ] . In some cases, upstream developers may close issues without resolving the underlying problem, because downstream developers fail to address the upstream feedback, or upstream developers do not follow up on the issue’s progress. Hence, relying only on issue status can lead to misleading conclusions about maintainer behavior. In this study, we consider both bug ownership and actual resolution status as key dimensions for evaluating the level of responsiveness of npm package maintainers to bug reports (what) . We define responsiveness as the extent to which upstream developers resolve bug reports for which they are responsible. To capture this, we propose a framework and automated approaches (how) for identifying and classifying both ownership and responsiveness from GitHub discussions submitted to the 500 most dependent-upon npm packages. Applying this framework at scale, however, presents a significant challenge. Manually analyzing thousands of issues is labor-intensive and impractical at the ecosystem level. To address this, we leverage Large Language Models (LLMs) to automate key parts of the analysis. With their advanced natural language understanding capabilities, LLMs offer a promising solution for automating tasks such as bug classification, acknowledgment detection, and resolution tracking [ 22 ] . Through this work, we aim to provide a deeper understanding of maintainer responsiveness, support downstream developers in their decision-making, and ultimately contribute to a more resilient and maintainable software ecosystem. This study aims to answer the following research questions: • RQ1: To what extent do npm package maintainers respond to bug reports submitted by downstream developers? Given that a single package may be a dependency for thousands of others, even a minor bug can have far-reaching consequences. By quantifying maintainer responsiveness, we aim to provide insights that help downstream developers make informed decisions when selecting dependencies, while also identifying packages that may require additional support and intervention to enhance their quality and long-term maintainability. • RQ2: What are the reasons upstream developers of npm packages do not fix reported bugs? Understanding why certain bugs remain unresolved is essential for improving collaboration between upstream and downstream developers. Identifying the specific reasons why upstream developers choose not to fix reported bugs provides critical insights into decision-making processes that affect the reliability of npm packages. • RQ3: How can Large Language Models be used to automate the analysis of maintainer responsiveness in individual npm packages? Manual classification of maintainer responsiveness does not scale across thousands of issues and packages. This research extends RQ1 by using instruction-tuned LLMs to automate and replicate manual classifications at the individual package level, enhancing external validity and practical applicability. Our findings indicate that npm upstream developers are generally responsive, with a median project-level responsiveness of 70% (IQR: 55%–89%), reflecting their commitment to support downstream developers. The reasons why maintainers do not resolve these upstream bugs were categorized into four main groups: Contribution Practices (e.g., template violations, insufficient information, and pending for proper fix), Dependency Issues (e.g., bugs in dependencies and version incompatibilities), Library Standards (e.g., rare edge cases, design concerns, priority, and discontinue maintenance), Lack of Engagement (e.g., lack of comments and staled investigations). By identifying these root causes of non-responsiveness, our study offers practical insights to improve bug resolution workflows such as enhancing contribution practices, leveraging LLMs for issue triage, and fostering more sustainable collaboration between upstream and downstream developers. The data and scripts to reproduce our results are available in the replication package. 1 1 1 https://osf.io/v4acz II Related Works II-A Quality and Responsiveness in Open-Source Projects A well-maintained OSS project is often characterized by active community engagement, timely issue resolution, and robust code quality. Garousi [ 8 ] proposed metrics such as average fix time and issue resolution rates to quantify project health. Similarly, Zhao et al. [ 45 ] and Dey and Mockus [ 6 ] highlighted the importance of developer activity and community dynamics in sustaining quality over