OpenDORS: A dataset of openly referenced open research software CCS: Software and its engineering Software libraries and repositories CCS: Applied computing Digital libraries and archives

Stephan Druskat, Lars Grunske · 2025

Read OpenDORS: A dataset of openly referenced open research software CCS: Software and its engineering Software libraries and repositories CCS: Applied computing Digital libraries and archives by Stephan Druskat, Lars Grunske (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-01570.txt.

Introduction

Stephan Druskat and Lars Grunske present a data set on open research software. Much lab work now makes software as it goes. That software is key to results, yet it is hard to track. Open references to it are scattered.

Their set, OpenDORS, gathers openly referenced research software in one place. Each entry is tied to its public reference. Scholars can study how research software spreads and lasts. Funders and labs can spot which tools merit long-term support. The set turns scattered mentions into a base for policy. Each record keeps its source link, so users can trace a software claim back to the paper or page that cited it first.

Catalog record

CREATORStephan Druskat, Lars Grunske
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE24 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-01570

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

OpenDORS: A dataset of openly referenced open research software CCS: Software and its engineering Software libraries and repositories CCS: Applied computing Digital libraries and archives Stephan Druskat, Lars Grunske Abstract . In many academic disciplines, software is created during the research process or for a research purpose. The crucial role of software for research is increasingly acknowledged. The application of software engineering to research software has been formalized as research software engineering, to create better software that enables better research. Despite this, large-scale studies of research software and its development are still lacking. To enable such studies, we present a dataset of 134,352 unique open research software projects and 134,154 source code repositories referenced in open access literature. Each dataset record identifies the referencing publication and lists source code repositories of the software project. For 122,425 source code repositories, the dataset provides metadata on latest versions, license information, programming languages and descriptive metadata files. We summarize the distributions of these features in the dataset and describe additional software metadata that extends the dataset in future work. Finally, we suggest examples of research that could use the dataset to develop a better understanding of research software practice in RSE research. 1. Introduction Software has become a central building block in research across many disciplines. “Research software” Gruenpeter et al. 2021 is created as part of the research process or specifically for the purpose of enabling and improving research. The quality of research software was regarded as negligible compared to the quality of software applied in military or business contexts Randell 2018 . Today, research software is increasingly acknowledged as being critical for developing new technologies, expanding knowledge and addressing grand challenges. The field of research software engineering is continuously formalized through the establishment of the research software engineer (RSE) role, institutional RSE units and national associations. There is growing interest in research software within the software engineering research community, and in opportunities for RSE research Felderer et al. 2025 that investigates features, challenges and methods, and contextual requirements specific to research software and its engineering. RSE research can help understand research software as a distinct class, and develop innovative solutions and integrations of software engineering processes, methods and tools in research software development. This will ultimately lead to the creation and use of better software for more and better critical research. Consequently, premier computer science and software engineering venues host events that focus on research software engineering, e.g., Dagstuhl Seminar “Research Software Engineering: Bridging Knowledge Gaps” Druskat et al. 2025 (2024) and the workshop ‘‘Software Engineering and Research Software’’ 1 1 1 https://conf.researchr.org/home/icse-2026/sers-2026 (SERS ’26) at ICSE. Work by the RSE community comprises technical papers, position papers Anzt et al. 2021 ; Jay et al. 2021 and practice papers discussing research software engineering Druskat et al. 2025a ; Druskat et al. 2024 . One focus of software engineering research on research software is qualitative and smaller scale quantitative work to understand aims and modes of research software production Segal 2009 ; Kelly 2015 , or unique challenges for engineering domain-specific research software Vogel et al. 2019 . Quantitative methods such as larger surveys ( N>1,000 ) are used to describe the state of the practice, e.g., for testing Eisty et al. 2025 , regional communities Carver et al. 2022 or professional backgrounds and attitudes towards software engineering concepts Hannay et al. 2009 . Other work mixed mining software repositories with surveys (Milewicz et al. Milewicz et al. 2019 for contribution roles), or with qualitative analysis (Pimentel et al. Pimentel et al. 2021 for computational notebooks). Larger and large scale work mined software repositories for computational notebooks Pimentel et al. 2019 ; Wang et al. 2021 or investigate software metadata Hounsri & Garijo 2025 . There is a lack of large scale and more comprehensive empirical studies of research software specifics and of its commonalities with other software classes across categories Hasselbring et al. 2025 , programming languages, project sizes, research domains, etc. This is due to a lack of large, sufficiently representative research software datasets that provide access to repositories for mining. To fill this latter gap, we present OpenDORS: Open Dataset of Openly Referenced Open Research Software , a dataset of 134,352 unique research software projects and 134,154 unique source code repositories. We release the dataset and the workflow to construct it under an open license Druskat 2025a . We also release a Python package opendors 2 2 2 https://pypi.org/project/opendors/ that implements the construction logic as open source code Druskat 2025 . The workflow and package, together with openly licensed publication metadata, make the dataset reproducible. 2. Related work Related work discusses research software identification and can be grouped into the areas citation, mentioning and strategies for identification through document linking or LLM use. Formal software citation Smith et al. 2016 makes it possible to identify research software through generic citation analysis. However, current academic practice often falls short of the principles of software citation. Instead, used software is often informally mentioned, missing relevant metadata such as URLs to artifacts. This complicates automated retrieval of software artifact URLs Howison & Bullard 2016 ; Sandt et al. 2019 ; Du et al. 2022 ; Druskat et al. 2024a . In lieu of good software citation practice, recent related work has focused on analyzing mentions to software in the literature. SoftCite Du et al. 2021 provides metadata for 4,093 software mentions in biomedicine and economics literature, manually annotated by 36 students over 2 years. It includes 2,541 sets of metadata that include URLs to websites related to the software. While this approach may yield high quality metadata, it does not scale to larger scale datasets. The SoftCite dataset was used to train a machine-learning model that was used to build the CORD-19 Software Mentions Wade & Williams 2021 . It contains software names mentioned in over 77,000 COVID-19-related full-text articles, but no URLs to access software artifacts. SoMeSci Schindler et al. 2021a consists of 3,756 manually annotated software mentions from 1,367 articles, around 40% of which provide a URL of “a location where additional information can be obtained” Schindler et al. 2021 , p. 4577 . Finally, CZ Software Mentions Istrate et al. 2022 includes \sim 19.3M software mentions (2,536,801 unique mentions) from \sim 20.7M publications. Mentions were mapped to \sim 185,000 URLs for five software ecosystems (PyPI, CRAN, Bioconductor, SciCrunch, GitHub) using string matching, which greatly reduces linking accuracy Brown et al. 2025 ; Druskat et al. 2024a . This makes the dataset unfit for large-scale empirical studies of research software through mining software repositories. Datasets that link research software mentioned in the literature to related software artifacts can be constructed using URL extraction. This is a promising approach, as issues with linking accuracy are largely irrelevant. Lin et al. Lin et al. 2022 provide a dataset of 7,502 URLs detected in regular papers presented at 10 AI conferences between 2010 and 2019 using machine-learning classifiers. However, over a quarter of URLs are not to source code repositories or other software artifacts. Garijo et al. Garijo et al. 2024 provide a dataset of 1,485 research software linked to their implementations. Their data is based on software mentions extracted from over 14,000

Read the complete text