The Software Behind the Stats: A Student Exploration of Software Trends in Economics, Political Science, and Statistics

Elizabeth Upton (contact author) · 2025

Read The Software Behind the Stats: A Student Exploration of Software Trends in Economics, Political Science, and Statistics by Elizabeth Upton (contact author) (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-06507.txt.

Introduction

Elizabeth Upton and co-authors turn a classroom exercise into a map of the software behind published research. Students audited the replication files of major journals in economics, political science, and statistics. The audit doubled as training in reproducible work.

Scraped records plus student coding covered more than ten thousand papers. Clear habits emerged: one commercial package still rules economics, while the free language R leads statistics and climbs in political science. More papers now mix several tools in one study. Students reported sharper grasp of how research is actually built. The exercise is cheap to copy in other courses. Software habits shape what results can be checked.

Catalog record

CREATORElizabeth Upton (contact author)
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-06507

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The Software Behind the Stats: A Student Exploration of Software Trends in Economics, Political Science, and Statistics Elizabeth Upton (contact author) Abstract This paper presents a student activity designed to explore the use of software and reproducibility practices in academic research across selected journals in economics, political science, and statistics. The activity was designed to deepen students’ understanding of reproducible research workflows and increase their awareness of disciplinary norms in quantitative scholarship. Students reviewed reproduction files associated with published articles from major journals and repositories, using a survey to document software use. Combined with web-scraped metadata, the resulting dataset spans more than 10,000 papers and reveals clear patterns within the journals examined: Stata remains dominant in economics, R is increasingly common in political science, and R is the standard in statistics, with a growing number of articles using multiple software platforms within a single manuscript. These results provide educators with a data-driven view of software practices in contemporary quantitative research, helping to inform decisions about which tools to emphasize in the classroom. To assess whether the student activity met its pedagogical goals, we summarize student feedback, which indicates increased understanding of academic workflows and greater awareness of software diversity. We provide all instructional materials, data, and code to support adoption across course levels and disciplines, and conclude with suggestions for follow-up assignments. Keywords: Stata, R, Python, economics, political science, reproducibility 1 Introduction A range of academic departments, including statistics, economics, and political science, offer courses in statistical and econometric methods. The teaching is not entirely theoretical; recent work has documented and encouraged a pedagogical shift towards empirical examples and data-centric projects ( Angrist and Pischke 2017 ; Carver et al. 2016 ; Çetinkaya-Rundel et al. 2022 ) . Classes on these topics now regularly require students to work with widely-used statistical software packages. Which programming language or statistical package, however, seems to vary across disciplines and is constantly changing over time ( Bednarowska-Michaiel and Uprichard 2025 ) . As educators, we make a conscious decision about what software tools we will use in our courses ( Schwab-McCoy et al. 2021 ; Siegfried et al. 2021 ) . This choice is often based on our own experiences, backgrounds, and the resources available to us. A pragmatic consideration should also be the current state of the software landscape—that is, an understanding of what software is being used in different disciplines. For example, economics departments teach in Stata at least in part because published economic research uses Stata—or at least, conventional wisdom suggests that this is the case, though data on this front is limited. From the student perspective, understanding the software landscape is also valuable. Students make decisions about which courses to take and how much effort to invest in learning a particular software tool or programming language. This decision may be particularly salient with the rapid adoption of generative AI tools, which can produce code and improve immediate task performance without necessarily producing corresponding gains in learning or longer-term knowledge transfer ( Daniotti et al. 2026 ) . Developing fluency in a tool requires time and motivation. The classic question—“why do I need to know this?”—can partially be answered with a clearer picture of disciplinary software norms, which conveys why particular tools are worth learning and how they connect to authentic research practices ( De Veaux et al. 2022 ) . While software preferences shift, one fundamental principle remains constant: reproducibility (i.e. obtaining consistent results using the same input data, computational steps, methods, code, and conditions of analysis ( National Academies of Sciences, Engineering, and Medicine 2019 ) ) is essential for rigorous research ( Munafò et al. 2017 ; Gertler et al. 2018 ; Vilhuber et al. 2022 ; Wrobel et al. 2024 ; Dogucu 2024 ) . Yet, while we tell our students that their code should be shareable and readable, they may not understand how reproducibility pipelines are operationalized in practice. Students may initially be unaware of the idea of reproducibility in data analyses ( Ostblom and Timbers 2022 ) ; even in classes that use data, a recent survey showed that relatively few classes introduce students to common ways of transparently sharing data and code ( Underwood et al. 2024 ) . Additionally, we often do not emphasize how reproducible workflows can be leveraged by students in their own research. That is, reproducibility is not just about making their own work transparent for others—its existence enables students to reproduce findings from a paper, learn how to practically apply methods, and build upon existing research with confidence ( Ball et al. 2022 ; Xiong and Cribben 2023 ) . Our courses, then, should not only teach students how to use the statistical tools prevalent in their field but also foster an understanding of reproducibility as a core research practice ( Horton et al. 2022 ) . At a low cost, we could also expose students to the tools used in other disciplines, emphasizing how the skills developed in one software package can transfer to another—and how these tools, in combination, support reproducible research. To this end, we designed a short activity for students that provides hands-on practice in accessing and interacting with existing reproduction packages, an essential first step in fostering reproducible research skills. The results of the activity, combined with web-scraped metadata, form a dataset describing software use in over 10,000 academic publications across statistics, economics, and political science journals. This dataset offers insight into the current landscape of statistical software usage, information that is valuable for students interested in quantitative fields of study and for instructors making decisions about which software tools to use in their classes. Thus, the contributions of this paper include (1) the introduction of a student activity, easily adaptable to a variety of classroom settings, that exposes students to reproducibility in academia; (2) the use of the resulting dataset to identify software trends that can inform learning and teaching practices; and (3) an outline of several potential extensions that build on or make use of the dataset, including student activities focused on reproducibility verification, documentation quality, and software comparison. The remainder of the manuscript is organized as follows. We first provide historical context and review prior work on trends in software use in research and teaching. We then describe the data sources and the student activity used to construct the dataset, present findings derived from the dataset, and conclude with a discussion of student outcomes and proposed extensions. Throughout the manuscript, we distinguish between reproducibility and replicability (obtaining consistent findings when a study is repeated with new data addressing the same scientific question) following National Academies of Sciences, Engineering, and Medicine (2019) . We note, however, that these terms have often been used interchangeably in the literature, including in some of the articles reviewed and in the original design of the student activity. This study was reviewed by the Williams College Institutional Review Board and determined to be exempt from IRB review, as it presents no risk to participants and relies exclusively on publicly available data. To support transparency and reproducibility, all data and analysis code used in this study are available in an Open Science Framework (OSF) repository: https://osf.io/72ajq/ . A

Read the complete text