Using digital traces to analyze software work: skills, careers and programming languages

Xiangnan Feng, Johannes Wachs, Simone Daniotti, Frank Neffke · 2025

Read Using digital traces to analyze software work: skills, careers and programming languages by Xiangnan Feng, Johannes Wachs, Simone Daniotti, Frank Neffke (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-03581.txt.

Introduction

Xiangnan Feng and his three co-authors, publishing in 2025, mine tens of millions of Stack Overflow posts to map the world of software skills. Question-and-answer sites leave rich traces of what programmers actually do, so the authors turn those traces into a detailed taxonomy and a skill space that shows which skills sit close together. They then read careers through that map, looking at how people's skill sets grow and which paths pay off.

They find that real jobs call for tightly linked bundles of skills, not random grab bags. Programmers mostly grow by adding skills related to ones they already have, a route that often leads to lower-value additions. Python users break that pattern: they tend to aim at higher-value skills, which the authors say may help explain the language's rise to the top of general-purpose use.

Catalog record

CREATORXiangnan Feng, Johannes Wachs, Simone Daniotti, Frank Neffke
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE86 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-03581

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Using digital traces to analyze software work: skills, careers and programming languages Xiangnan Feng, Johannes Wachs, Simone Daniotti, Frank Neffke Abstract Recent waves of technological transformation are reshaping work in uncertain and hard-to-predict ways. However, jobs at the forefront of the digitizing economy offer an early glimpse of these changes and leave rich activity traces. We exploit such traces in tens of millions of Question and Answer posts on Stack Overflow for the creation of a fine-grained taxonomy of software skills to analyze human capital in the global software industry. Constructing a software skill space that maps relations among these skills reveals that real-world software jobs demand highly coherent skill sets and that programmers learn through a process of related diversification. The latter process often leads to the acquisition of lower-value skills. However, when programmers use Python they preferentially target higher-value skills, offering a potential explanation for Python’s successful rise as a dominant general purpose language. Keywords: human capital; skills; software; economic complexity; networks 1 Introduction Knowledge of detailed skills and expertise used at work is central to understanding wages, productivity, and overall labor market dynamics ( Acemoglu and Autor, 2011 ) . Recent work has transformed our ability to do so by using complex network analysis. This has allowed moving away from descriptions that rely on years of schooling, credentials, and work experience to studies of the relations among concrete skills and the tasks they enable workers to perform ( Anderson, 2017 ; Alabdulkareem et al., 2018 ; Hosseinioun et al., 2025 ) . However, most of these studies focus on the content of jobs, not the human capital of who performs them. This limits our understanding of how workers learn new skills, which is crucial for helping individuals, firms and educators navigate transforming labor markets in times of rapid technological change. To address this, we focus on a specific type of work that has become increasingly important, is changing fast and can be studied in great detail: software development. Constructing a fine-grained taxonomy of programming skills, we create a software development skill space that maps relations among these skills. We use this space to analyze which skills are combined in job ads, how programmers acquire new skills and what role programming languages play therein. Software jobs are particularly interesting, because they represent a fast-changing and critical domain of the digital economy ( Brynjolfsson and McAfee, 2014 ; Wachs et al., 2022 ; Juhász et al., 2026 ) . Software companies dominate the global ranks of the largest firms by market capitalization. 1 1 1 Of the seven largest companies worldwide, three (Microsoft, Alphabet, and Meta) focus almost exclusively on software, while two others (Apple and Amazon) derive substantial revenue from it. On the labor market, demand for programming skills has risen sharply over the past two decades: one in 11 U.S. occupations now requires coding skills ( O*NET, 2025 ) , and software-related roles such as data scientist , information security analyst , and computer research scientist rank among the fastest-growing occupations in the US ( U.S. Bureau of Labor Statistics, 2025 ) . At the macro-economic level, this has sparked intense global competition for talent, prompting major economies to designate software development as a strategic priority ( Draghi, 2024 ; Kazim et al., 2021 ; Singh, 2024 ) . However, we currently lack a detailed understanding of the changing human capital that is employed in this sector. As new hardware, programming languages, and specialized libraries reshape computing, fresh roles (e.g., web development, DevOps, data science, artificial intelligence) keep emerging ( Rock, 2019 ; Papoutsoglou et al., 2019 ; Hemon et al., 2020 ) and existing roles transform. Existing databases linking occupations to skills ( O*NET, 2025 , e.g., ) ) are often curated by human experts, making them relatively coarse and slow to update. 2 2 2 For example, the only software-related skill in O*NET is undifferentiated “programming” and the listed software-related work activities often focus on broad domains of application (e.g., “geoinformatics” or “biostatistics”), team dynamics (e.g., managing or collaborating with software engineers), or acquiring software products. More dynamic data sources are challenging in their own right. For instance, job ads — frequently used to study job contents — describe job requirements of ideal-type workers, not human capital endowments of actual workers. Likewise, although rich data from platforms that mediate online freelancing work provide insights into how complex skill interdependencies affect wage premiums ( Anderson, 2017 ; Stephany and Teutloff, 2024 ) , the extent to which these findings generalize to traditional labor markets remains uncertain. We address these gaps by analyzing millions of posts from Stack Overflow (SO)—the largest question-and-answer forum for programmers ( Anderson et al., 2012 ) . Each post describes a specific technical challenge and includes tags that indicate the tools, languages, or concepts involved ( Barua et al., 2014 ) . These challenges reflect real-world coding tasks and by posting answers users demonstrate skills and expertise in these tasks. Indeed, SO postings have real-world value as signals to prospective employers of a programmer’s capabilities ( Xu et al., 2020 ) . Interpreting tags as a structured, albeit partial, description of posted questions, we aggregate questions to create a software-skill taxonomy by identifying clusters of frequently co-occurring tags. We then introduce a notion of relatedness among programming skills based on co-occurrence patterns in users’ posting histories. We use this relatedness to construct a skill space where skills are connected if they are often jointly possessed by the same users. We then use this taxonomy and skill space to examine the postings and learning trajectories of programmers. We find that our skill constructs can be used to predict salaries in real-world job postings. Notably, wages vary greatly across skill profiles, with higher-paying jobs concentrated in more specialized or in-demand fields such as AI and machine learning. Similarly, relatedness estimates derived from interactions with the SO platform predict which combinations of skills are demanded in real-world job ads. This not only shows that our taxonomy captures meaningful structures in the software development landscape, but also that software development jobs are coherent in the sense that they often require sets of closely related skills. The skill taxonomy also sheds light on the role and evolution of programming languages. Programming languages differ in the expertise they support. Analyzing which skills are used with which programming languages, we observe a “nested” pattern reminiscent of similar patterns observed in ecology ( Bascompte et al., 2003 ) , economic development ( Hidalgo and Hausmann, 2009 ; Tacchella et al., 2012 ; Mariani et al., 2019 ) and skill hierarchies ( Hosseinioun et al., 2025 ) . This means that although programming languages may have been tailored for specific use cases, this is not observed in how programmers use languages in practice. Instead, we observe that skills have an implicit hierarchy such that the most ubiquitous skills are supported by almost all languages, whereas rare skills often rely on the most versatile ones. A prime example of the latter is the programming language Python , a popular language that has seen significant growth in recent years ( Economist, 2018 ) . Our skill taxonomy shows that this growth has been

Read the complete text