Safe to Stay: Psychological Safety Sustains Participation in Pull-based Open Source Projects

Emeralda Sesari, Federica Sarro, Ayushi Rastogi · 2025

Read Safe to Stay: Psychological Safety Sustains Participation in Pull-based Open Source Projects by Emeralda Sesari, Federica Sarro, Ayushi Rastogi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-17510.txt.

Introduction

Emeralda Sesari, Federica Sarro, and Ayushi Rastogi studied in 2025 psychological safety in open source software projects that work through pull requests. Psychological safety is the belief that one can speak up, ask questions, and err without punishment. It is well studied in company teams but little understood among volunteer contributors who direct their own work.

The authors built a framework linking safety to observable patterns in pull request exchanges, such as feedback and visible engagement. They measured these patterns across tens of thousands of pull requests in popular projects. Visible engagement from contributors, reviewers, and maintainers tracked with people staying active. Discussion helped up to a point, beyond which more talk stopped helping.

Catalog record

CREATOREmeralda Sesari, Federica Sarro, Ayushi Rastogi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-17510

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Safe to Stay: Psychological Safety Sustains Participation in Pull-based Open Source Projects Emeralda Sesari, Federica Sarro, Ayushi Rastogi Abstract Background: Psychological safety refers to the belief that team members can speak up or make mistakes without fear of negative consequences. While it is recognized as important in traditional software teams, its role in open-source software development remains understudied. Open-source contributors often collaborate without formal roles or structures, where interpersonal relationships can significantly influence participation. Code review, a central and collaborative activity in modern software development, offers a valuable context for observing such team interactions. Aims: This study investigates whether team-level psychological safety, inferred from code review activities, is associated with contributors’ sustained participation in open-source projects. Method: Using data from 60,684 pull requests across multiple repositories, we developed a psychological safety index based on observable cues such as merge decisions, comment activity, interaction diversity, and mentions. We analyzed the relationship between this index and contributors’ short-term (within 1 year) and long-term (over 4-5 years) sustained participation using three logistic regression models. Results: Contributors are more likely to remain active in repositories with higher levels of psychological safety. Psychological safety is positively associated with both short-term and long-term sustained participation. However, prior participation emerges as a stronger predictor of future engagement, reducing the effect of psychological safety when accounted for. Conclusions: This study introduces a scalable, data-driven approach to measuring psychological safety through pull request data and provides new empirical evidence of its relevance in sustaining participation within open-source development. I Introduction Software Engineering (SE) is a highly team-intensive discipline that requires effective collaboration, communication, and coordination among developers to successfully build and maintain software systems. Studies have shown that factors such as team diversity, cohesion, and human factors impact software development outcomes [ 1 , 2 ] . One of the key elements that fosters such teamwork is psychological safety (PS). Psychological safety is a shared belief held by members of a team that the team is safe for interpersonal risk-taking [ 3 ] . It allows individuals to speak up, ask questions, admit mistakes, and offer new ideas without fear of negative consequences. Research has shown that PS is a key factor in high-performing teams [ 3 ] . Google’s Project Aristotle examined 115 engineering teams and 65 sales teams to determine what makes a team effective [ 4 ] . Their findings revealed that teams with strong PS were more effective, as members felt comfortable sharing ideas, taking risks, and collaborating openly. Their results showed that even highly skilled employees needed a psychologically safe environment to contribute their best work. Project Aristotle also revealed that employees do not want to suppress their personalities or emotions at work. PS allows individuals to bring their entire self to work, to allow honest discussions about challenges, frustrations, and uncertainties about their work. In SE, studies suggest that PS can be indicated by open communication, constructive feedback, willingness to admit mistakes, and engagement in discussions [ 5 , 6 , 7 ] . Santana et al. highlight that software teams benefit from open communication, constructive feedback, and a culture where mistakes are seen as learning opportunities [ 5 , 6 ] . Recent work also suggests that interpersonal fairness, such as being treated with respect and dignity, is not only central to job satisfaction [ 8 ] , but also underpins PS in software teams [ 9 ] . Lenberg and Feldt examined PS in open-source communities by linking it to sustained participation measuring factors like discussion engagement and re-engagement after PR rejections [ 7 ] . GitLab emphasizes the negative effects of punishment culture, blame, and poor communication, which can reduce trust and collaboration [ 10 ] . PS has also been linked to high team performance in software teams [ 4 , 7 ] . Despite these insights, most empirical studies of PS in SE have focused on company environments and rely primarily on qualitative methods, such as interviews and surveys [ 5 , 6 , 7 , 11 , 12 ] . However, software development also takes place in open-source software (OSS) communities, which differ from traditional workplaces. OSS contributors span diverse time zones, cultures, and experience levels, and they participate voluntarily or as part of their professional work [ 13 ] . Because participation is self-directed and non-contractual, contributors are especially sensitive to the social dynamics they encounter. Prior studies have shown that motivation, task characteristics, social capital, and experiences of rejection shape contributor engagement [ 14 , 15 , 16 , 17 , 18 , 19 , 20 , 21 , 22 , 23 , 24 ] . Given this, psychological safety, the sense that it is safe to ask questions and make mistakes, may be particularly important in OSS, where contributors often decide to stay or leave based on how they are treated and whether their work is valued. In OSS development, pull requests (PRs) are central to collaboration. PRs are not only technical data but also a source of social interaction, where contributors receive feedback, negotiate changes, and seek acceptance from project maintainers [ 25 ] . These interactions can be constructive, supportive, or discouraging, and they offer insights into how teams communicate and whether a psychologically safe environment exists [ 26 ] . For this reason, we focus on code review as the collaborative activity through which PS may be reflected. We hypothesize that contributors are more likely to remain engaged when PR activities reflect higher PS. This study focuses on PR interactions as a cue for team-level PS in OSS, examining whether these observable signals are associated with the continued participation of contributors. This study takes an initial step toward empirically examining how PS during code review influences sustained participation in OSS. Specifically, we investigate the following research questions: RQ1: How is psychological safety associated with contributors’ sustained participation in a repository? We modeled the relationship between repository-level PS and sustained participation, defined as whether a contributor remains active within 12 months after their PR. The results show that contributors are more likely to remain active in repositories where the team exhibits a higher PS. RQ2: How is psychological safety associated with contributors’ future sustained participation in a repository? We then tested whether PS predicts longer-term participation, measured as participation beyond the 12-month window. We found that team-level PS measured at the time of the contributor’s PR significantly predicts future sustained participation. RQ3: How are psychological safety and contributors’ prior sustained participation associated with their future sustained participation in a repository? To further examine the relative importance of PS, we extended the model in RQ2 by including prior participation as a predictor. The findings show that prior participation is a stronger predictor of future participation, and that the effect of PS is weaker once past activity is taken into account. Through this study, we contribute a data-driven approach to operationalizing PS in OSS by developing a proxy based on PR cues. We test its association with sustained participation across three statistical models. Our findings suggest that PS serves as a meaningful signal that supports contributor sustained participation. However, for contributors who have already established a participation pattern in a project, long-term participation appears

Read the complete text