Modeling Communication Perception in Development Teams Using Monte Carlo Methods Conference: The 29th International Conference on Evaluation and Assessment in Software Engineering; 17–20 June, 2025; Istanbul, Türkiye Price: 15.00 ISBN: 978-1-4503-XXXX-X/18/06 CCS: Software and its engineering Collab

Marc Herrmann, Martin Obaidi, Jil Klünder · 2025

Read Modeling Communication Perception in Development Teams Using Monte Carlo Methods Conference: The 29th International Conference on Evaluation and Assessment in Software Engineering; 17–20 June, 2025; Istanbul, Türkiye Price: 15.00 ISBN: 978-1-4503-XXXX-X/18/06 CCS: Software and its engineering Collab by Marc Herrmann, Martin Obaidi, Jil Klünder (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-17610.txt.

Introduction

Marc Herrmann, Martin Obaidi, and Jil Klünder model how software teams read each other's mood in this 2025 paper. Team mood can be surveyed by reading chat text, but people read tone differently. A line that feels neutral to one developer may feel toxic to another, based on their conversational culture.

Through a simulation experiment with 45 developers, the authors build an early math model. It estimates how much agreement within a subset of a team is needed to reflect the whole team's agreement. For an average team of seven, leaving out even one member can misstate the mood, they find. They recommend surveying every developer when team mood is assessed.

Catalog record

CREATORMarc Herrmann, Martin Obaidi, Jil Klünder
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-17610

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Modeling Communication Perception in Development Teams Using Monte Carlo Methods Conference: The 29th International Conference on Evaluation and Assessment in Software Engineering; 17–20 June, 2025; Istanbul, Türkiye Price: 15.00 ISBN: 978-1-4503-XXXX-X/18/06 CCS: Software and its engineering Collaboration in software development CCS: Software and its engineering Programming teams CCS: Computing methodologies Modeling and simulation CCS: Mathematics Subject Classification (2020) 68N30; 65C05; 62J02 Marc Herrmann, Martin Obaidi, Jil Klünder Abstract . Software development is a collaborative task involving diverse development teams, where toxic communication can negatively impact team mood and project success. Mood surveys enable the early detection of underlying tensions or dissatisfaction within development teams, allowing communication issues to be addressed before they escalate, fostering a positive and productive work environment. The mood can be surveyed indirectly by analyzing the text-based communication of the team. However, emotional subjectivity leads to varying sentiment interpretations across team members; a statement perceived neutrally by one developer might be seen as problematic by another developer with a different conversational culture. Early identification of perception volatility can help prevent misunderstandings and enhance team morale while safeguarding the project. This paper analyzes the diversity of perceptions within arbitrary development teams and determines how many team members should report their sentiment to accurately reflect the team’s mood. Through a Monte Carlo experiment involving 45 developers, we present a preliminary mathematical model to calculate the minimum agreement among a subset of developers based on the whole team’s agreement. This model can guide leadership in mood assessment, demonstrating that omitting even a single member in an average-sized 7-member team can misrepresent the overall mood. Therefore, including all developers in mood surveying is recommended to ensure a reliable evaluation of the team’s mood. 1. Introduction Software projects require teamwork and social interactions in order to be successfully completed ( Kraut and Streeter 1995 ; Zaman et al. 2019 ) . Open and respectful communication fosters a positive work environment. It encourages trust, collaboration, and a sense of belonging within the team ( Awotunde et al. 2020 ) . Timely and clear communication helps address and resolve conflicts, misunderstandings, and differences in opinions before they escalate. When communication is perceived as clear, open, and effective, team members feel more connected, supported, and engaged ( DeMarco and Lister 2013 ) . This can lead to better collaboration, higher morale, and a more cohesive work environment ( Schneider et al. 2018 ) . That is, if the team communicates in a friendly way and is generally in a good mood, the project is more likely to be finished successfully ( Graziotin et al. 2014 ; Graziotin et al. 2015 ; Schneider et al. 2018 ) . Poor communication on the other hand can lead to misunderstandings, frustration, and a lack of clarity about responsibilities. This can result in duplicated efforts, missed deadlines, and lower quality outcomes ( Stapel and Schneider 2014 ) . Negative communication can breed a toxic work environment in software projects ( Miller et al. 2022 ) , where conflicts go unresolved, and team members feel undervalued or unsupported, which can lead to far-reaching consequences such as burnout ( Tulili et al. 2022 ) . Such symptoms are sometimes described as community smells ( Caballero-Espinosa et al. 2023 ) , i.e., suboptimal social patterns and organizational structures within a development team that can negatively impact collaboration, communication, and ultimately the software quality. To mitigate these problems, project leaders can survey the mood of the team by interviews with individual team members. However, this may be ineffective if the mood of the developers surveyed does not reflect that of the rest. Another technique to mitigate these problems is the application of sentiment analysis for software engineering (hereinafter SA4SE), where a software analyzes the text-based communication within collaborative software development environments and determines whether a statement’s sentiment polarity is positive , negative , or neutral ( Medhat et al. 2014 ; Obaidi and Klünder 2021 ) . This way, a project leader gathers information on the amount of negative communication, assuming that this is an indicator for problems or points to the need for interventions ( Herrmann and Klünder 2021 ; Herrmann et al. 2022a ; Schroth et al. 2022 ; Specht et al. 2024 ) . However, a recent study among software developers ( Herrmann et al. 2022b ) has shown that the perception of developers differs remarkably from the predefined sentiment polarities in SA4SE-datasets. While some developers perceive a statement as positive , others perceive it as neutral or even as negative ( Herrmann et al. 2025 ) . The significant variability in perceptions among software developers prompts an inquiry into whether excessive variability exists within arbitrary software development teams and how many team members are necessary to accurately represent the overall mood trend, e.g., for surveying the mood of selected developers or calibrating a sentiment analysis approach to the teams’ communication. Despite its critical nature, communication within software development teams often suffers due to various factors such as diversity, varying levels of experience and expertise, and most importantly differing perceptions of communication ( Herrmann et al. 2025 ) among team members. However, hardly any study examines the differences in the perceptions of developers, let alone attempt to model them formally. In this paper, we want to investigate how volatile the agreement towards perception of software project communication among teams of developers is. Further, we want to find out how many developers from a larger team need to be surveyed in order for project managers to elicit the mood of the team. We perform a Monte Carlo experiment ( Paxton et al. 2001 ) based on a developer sentiment survey study conducted in 2021 ( Obaidi et al. 2022a ) . We modeled the perceptions of 45 software developers with varying levels of experience and skills with respect to their agreement. We provide the following key contributions: (1) We compute numerous arbitrary draws to calculate deviations to the agreement of a group of developers by bootstrapping a random subset of developers. These deviations can then be used to determine the volatility and the expected intervals of agreement of perceived communication in software projects. (2) Furthermore, we provide a preliminary mathematical model to calculate the minimum agreement of a subset of raters when compared to the agreement of the whole set. (3) Lastly, we recommend best practices about the number of sufficient raters needed to match the perception of an average sized development team based on our findings, which imply how many developers should be surveyed for mood analysis. Outline. The rest of the paper is structured as follows: In Section 2 , we highlight related research and background details. Section 3 explains the design of the experiment, including our data and methodology. The results are presented in Section 4 and discussed in Section 5 . The paper is summarized in Section 6 . 2. Background and Related Work This background section reviews key research that reveals the intricate interplay of cultural, demographic, and personality factors that influence emotional perception, and further the methodological factors in mood and sentiment analysis within software engineering. They advocate for a multi-faceted approach that considers these variables to accurately interpret team emotions, thereby potentially enhancing collaborative

Read the complete text