Gender Disparities in StackOverflow’s Community-Based Question Answering: A Matter of Quantity versus Quality
Maddalena Amendola, Cosimo Rulli, Carlos Castillo, Andrea Passarella, Raffaele Perego · 2026
Read Gender Disparities in StackOverflow’s Community-Based Question Answering: A Matter of Quantity versus Quality by Maddalena Amendola, Cosimo Rulli, Carlos Castillo, Andrea Passarella, Raffaele Perego (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-23063.txt.
Introduction
Maddalena Amendola and four co-authors examine gender gaps on Stack Overflow, the programmer question-and-answer site. Such platforms rate answers and expertise, ideally without bias. Yet earlier research keeps finding gender biases, raising doubts about fairness and inclusion.
Their study frames the gap as a matter of quantity versus quality. It asks whether differences lie in how much users contribute, or in how their work is judged. Knowing which side drives the gap points to the right fix for community platforms. The platform's own answer ratings frame the study, since those mechanisms claim to reward expertise regardless of who contributes.
Catalog record
| CREATOR | Maddalena Amendola, Cosimo Rulli, Carlos Castillo, Andrea Passarella, Raffaele Perego |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 65 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-23063
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Gender Disparities in StackOverflow’s Community-Based Question Answering: A Matter of Quantity versus Quality Maddalena Amendola, Cosimo Rulli, Carlos Castillo, Andrea Passarella, Raffaele Perego Abstract Community Question-Answering platforms, such as Stack Overflow (SO), are valuable knowledge exchange and problem-solving resources. These platforms incorporate mechanisms to assess the quality of answers and participants’ expertise, ideally free from discriminatory biases. However, prior research has highlighted persistent gender biases, raising concerns about the inclusivity and fairness of these systems. Addressing such biases is crucial for fostering equitable online communities. While previous studies focus on detecting gender bias by comparing male and female user characteristics, they often overlook the interaction between genders, inherent answer quality, and the selection of “best answers” by question askers. In this study, we investigate whether answer quality is influenced by gender using a combination of human evaluations and automated assessments powered by Large Language Models. Our findings reveal no significant gender differences in answer quality, nor any substantial influence of gender bias on the selection of “best answers." Instead, we find that the significant gender disparities in SO’s reputation scores are primarily attributable to differences in users’ activity levels, e.g., the number of questions and answers they write. Our results have important implications for the design of scoring systems in community question-answering platforms. In particular, reputation systems that heavily emphasize activity volume risk amplifying gender disparities that do not reflect actual differences in answer quality, calling for more equitable design strategies. 1 Introduction Community Question&Answering (CQA) platforms have become invaluable sources of knowledge and skill-sharing, evolving from platforms for exchanging information to tools for showcasing expertise. One well-known example is Stack Overflow 1 1 1 https://stackoverflow.com/ (SO), the most extensive programming community, which is not only used by developers to find answers to questions but is also used by companies to identify and recruit experts in specialized fields of computer science [ 17 ] . Recent studies have highlighted several challenges within Stack Overflow , particularly concerning inclusivity. The platform is perceived as unwelcoming to minority groups, especially women, who make up only about 10% of the user base [ 18 , 5 , 17 , 26 ] . Aggravating the problem, Stack Overflow ’s reputation system (a core metric used to evaluate and showcase user expertise) favors male users, who, on average, achieve SO-Reputation scores twice as high as their female counterparts [ 30 , 18 ] . While some studies attribute this disparity to men’s higher activity levels, others suggest that the platform’s predominantly male user base may contribute to biased voting and rating patterns [ 18 , 30 ] . As a result, women may perceive Stack Overflow as a hostile environment that discourages them from actively participating and instead encourages them to adopt strategies such as preferring to engage with posts where other women are present [ 19 , 9 ] . Online platforms that embrace and do not hinder the participation of minority groups, especially women, are necessary to foster inclusive online spaces and increase the diversity and quality of the content. This study explores the interplay between answer quality, the selection of best answers (i.e., those marked as “accepted” by askers), and perceived gender within the Stack Overflow community. It aims to identify whether the recognition of contributions and the selection of best answers is driven solely by content quality or also influenced by the perceived gender of the contributor. By addressing these questions, this work contributes to understanding bias in Stack Overflow and highlights ways in which such platforms might promote greater inclusivity. Because Stack Overflow does not collect or display gender identities of platform users, we estimate perceived gender based on usernames and country data using genderComputer 2 2 2 https://github.com/tue-mdse/genderComputer [ 29 ] , a widely adopted tool in gender bias studies. This approach, which we acknowledge has the limitation of assuming a binary gender, seems to approximate the kind of gender inference that users themselves might implicitly perform when viewing other contributors’ usernames. In other words, our focus is not on actual gender identity, which users do not declare on this platform, but instead on exploring if and how gender perceptions influence community behavior. Additionally, given their strong reasoning and coding capabilities, we leverage state-of-the-art Large Language Models (LLMs) to assess the quality of male and female answers concerning Stack Overflow questions. We first perform two human assessments to validate the methodology intended to approximate human judgment: (i) the accuracy of gender inference by genderComputer, and (ii) the assessment of answer quality for specific questions provided by male and female users. The human evaluation supports genderComputer ’s effectiveness in inferring user gender, achieving a precision of approximately 90\% for men and 80\% for women. Furthermore, by comparing the selection of the “best answer” by Stack Overflow users and LLMs to human assessments, we observe that state-of-the-art LLMs achieve alignment rates of up to 76\% , indicating good reliability in assessing answer quality. Next, we conduct a statistical analysis on relevant aggregated features (i.e., SO-Reputation, views, and downvotes) to compare men’s and women’s behaviors. This analysis reveals that men generally have higher SO-Reputation and higher average answer scores, aligning with their greater overall activity. On the other hand, when we restrict our analysis to questions with both male and female responses, women show higher activity levels, supporting the hypothesis of homophilic behavior. Finally, we compare LLM-generated evaluations with those from Stack Overflow , assessing how often a male answer is accepted over a female one that the LLM selects as the best answer, and vice versa. We find that (i) LLMs agree with Stack Overflow ’s accepted answers between 47\% and 68\% of the time; and (ii) the frequency of choosing a male-authored answer over a female-authored one, or vice versa, shows no systematic pattern, with differences in selection rates remaining below 2\% . This result highlights that the asker’s subjective preferences may also influence discrepancies in selecting the best answer. The overall analysis reveals that male and female users provide answers of equal quality, with disparities in recognition metrics primarily linked to the different activity levels and the design of the reputation system, which heavily emphasizes activity volume. The main contributions of our study are the following: • Analysis of Features-Based Gender Differences: our statistical analysis supports previously observed gender disparities, including male dominance in key features, and prior findings on women’s homophilic behavior. • LLM-Based Evaluation of Answer Quality and Selection: leveraging LLMs, we analyze answer quality differences across genders and investigate potential gender-related biases in the selection of the “best answer”. To our knowledge, this is the first study to directly compare the quality and correctness of male and female answers, while previous research primarily suggested bias based only on a statistical analysis of user features, neglecting the quality of answers. The paper is structured as follows: Section 2 reviews previous research on biases in Stack Overflow . Section 3 introduces the Stack Overflow datasets, details the gender inference methodology using genderComputer, and describes dataset partitions. Section 4 outlines our methodology, including Features-based (Section 4.1 ) and LLM-based analyses (Section 4.2 ). Section 5 presents human evaluations conducted via Amazon Mechanical Turk 3 3 3 https://www.mturk.com/ . Section