NLP needs Diversity outside of ‘Diversity’
Joshua Tint · 2026
Read NLP needs Diversity outside of ‘Diversity’ by Joshua Tint (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-14595.txt.
Introduction
Tint argues that recent diversity progress in natural language processing clusters disproportionately around fairness, leaving other areas behind. Incentives, biases, and barriers, he says, push marginalized researchers out of non-fairness fields or into fairness work. Drawing on a demographic study of researchers by subfield, he offers recommendations for making every NLP area more inclusive and equitable. Breaking self-reinforcing feedback loops and easing geographical and linguistic barriers to participation stand out among his proposals.
Catalog record
| CREATOR | Joshua Tint |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 23634 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.14595
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
NLP needs Diversity outside of ‘Diversity’ Joshua Tint Abstract This position paper argues that recent progress with diversity in NLP is disproportionately concentrated on a small number of areas surrounding fairness. We further argue that this is the result of a number of incentives, biases, and barriers which come together to disenfranchise marginalized researchers in non-fairness fields, or to move them into fairness-related fields. We substantiate our claims with an investigation into the demographics of NLP researchers by subfield, using our research to support a number of recommendations for ensuring that all areas within NLP can become more inclusive and equitable. In particular, we highlight the importance of breaking down feedback loops that reinforce disparities, and the need to address geographical and linguistic barriers that hinder participation in NLP research. 1 Introduction Natural language processing, like many subfields of computer science, has long been male-dominated, and subject to severe WEIRD (Western, Educated, Industrialized, Rich, and Developed) biases 15 ; 21 . As a science studying the fundamentally social phenomenon of language, it is imperative that the researchers working in NLP reflect the world it serves. Recently, the diversity of the field of NLP has been reported by many sources to be increasing, including more women and people from varied geographic backgrounds 25 ; 19 . In the last five years, the ACL has introduced multiple initiatives aimed at improving the fairness and inclusivity of the field, including adding an new Diversity & Inclusion committee in 2020 2 . However, we find that these gains are in fact not as vast as they appear—that diversity in NLP is largely concentrated in areas such as fairness and ethics, and have largely not penetrated “core” NLP fields. We perform novel research to analyze the current state of diversity in various topics within NLP, and speculate as to why many areas have been left behind in terms of inclusion. We synthesize our research to create a set of recommendations for both improving the true diversity of NLP, and for accurately reporting diversity statistics. 1.1 What is “Diversity,” anyways? We take from Cletus a definition of diversity as “mutual respect for qualities and experiences of individuals who have different attributes” 6 . The attributes in question are not limited in scope, and may include social class, race, orientation, religion, nationality, disability, and ancestry 14 . Some categories, such as caste, are social frameworks that exist within only a few cultures 7 . For the sake of clarity, we focus on two categories, where a bias is widely observed and easily understood: gender and geography. Following Devinney’s recommendations, this paper will present a theory of gender in the interest of precision 8 . This paper recognizes the existence of nonbinary genders outside male and female, and furthermore that gender and biological sex are distinct. However, we do examine datasets which do not provide data on nonbinary researchers due to a lack of available data. 1.2 Diversity in NLP Various attempts have been made to quantify the gender diversity of the field at different points in time. Overall, NLP researchers are far more likely to be male than female. In 2020, Mohammad performed a comprehensive study of gender bias in authorship of NLP papers, estimating that approximately 29% of authors were female 23 . Unfortunately, while Mohammed provides data on gender bias by paper topic, fairness-related topics were not included in that analysis. The ACL publishes membership statistics, but the most recent dataset is as of 2017; in that year, 24% of members were female (while 70% were male and 6% were unknown). In terms of geographic diversity, there is less data available. NLP researchers are more concentrated in Europe and North America, while less concentrated in other regions. From the ACL’s 2017 dataset, 55% of authors were from the Americas, 19% were from Europe, Africa or the Middle East, and 23% were from Asia or Oceania (3% were unknown) 1 . 2 NLP’s Diversity by Topic Facing a gap in the research, we were motivated to perform a small experiment to understand how diversity in NLP varies by topic. 2.1 Methodology In order to understand the composition of researchers in a given field, we use a keyword search on ACL Anthology to identify authors that are prolific in a particular area. For each keyword, we performed an author page search using the default “Relevance” ranking algorithm. ACL uses Google’s Programmable Search algorithm to prioritize pages that recently and prevalently use the keyword, or text semantically similar to the keyword 16 . We filtered by author pages to identify authors that are prolifically and recently associated with these keywords (i.e. authors that publish often in the field and are still active). For each keyword, we identify the top 50 authors using the aforementioned “Relevance” ranking, identifying the author’s gender and geographical location. To find the author’s gender, we first check their ACL profile, then if a gender is unavailable we perform a web search to identify any profiles on a personal website or from affiliated institutions. If no gender is found, we mark the gender as “unknown,” but this was only needed in one instance. We took use of traditionally gendered pronouns, e.g. “he” or “she” as an indicator of male and female, respectively, following the method used by 30 . Pronouns such as these were often found when researchers were discussed in works by outside sources, or when researchers marked pronoun declensions in their personal biographies or profiles (e.g. “FirstName LastName, she/her”). Due to methodological and social concerns 11 , we do not use names as an indicator of gender, unlike much prior research on gender disparities in NLP 9 . Resources that were used to determine authors’ gender include the following. Ordering indicates the precedence in which we used each resource: 1. Pages about authors from their affiliated institutions, e.g. biographies or articles written about them in campus news 2. Pages about authors from other sources, such as news articles 3. Authors’ personal websites or online CVs 4. Authors’ professional profiles on career-related or blogging platforms, e.g. LinkedIn or X.com (formerly Twitter) To identify keywords pertaining to NLP fields, we use the keyword extraction performed by 23 in NLP papers . Of the top 20 keywords identified, we for filter those which are associated with a field or topic of research (for instance, eliminating “large scale”). This leaves us with 12 remaining keywords, which can be seen in Table 1 . However, this analysis had no fairness related keywords, thus we use the three identified in the ACL’s fairnes track: “fairness,” “bias,” and “ethics.” This approach was chosen over using the ACL’s tracks, as many tracks make poor keywords for searchability, e.g., work in NLP applications rarely contains the phrase “NLP Applications.” ARR topic area keywords were considered as well, but most are too narrow to represent a significant portion of the NLP community. Of the keywords we used, there was some potential for overlap, for instance between “Language Models” and “Word Embeddings,” however, no authors appeared under more than one query. We included 150 distinct authors in fairness-related categories, and 600 in non-fairness related categories. Table 1: Topic-based keywords used in measuring diversity Non-fairness-related