IYKYK (But AI Doesn’t): Automated Content Moderation Does Not Capture Communities’ Heterogeneous Attitudes Towards Reclaimed Language

Christina Chance, Rebecca Pattichis, Arjun Subramonian, James He, Shruti Narayanan, Saadia Gabriel, Kai-Wei Chang · 2026

Read IYKYK (But AI Doesn’t): Automated Content Moderation Does Not Capture Communities’ Heterogeneous Attitudes Towards Reclaimed Language by Christina Chance, Rebecca Pattichis, Arjun Subramonian, James He, Shruti Narayanan, Saadia Gabriel, Kai-Wei Chang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-16654.txt.

Introduction

Chance and colleagues study how auto filters handle reclaimed slurs in target groups online. Reclaimed use builds unity and identity, yet tools often confuse reclaimed with hateful uses. That failure mutes target voices. They survey users in LGBTQIA+, Black and women's groups and build a labeled usage corpus. In-group raters disagree a lot, with low agreement across questions. Without clear identity and intent signals, even in-group members may read the usage apart. Talks link spread to life stories, and judgments align poorly with the tool.

Catalog record

CREATORChristina Chance, Rebecca Pattichis, Arjun Subramonian, James He, Shruti Narayanan, Saadia Gabriel, Kai-Wei Chang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE95513
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.16654

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

IYKYK (But AI Doesn’t): Automated Content Moderation Does Not Capture Communities’ Heterogeneous Attitudes Towards Reclaimed Language Conference: ; ; DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 Thanks: Code available at https://github.com/christinachance/reclaimed-language-community-attitudes CCS: Computing methodologies Natural language processing CCS: Social and professional topics Hate speech CCS: Social and professional topics User characteristics CCS: Human-centered computing Social media Christina Chance, Rebecca Pattichis, Arjun Subramonian, James He, Shruti Narayanan, Saadia Gabriel, Kai-Wei Chang Abstract . Reclaimed slur usage is a common and meaningful practice online for many marginalized communities. It serves as a source of solidarity, identity, and shared experience. However, contemporary automated and AI-based moderation tools for online content largely fail to distinguish between reclaimed and hateful uses of slurs, resulting in the suppression of marginalized voices. In this work, we use quantitative and qualitative methods to examine the attitudes of social media users in LGBTQIA+, Black, and women communities around reclaimed slurs targeting our focus groups including the f-word, n-word, and b-word. With social media users from these communities, we collect and analyze an annotated online slur usage corpus. The corpus includes annotators’ perceptions of whether an online text containing a slur should be flagged as hate speech, as well as contextual features of the slur usage (e.g., whether derogatory, target of the slur). Across all communities and annotation questions, we observe low inter-annotator agreement, indicating substantial disagreement among in-group annotators. This is compounded by the fact that, absent clear contextual signals of identity and intent, even in-group members may disagree on how to interpret reclaimed slur usage online. Semi-structured interviews with annotators suggest that differences in lived experience and personal history contribute to this variation as well. We find poor alignment between annotator judgments and automated hate speech assessments produced by Perspective API. We further observe that certain features of a text such as whether the slur usage was derogatory and if the slur was targeted at oneself are more associated with whether annotators report the text as hate speech. Together, these findings highlight the inherent subjectivity and contextual nature of how marginalized communities interpret slurs online. They challenge assumptions that community membership alone is sufficient to establish reliable gold standards for content moderation. Results emphasize that context-sensitive approaches are critical to address online slur usage without over-moderating and further marginalizing online communities. 1. Introduction Ultimately, struggles involving the N word and other forms of toxic language become intensely personal conflicts, waged and decided within our individual selves. Alone with our thoughts, impulses, and emotions, we are at liberty to weigh the arguments and make a choice at a protective remove from the clamor and heat of Orwellian crusaders. The primacy of individual choice and the esteem with which we Americans regard freedom of expression complicates our attitudes toward the N word. — Jabari Asim (2007) ( 6 , Chapter 15, p. 229) Social media platforms are central sites for community formation, cultural expression, and political engagement ( 5 ; 32 ; 41 ; 85 ; 78 ) . By enabling interaction across space and time, these platforms allow users to organize around shared identities, experiences, and values. However, alongside these affordances, platforms rely heavily on automated and community-based content moderation to govern user behavior. For marginalized communities, these systems often introduce a different constraint: over-regulation and suppression. Prior work documents how moderation systems disproportionately police identity-specific topics, enforce colonial and Western norms, and fail to capture the social and cultural nuance of marginalized communities ( 44 ; 79 ) . One particularly salient example of this failure is the treatment of reclaimed language. Reclaimed slurs are terms historically used to oppress marginalized groups that have been reappropriated as markers of identity, solidarity, and shared experience ( 19 ; 70 ; 67 ) . While reclaimed language plays an important social role within communities, content moderation systems and hate speech detection models frequently flag these terms as abusive, reflecting a broader inability to account for context, intent, and community-specific meaning. In response, other work has attempted to improve moderation performance by increasingly incorporating annotators who share the identity of the targeted community, under the assumption that in-group membership provides more faithful judgments. However, even with more reliable labels, during training and testing models still have poor performance on differentiating slur usage in the context of toxicity detection ( 27 ) . We hypothesize that this failure stems from a deeper assumption: that marginalized communities are internally homogeneous in their beliefs, experiences, and interpretations of reclaimed language. In practice, reclaimed slur usage is deeply personal and shaped by lived experience, including familial, cultural, and environmental factors. While in-group perspectives are necessary for understanding harm, they do not guarantee consensus. Disagreement is not an anomaly in these settings but a defining feature of how reclaimed language is interpreted. This challenge is further compounded by limitations in annotation practices. Many hate speech datasets lack sufficient contextual information to capture speaker intent, audience, or relational dynamics, all of which are critical to interpreting reclaimed slur usage. As a result, reclaimed language occupies a difficult and underexplored space in hate speech detection research, sitting at the intersection of language, identity, community norms, and moderation governance. In this study, we examine how members of marginalized communities interpret reclaimed slur usage and decide whether such content should be reported as hate speech. We focus on LGBTQIA+, Black, and women communities, examining the use of the f-word, n-word, and b-word as reclaimed language within these groups. From a corpus of approximately 12,000 tweets containing slurs drawn from Twitter and existing hate speech datasets, we select 100 texts per slur for annotation. Annotators label features of each text including whether the slur is used in a reclaimed manner, the target of the slur, the surrounding context, and whether the content should be reported as hate speech. We complement this annotation task with semi-structured interviews to examine how personal experiences with reclaimed language shape their interpretations of slurs and online behavior. Through this mixed-methods approach, we interrogate assumptions of intra-community homogeneity, examine how lived experience influences interpretations of reclaimed slurs, and analyze how norms vary across different reclaimed terms. We center our analysis around the following research questions: RQ1. To what extent does disagreement within identity groups challenge prior work that treats identity as a reliable predictor of labeling decisions? RQ2. What are the most predictive features of whether someone thinks that content should be flagged as hate speech? RQ3. Does model calibration reflect real world uncertainty for flagging content? RQ4. What patterns and differences emerge in how reclaimed slurs are interpreted across different marginalized communities? Our results indicate that shared identity group does not suggest improved agreement-wise reliability, as we saw low Krippendorff’s alpha agreement for all annotation questions for each community (f-word \alpha=0.15 , n-word \alpha=0.06 , b-word \alpha=0.21 ). The agreement is only marginally higher for reporting the text as hate speech if the author of the tweet is in-group (in-group \alpha=0.18 , out-group \alpha=0.15 ) [ RQ1 ]. Features like whether the text is derogatory as well as who the target is influences the overall decision for reporting, with features

Read the complete text