Take the Power Back: Screen-Based Personal Moderation Against Hate Speech on Instagram Conference: Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems; April 13–17, 2026; Barcelona, Spain Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI ’26), April 13–17, 2026, Barcelona, Spain DOI: 10.1145/3772318.3790748 ISBN: 979-8-4007-2278-3/2026/04 CCS: Human-centered computing Empirical studies in collaborative and social computing CCS: Human-centered computing Empirical studies in HCI

Anna Ricarda Luther, Hendrik Heuer, Stephanie Geise, Sebastian Haunss, Andreas Breiter · 2026

Read Take the Power Back: Screen-Based Personal Moderation Against Hate Speech on Instagram Conference: Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems; April 13–17, 2026; Barcelona, Spain Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI ’26), April 13–17, 2026, Barcelona, Spain DOI: 10.1145/3772318.3790748 ISBN: 979-8-4007-2278-3/2026/04 CCS: Human-centered computing Empirical studies in collaborative and social computing CCS: Human-centered computing Empirical studies in HCI by Anna Ricarda Luther, Hendrik Heuer, Stephanie Geise, Sebastian Haunss, Andreas Breiter (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-01187.txt.

Introduction

Luther and four colleagues ask Instagram users facing hate speech where they want user-run filters and which features matter most. A three-wave Delphi study with 40 people finds chat and feed-curated screens top the list. Users prize undo power and watch across screens, while input-based, content-specific, and highly auto features vary more by screen, yielding design tips for user-run filters.

Catalog record

CREATORAnna Ricarda Luther, Hendrik Heuer, Stephanie Geise, Sebastian Haunss, Andreas Breiter
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE110704
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.01187

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Take the Power Back: Screen-Based Personal Moderation Against Hate Speech on Instagram Conference: Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems; April 13–17, 2026; Barcelona, Spain Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI ’26), April 13–17, 2026, Barcelona, Spain DOI: 10.1145/3772318.3790748 ISBN: 979-8-4007-2278-3/2026/04 CCS: Human-centered computing Empirical studies in collaborative and social computing CCS: Human-centered computing Empirical studies in HCI Anna Ricarda Luther, Hendrik Heuer, Stephanie Geise, Sebastian Haunss, Andreas Breiter Abstract . Hate speech remains a pressing challenge on social media, where platform moderation often fails to protect targeted users. Personal moderation tools that let users decide how content is filtered can address some of these shortcomings. However, it remains an open question on which screens (e.g., the comments, the reels tab, or the home feed) users want personal moderation and which features they value most. To address these gaps, we conducted a three-wave Delphi study with 40 activists who experienced hate speech. We combined quantitative ratings and rankings with open questions about required features. Participants prioritized personal moderation for conversational and algorithmically curated screens. They valued features allowing for reversibility and oversight across screens, while input-based, content-type specific, and highly automated features are more screen specific. We discuss the importance of personal moderation and offer user-centered design recommendations for personal moderation on Instagram. 1. Introduction Hate speech is a well-documented issue on social media ( 12 ; Casta~no-Pulgarín2021Internet ; 13 ) , widely affecting social media users ( 37 ) . In this paper, we operationalize hate speech as any form of communication that disparages individuals or groups based on characteristics such as race, gender, or religion ( 83 ) . Exposure to hate speech has been shown to have a silencing effect, deterring users from participating in public discourse or disclosing parts of their identities. But the consequences of hate speech online extend beyond digital spaces, posing real-world risks to mental and physical well-being ( 70 ; 78 ) . The scope and gravity of this impact highlight the pressing need for effective strategies to mitigate hate speech and foster safer online environments. Existing moderation systems predominantly employ platform moderation (i.e., moderation decisions apply to the entirety of the platform) ( 33 ) , which has been shown to fail to effectively combat hate speech ( 12 ) . Automated hate speech detection, which is an integral part of platform moderation ( 33 ) , often lacks the context necessary to determine whether a statement is abusive ( 24 ) resulting in over- and undermoderation ( 36 ) , particularly for content from marginalized users ( 24 ) . Users themselves are often aware of these contexts. Personal moderation tools can empower users to give this context, addressing this shortcoming of automated platform moderation. Personal moderation is described as tools that empower users to influence what content they see by setting their preferences e.g., through word filter or sensitivity controls, which exclusively apply to their accounts ( 45 ) . In this way, personal moderation has the potential to create safer, more inclusive online spaces that respect diverse cultural and personal norms ( 31 ; 38 ) . Previous work yielded insights on user preferences and design considerations for personal moderation tools ( 42 ; 44 ; 38 ) . One issue previous work identified is that personal moderation tools need to match the moderation goals of the users in granularity of control. More specifically, their findings suggest that users might have different personal moderation needs for different parts of social media apps ( 44 ) . Building on this perspective, we contribute an empirical investigation of whether and how personal moderation needs vary between distinct parts of social media. To systematically investigate these differences, we introduce the theoretical construct “screens” (e.g., the comments section, the home feed, or the reels tab). Since personal moderation needs can be reflected in the functions users require ( 44 ) , we further examine personal moderation features across screens. We operationalize the term personal moderation features as discrete user interface elements that users can configure in order to avoid harmful content on their individual accounts. We address the following research questions (RQs): • Which Screens Should Provide Personal Moderation For Activists Targeted by Hate Speech? (RQ1) • What Personal Moderation Features Are Requested Per Screen by Activists Targeted by Hate Speech? (RQ2) To answer these research questions, we conducted a three-wave Delphi study with 40 activists living in Germany who experienced hate speech. We recruited activists because their visible engagement with political issues places them at heightened risk of encountering hate speech ( 54 ) , and many belong to marginalized groups that are disproportionately targeted by hate speech ( 10 ) . Their extensive and often unavoidable reliance on social media to amplify their messages further increases both their exposure and the stakes of managing harassment ( 58 ) . We focused on Instagram because it is the most widely used social media platform in Germany ( 73 ) , particularly among younger and activist users ( 73 ; 48 ) . Prior research has also documented challenges with hate speech on Instagram, making it a relevant and high-exposure environment for studying personal moderation needs ( 56 ) . We find that personal moderation options are assessed as particularly important for screens representing conversational and algorithmically curated spaces. Although features allowing for oversight and reversibility are requested for all screens, there are also differences in the features requested for each screen. Input-based features are more frequently requested for conversational screens, where the kind of harm is known. For algorithmically curated spaces, features that are specific to different content types and features that rely heavily on automation while requiring minimal user configuration are requested. We provide the first empirically grounded account of the screens for which activists targeted by hate speech want personal moderation (RQ1). For each screen we provide the features that are considered most important (RQ2). In the discussion, we translate the identified user needs into concrete design recommendations for personal moderation tools. Together, these contributions advance research on personal moderation on social media and provide actionable pathways for designing moderation practices that are both scalable and responsive to the needs of those affected by hate speech. 2. Background 2.1. Different Types of Moderation on Social Media We situate this work within existing scholarship that differentiates between different moderation approaches. 44 ( ( 44 ) ) categorized moderation approaches on social media based on the scope of the respective moderation decision, resulting in the following three categories: platform moderation (moderation decisions that apply to the entirety of the platform), community moderation (moderation decisions that apply to specific communities), and personal moderation (moderation decisions that apply to the view of an individual user). They further distinguish between moderation decisions that are based on the content (e.g., removing content because it contains a specific keyword) and moderation decisions that are based on the account (e.g., banning a user because they repeatedly violated platform guidelines) ( 44 ) . Given that community moderation possibilities on Instagram are limited to individual channels of content creators ( 41 ) , in the following,

Read the complete text