Community Notes are Vulnerable to Rater Bias and Manipulation

Bao Tran Truong, Siqi Wu, Alessandro Flammini, Filippo Menczer, Alexander J. Stewart · 2025

Read Community Notes are Vulnerable to Rater Bias and Manipulation by Bao Tran Truong, Siqi Wu, Alessandro Flammini, Filippo Menczer, Alexander J. Stewart (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-02615.txt.

Introduction

Bao Tran Truong, Siqi Wu, Alessandro Flammini, Filippo Menczer, and Alexander Stewart stress-test the algorithm behind Community Notes, the crowdsourced fact-checking system used on social media. Notes become visible when raters who usually disagree rate them helpful, a design meant to resist bias. The authors built simulations with realistic rater and note behaviour and measured how often the algorithm publishes genuinely helpful notes versus unhelpful ones.

The results are uncomfortable. A substantial fraction of truly helpful notes never surface, and the system is highly sensitive to rater biases such as polarisation and in-group preference. Worse, a coordinated minority of bad raters, between five and twenty percent of the pool, can strategically bury targeted helpful notes, in effect censoring reliable information. The authors conclude that crowdsourced moderation's scalability comes with a fragility that platforms need stronger safeguards against.

Catalog record

CREATORBao Tran Truong, Siqi Wu, Alessandro Flammini, Filippo Menczer, Alexander J. Stewart
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE66 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-02615

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Community Notes are Vulnerable to Rater Bias and Manipulation Bao Tran Truong, Siqi Wu, Alessandro Flammini, Filippo Menczer, Alexander J. Stewart Abstract Social media platforms increasingly rely on crowdsourced moderation systems like Community Notes to combat misinformation at scale. However, these systems face challenges from rater bias and potential manipulation, which may undermine their effectiveness. Here we systematically evaluate the Community Notes algorithm using simulated data that models realistic rater and note behaviors, quantifying error rates in publishing helpful versus unhelpful notes. We find that the algorithm suppresses a substantial fraction of genuinely helpful notes and is highly sensitive to rater biases, including polarization and in-group preferences. Moreover, a small minority (5–20%) of bad raters can strategically suppress targeted helpful notes, effectively censoring reliable information. These findings suggest that while community-driven moderation may offer scalability, its vulnerability to bias and manipulation raises concerns about reliability and trustworthiness, highlighting the need for improved mechanisms to safeguard the integrity of crowdsourced fact-checking. Keywords— Community Notes, Social Media Moderation, Crowdsourcing, Rater Bias, Polarization, Algorithm Manipulation Over the past decade, online platforms have increasingly struggled with how to moderate misinformation at scale. Traditional approaches, such as professional fact-checking and content labeling, have been shown to effectively reduce the spread of false information and increase the accuracy of user beliefs [ 15 , 14 ] . Despite this demonstrated effectiveness, many major platforms have recently moved away from expert-driven methods in favor of “community-based” moderation systems. The most prominent demonstration of this shift is Community Notes, a crowdsourced approach to fact-checking introduced by Twitter (now X) as Birdwatch, and later expanded under its current name [ 33 ] . Community Notes allows platform users to collaboratively identify and contextualize potentially misleading content. Its open-source algorithm for selecting and publishing “helpful” notes is designed to promote consensus across ideological lines [ 32 ] , representing an effort to balance transparency, participation, and perceived fairness. Following X, other platforms, including Facebook and TikTok, have begun to replace traditional fact-checking programs with versions of Community Notes, at least in the U.S. context. Both have adopted the same core algorithm as X, often citing its purported ability to reduce bias and increase user trust. While empirical support for the claim of reduced bias remains limited, some studies do suggest that community-driven annotations can increase user confidence in moderation outcomes [ 12 ] . As of July 2025, TikTok reported more than 80,000 contributors to its Footnotes program [ 24 ] , while Meta announced that its Community Notes initiative had generated around 15,000 notes from 70,000 users since its March 2025 launch [ 26 ] . This enthusiasm reflects broader optimism about the scalability and effectiveness of crowdsourced fact-checking. Early research finds that community fact-checkers can achieve accuracy comparable to professional fact-checkers [ 1 , 18 ] , and that the approach may be more scalable and cost-effective than expert-based models [ 20 , 27 ] . Exposure to community-authored corrections seems less likely to provoke disengagement than individual misinformation tagging [ 17 ] , even though layperson volunteers are perceived as less legitimate than experts [ 21 ] . Some studies suggest that when shown to users, Community Notes reduce engagement with and diffusion of false or misleading content [ 11 , 16 , 28 ] . There is weak consensus on this finding, however, especially when considering engagement with misinformation in the early stage of diffusion [ 10 ] and misinformation originating from influential users [ 25 ] . The performance of community moderation in real-world conditions is uneven. Crowdsourcing introduces challenges of coverage, timeliness, and reliability. Volunteer contributors may self-select content that reflects their interests or ideological motivations, and may draw on inconsistent sources when writing notes [ 2 , 27 ] . These limitations, combined with platform-level visibility constraints, raise concerns about whether community moderation can provide an effective large-scale substitute for traditional fact-checking [ 4 ] . Visibility is a central challenge. According to one study [ 9 ] , 74% of misleading posts on X that had accurate notes were never shown to users. Investigations have found that most users never encounter published notes at all [ 6 ] . When notes are shown, they receive much lower exposure than the corresponding posts [ 9 , 6 , 28 ] . An explanation for this gap in visibility and impact is the delay with which notes appear when they are published. Between January 2021 and January 2025, only 13.55% of posts with at least one proposed note on X received a “helpful” note, while 87.7% remained in the “Needs More Ratings” category. Of all notes submitted, just 8.3% achieved “helpful” status and were published, with an average delay of 26 hours [ 22 ] — well past the period of peak engagement on most platforms [ 8 , 31 ] . Meta reports similar figures, with only about 6% of notes ultimately published [ 26 ] . Trends on X further suggest a decline in published notes. The share of “helpful” notes fell from a peak of 13.1% in March 2024 to 8.2% in May 2025. At the same time, contributor retention is decreasing: the proportion of authors remaining active six months after writing their first note dropped from 63% in early 2023 to 44% in late 2024. Because contributors whose notes are never published are less likely to continue participating, this dynamic raises concerns about the long-term sustainability of the system [ 3 ] . Beyond questions of efficacy, scholars have highlighted deeper risks in replacing expert fact-checking with crowdsourced moderation. These include the potential for manipulation, the erosion of epistemic authority, and the emergence of politically motivated behavior within crowdsourced systems [ 4 ] . In polarized online environments, where users often lack incentives for cross-ideological collaboration, community-driven moderation may reflect or even amplify partisan bias [ 35 ] . Reports of politically motivated down-rating [ 13 ] and evidence that contributors are often motivated by correcting ideological opponents [ 2 ] suggest that the aspiration toward neutrality may be difficult to sustain in practice. These developments position community moderation at the center of a critical debate: whether crowdsourced intelligence can serve as a trustworthy, scalable, and robust alternative to expert-led content moderation. Here we contribute to this debate by analyzing the vulnerabilities of community moderation to rater bias and manipulation. Since neither Meta nor TikTok provides access to their data or algorithms, we use X’s open-source Community Notes algorithm. By feeding it with simulated ratings that model reasonable assumptions about notes and raters, we can systematically and precisely quantify different kinds of errors, such as helpful notes that are not published and published notes that are not helpful. This analysis reveals that the Community Notes algorithm is highly sensitive to rater biases, such as the observed tendency to rate notes that are not aligned with one’s political views. The algorithm is also vulnerable to manipulation: a small fraction of bad raters can easily suppress helpful notes so that they are never published. Results Experimental design We focus on the efficacy of the Community Notes algorithm as described in Wojcik et al. [ 32 ] and in the release notes accompanying

Read the complete text