Auditing Political Exposure Bias: Algorithmic Amplification on Twitter/ 𝕏 \mathbb{X} During the 2024 U.S. Presidential Election
Jinyi Ye, Luca Luceri, Emilio Ferrara · 2024
Read Auditing Political Exposure Bias: Algorithmic Amplification on Twitter/ 𝕏 \mathbb{X} During the 2024 U.S. Presidential Election by Jinyi Ye, Luca Luceri, Emilio Ferrara (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2411-01852.txt.
Description
Abstract . Approximately 50% of tweets in 𝕏 \mathbb{X} ’s user timelines are personalized recommendations from accounts they do not follow. This raises a critical question: What political content are users exposed to beyond their established networks, and what implications does this have for democratic discourse online?
Catalog record
| CREATOR | Jinyi Ye, Luca Luceri, Emilio Ferrara |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2411-01852
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Auditing Political Exposure Bias: Algorithmic Amplification on Twitter/ 𝕏 \mathbb{X} During the 2024 U.S. Presidential Election Jinyi Ye, Luca Luceri, Emilio Ferrara Abstract . Approximately 50% of tweets in 𝕏 \mathbb{X} ’s user timelines are personalized recommendations from accounts they do not follow. This raises a critical question: What political content are users exposed to beyond their established networks, and what implications does this have for democratic discourse online? In this paper, we present a six-week audit of 𝕏 \mathbb{X} ’s algorithmic content recommendations during the 2024 U.S. Presidential Election by deploying 120 sock-puppet monitoring accounts to capture tweets from their personalized “For You” timelines. Our objective is to quantify out-of-network content exposure for right- and left-leaning user profiles and assess any potential inequalities and biases in political exposure. Our findings indicate that 𝕏 \mathbb{X} ’s algorithm skews exposure toward a few high-popularity accounts across all users, with right-leaning users experiencing the highest level of exposure inequality. Both left- and right-leaning users encounter amplified exposure to accounts aligned with their own political views and reduced exposure to opposing viewpoints. Additionally, we observe that new accounts experience a right-leaning bias in exposure within their default timelines. Our work contributes to understanding how content recommendation systems may induce and reinforce biases while exacerbating vulnerabilities among politically polarized user groups. We underscore the importance of transparency-aware algorithms in addressing critical issues such as safeguarding election integrity and fostering a more informed digital public sphere. Conference: Anonymous Conference; Month Day–Day, 2025; Location Proceedings of the Anonymous Conference, Month Day–Day, 2025, Location CCS: Human-centered computing Empirical studies in collaborative and social computing CCS: Information systems Social networks 1. Introduction During the 2024 U.S. Presidential Election, social media platforms like \mathbb{X} (formerly Twitter) play a pivotal role as hubs for political information and public discourse. However, the information users encounter on \mathbb{X} is increasingly curated by algorithmic recommendation systems that personalize content in their “For You” timelines. As of this writing, \mathbb{X} ’s “For You” timeline typically consists of 50% in-network tweets (i.e., from accounts a given user follows) and 50% out-of-network tweets (i.e., from accounts that user does not directly follow)—an increase from the 37% out-of-network tweets in 2023 ( Bouchaud et al., 2023 ) . How does \mathbb{X} ’s algorithm select relevant tweets from outside a user’s network? In 2023, Twitter partially open-sourced its recommendation algorithm, revealing that out-of-network recommendations are sourced through engagement and follow graphs, ranked by a neural network, and refined with heuristics and filters ( Twitter, Inc., 2023 ) . Despite the increasing prominence of out-of-network tweets in user timelines, much remains unknown about their composition and nature. While prior research has demonstrated amplification of certain political groups and media sources within users’ in-network tweets, the extent to which such biases extend to out-of-network recommendations is unclear. In contexts like the 2024 U.S. Election, examining this issue is essential to understanding how algorithms shape the consumption of online political content and influence users’ perspectives. Research on \mathbb{X} ’s algorithmic auditing faces a critical challenge in analyzing out-of-network content: While many studies assess amplification by comparing personalized timelines with reverse-chronological timelines as a baseline—where tweets appear in the order they were posted without algorithmic effects ( Bartley et al., 2021 ; Bartley et al., 2023 ; Huszár et al., 2022 ; Bouchaud et al., 2023 ; Wang et al., 2024 ) , out-of-network tweets lack a reverse-chronological baseline as users do not follow the authors of those tweets, making it challenging to quantitatively measure exposure bias. To address this limitation, we utilize a “sock-puppet audit,” a study design that deploys artificial user accounts with controlled features to systematically capture and analyze platform recommendations ( Bartley et al., 2021 ; Chen et al., 2020 ; Bandy and Diakopoulos, 2021 ; Hosseinmardi et al., 2024 ) . Specifically, we introduce a self-constructed baseline using accounts that follow a politically balanced social media diet, enabling direct comparisons with other manually-created partisan user accounts. This approach is particularly well-suited to studying out-of-network exposure patterns because it allows us to observe algorithmic behavior without the interference of the variations of user behaviors or connections. Furthermore, previous sock-puppet audits on \mathbb{X} are often constrained by small sample sizes (fewer than 10 accounts) and restricted tweet collection in terms of both quantity and frequency ( Bandy and Diakopoulos, 2021 ; Bartley et al., 2021 ; Chen et al., 2020 ) , limiting the generalization and robustness of their findings. Our audit aim to implement a more comprehensive data collection strategy, enabling us to systematically observe and analyze algorithmic behaviors on a much larger scale. Contribution of this work In this study, we deploy 120 sock-puppet accounts distributed into four groups across the political spectrum—left-leaning, right-leaning, balanced, and neutral—collecting a robust dataset of over 9 million tweets over six weeks from October to November 2024. Within this framework, we systematically evaluate potential exposure biases, such as popularity bias and algorithmic (de-)amplification across account groups. The contributions of this work can be summarized as follows: • We quantify algorithmic exposure to out-of-network content for users with varying political alignments during the 2024 U.S. Election through a sock-puppet audit of \mathbb{X} ’s personalized timelines. • We propose a methodology for evaluating out-of-network (political) exposure biases by creating a baseline using politically balanced accounts. We find that \mathbb{X} skews exposure toward a few high-popularity accounts for all users, with right-leaning users experiencing the most inequality. Both left- and right-leaning users encounter amplified exposure to accounts aligned with their own political stance and reduced exposure to opposing viewpoints. Additionally, neutral accounts who do not follow anybody (akin to a newly-registered user account) show a default right-leaning bias in content exposure. Our findings reveal how content recommendation systems can influence and amplify biases, potentially increasing vulnerabilities within politically polarized user groups. This work underscores the urgent need for transparent algorithms to safeguard the integrity of online discourse and the sovereignty of elections. 2. Background & Research Questions 2.1. Related Work The impact of algorithmic content curation on political discourse in social media has been a major focus of research and public debate. Previous studies consistently show that \mathbb{X} ’s algorithm amplifies political biases and prioritizes high-engagement content, including emotionally charged, toxic, and low-credibility information ( Huszár et al., 2022 ; Bouchaud et al., 2023 ; Bandy and Diakopoulos, 2021 ; Chen et al., 2020 ; Bartley et al., 2021 ; Corsi, 2024 ) . Researchers have used methods including randomized experiments, sock-puppet audits, crowdsourced audits, and observational data to study \mathbb{X} ’s algorithmic effects. Some have found that Twitter’s algorithms tend to amplify content from right-leaning media sources and politicians more than their left-leaning counterparts ( Huszár et al., 2022 ; Graham and Andrejevic, 2024 ) . Other studies report increased exposure to ideologically aligned friends ( Bouchaud et al., 2023 ; Bandy and Diakopoulos, 2021 ) , but decreased exposure to external links ( Wang et al., 2024 ; Bandy and Diakopoulos, 2021 ) . Studies also observe increased low-credibility content in algorithmic timelines ( Corsi, 2024 ) , with right-leaning users experiencing higher exposure to such content ( Chen et al., 2020 ) . Although algorithms are often flagged for promoting ideological