PolitiSky24 : U.S. Political Bluesky Dataset with User Stance Labels

Peyman Rostami, Vahid Rahimzadeh, Ali Adibi, Azadeh Shakery · 2025

Read PolitiSky24 : U.S. Political Bluesky Dataset with User Stance Labels by Peyman Rostami, Vahid Rahimzadeh, Ali Adibi, Azadeh Shakery (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-07606.txt.

Introduction

Peyman Rostami and co-authors (2025) release PolitiSky24, a data set of political stances from the social platform Bluesky. Stance detection asks which side a text takes toward a target. Most older sets label single posts on older platforms. This one labels whole users, using their full posting history, which gives a fuller picture. The set covers the 2024 United States presidential election. It holds more than sixteen thousand user-target pairs.

Each entry carries engagement data, the interaction graph, and the user's posts. Labels came from a pipeline mixing search methods with large language models. That pipeline reached about 81 percent accuracy and records its reasons for each label. The authors stress transparency: researchers can audit why a user was tagged. They present the set as open infrastructure for studying political talk on a new platform, at the level of people rather than posts.

Catalog record

CREATORPeyman Rostami, Vahid Rahimzadeh, Ali Adibi, Azadeh Shakery
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-07606

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

PolitiSky24 : U.S. Political Bluesky Dataset with User Stance Labels Peyman Rostami, Vahid Rahimzadeh, Ali Adibi, Azadeh Shakery Abstract Stance detection identifies the viewpoint expressed in text toward a specific target, such as a political figure. While previous datasets have focused primarily on tweet-level stances from established platforms, user-level stance resources—especially on emerging platforms like Bluesky—remain scarce. User-level stance detection provides a more holistic view by considering a user’s complete posting history rather than isolated posts. We present the first stance detection dataset for the 2024 U.S. presidential election, collected from Bluesky and centered on Kamala Harris and Donald Trump. The dataset comprises 16,044 user-target stance pairs enriched with engagement metadata, interaction graphs, and user posting histories. PolitiSky24 was created using a carefully evaluated pipeline combining advanced information retrieval and large language models, which generates stance labels with supporting rationales and text spans for transparency. The labeling approach achieves 81% accuracy with scalable LLMs. This resource addresses gaps in political stance analysis through its timeliness, open-data nature, and user-level perspective. The dataset is available at https://doi.org/10.5281/zenodo.15616911 1 Introduction Stance detection is the task of automatically determining the viewpoint expressed in a text toward a specific target, such as an entity, topic, or claim Mohammad et al. 2016 . This task serves as a vital component of many NLP tasks, such as fake news detection, fact-checking, rumor verification and user profiling Rahimzadeh et al. 2025 . Furthermore, it supports applications like identifying public opinion, tracking sentiment toward politicians or products, and understanding user attitudes in social media conversations Zhang et al. 2024 ; Zarharan et al. 2024 . Figure 1: An illustrative example of the user stance with metadata in PolitiSky24. Research in stance detection spans multiple domains, each with its unique challenges and characteristics. In the financial domain, datasets like WT-WT Conforti et al. 2020 have focused on mergers and acquisitions between major companies. Health-related datasets emerged during the COVID-19 pandemic, capturing positions toward public health figures and policies Glandt et al. 2021 . General-purpose datasets such as VAST Allaway and McKeown 2020 and EZ-STANCE Zhao and Caragea 2024 have addressed broader topics spanning education, entertainment, and environmental protection. However, the political domain, particularly U.S. politics, has attracted the most attention due to its societal impact and complexity. Numerous datasets have been developed focusing on political figures and events, with a significant emphasis on the 2016 and 2020 U.S. presidential elections Kawintiranon and Singh 2021 ; Li et al. 2021a ; Mohammad et al. 2017 ; Mohammad et al. 2016 . To the best of our knowledge, no datasets currently exist for the 2024 election. Twitter (now X) has traditionally been the primary source for stance detection datasets, but recent API restrictions have severely limited access to public data, hampering research efforts. Additionally, most existing datasets focus on individual post-level analysis, overlooking valuable contextual information from users’ complete posting histories. Examining stance at the user-level provides a more comprehensive understanding of political viewpoints by considering broader expression patterns rather than isolated posts. Furthermore, while alternative platforms like Bluesky offer decentralized architectures and greater data accessibility, they remain largely unexplored for stance detection dataset creation. To address these limitations, we present a comprehensive stance dataset focused on the 2024 US presidential candidates, specifically targeting Kamala Harris and Donald Trump. Our contribution includes 16,044 user-target stance pairs with rich metadata and network information (See Figure 1 ). The dataset was created through a meticulously configured pipeline that first filters users with a hashtag-based algorithm to identify relevant accounts, then employs LLMs to determine stance based on high-quality chunks of user history. We developed carefully crafted validation datasets to evaluate different components, testing various embedding models for context retrieval and LLMs for stance labeling. Our thoroughly evaluated pipeline provides stance labels with reasoning explanations, relevant text spans, and complete network structures of users’ interactions, namely repost, like and following. The dataset enables analysis of political discourse on emerging platforms while offering insights into LLM capabilities for understanding complex political communication. The remainder of this paper is organized as follows: Section 2 reviews related work in both stance detection and studies of the Bluesky platform. Section 3 describes our Bluesky dataset, detailing the network structure and data collection methodologies that resulted in our US political dataset. Section 4 presents our stance labeling pipeline and the resulting stance dataset. Section 5 provides experimental results and comprehensive error analysis of LLM performance in stance detection and presents key insights derived from our dataset. Finally, Section 6 concludes the paper and discusses future research directions. 2 Related Work Bluesky Social Network. Bluesky is a decentralized social network that has recently drawn research attention. Studies have examined its architecture Kleppmann et al. 2024 and curated datasets to analyze user activity, network diversity, content moderation, and interaction patterns Balduf et al. 2024 ; Jeong et al. 2024 ; Quelle and Bovet 2025 ; Failla and Rossetti 2024 . Notably, analyses suggest that Bluesky currently has a predominantly left-leaning user base Quelle and Bovet 2025 . However, it has not yet been explored for downstream tasks such as stance detection. Stance Detection. Stance detection aims to identify a user’s position toward a specific target and is widely studied across domains, such as politics Li et al. 2021a , public health Glandt et al. 2021 , and multi-topic datasets Mohammad et al. 2016 . For example, Mohammad et al. 2016 introduced a dataset covering multiple topics, including U.S. political figures, and Conforti et al. 2020 investigated cross-domain stance detection, highlighting domain shift challenges. Recent efforts have also focused on zero-shot stance detection (ZSSD), where the target is unseen during model training. For example, EZ-STANCE Zhao and Caragea 2024 introduced a large-scale English ZSSD dataset containing 47,316 annotated text-target pairs, covering both claim- and noun-phrase-based targets across diverse domains. Despite these advances, existing work primarily focuses on post-level stance detection within centralized platforms, with limited attention to user-level stance detection on decentralized networks like Bluesky. Furthermore, to the best of our knowledge, there are currently no stance detection datasets centered on key figures or targets from the 2024 U.S. presidential election. 3 Bluesky Dataset on U.S. Politics To create a dataset capturing Bluesky users’ stances toward the main candidates in the 2024 U.S. presidential election, we first needed to identify a set of users engaged in U.S. politics, along with their posting histories. In this section, we describe the process of collecting this dataset and present statistics on users’ posts and network connections. In the next section, we outline the steps taken to construct the stance dataset based on this U.S. political data. 3.1 Bluesky Social Network Bluesky is a decentralized social network where users can share short posts (up to 300 characters), along with images and videos, similar to Twitter/X Balduf et al. 2024 . On this platform, users can engage with others by following them, as well as by liking, reposting, quoting, and replying to their posts. A standout feature of Bluesky is its Feed Generator service, which enables users to create personalized timelines—called feeds—on various topics using custom algorithms Jeong et al. 2024 . This service provides real-time access to recent posts on Bluesky related to any topic of

Read the complete text