A Lightweight Approach for User and Keyword Classification in Controversial Topics

Ahmad Zareie, Kalina Bontcheva, Carolina Scarton · 2025

Read A Lightweight Approach for User and Keyword Classification in Controversial Topics by Ahmad Zareie, Kalina Bontcheva, Carolina Scarton (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-12272.txt.

Introduction

Ahmad Zareie, Kalina Bontcheva, and Carolina Scarton propose a 2025 light method to sort social media users and words by stance on hot topics. Knowing where the public stands helps social scientists and policy makers. Most past methods need much labeled data, full post text, or follower lists that are hard to get.

Their method needs just one seed word per stance and reads only the words in posts. A tuned random walk spreads stance scores from those seeds across users and terms. Tests beat rival methods while using far less data and time. The tool can also track how public worries shift over months.

Catalog record

CREATORAhmad Zareie, Kalina Bontcheva, Carolina Scarton
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE26 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-12272

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Lightweight Approach for User and Keyword Classification in Controversial Topics Ahmad Zareie, Kalina Bontcheva, Carolina Scarton Abstract Classifying the stance of individuals on controversial topics and uncovering their concerns is crucial for social scientists and policymakers. Data from Online Social Networks (OSNs), which serve as a proxy to a representative sample of society, offers an opportunity to classify these stances, discover society’s concerns regarding controversial topics, and track the evolution of these concerns over time. Consequently, stance classification in OSNs has garnered significant attention from researchers. However, most existing methods for this task often rely on labelled data and utilise the text of users’ posts or the interactions between users, necessitating large volumes of data, considerable processing time, and access to information that is not readily available (e.g. users’ followers/followees). This paper proposes a lightweight approach for the stance classification of users and keywords in OSNs, aiming at understanding the collective opinion of individuals and their concerns. Our approach employs a tailored random walk model, requiring just one keyword representing each stance, using solely the keywords in social media posts. Experimental results demonstrate the superior performance of our method compared to the baselines, excelling in stance classification of users and keywords, with a running time that, while not the fastest, remains competitive. Keywords: Users Classification Keyword Classification Stance Detection Random Walk Department of Computer Science, The University of Sheffield, Sheffield, UK { a.zareie, k.bontcheva, c.scarton } @sheffield.ac.uk 1 Introduction In society, individuals may hold varying opinions on controversial topics. Controversial topics refer to subjects that create polarisation in individuals’ stances, leading to dichotomous opinions (e.g., Leave vs. Remain in the Brexit context, Pro-vaccine vs. Anti-vaccine in the COVID-19 context, or support for a specific candidate in an election); this resulting position is known as the stance. In controversial topics, classifying users based on their stance, discovering the concerns within each class and tracking the evolution of classes and concerns over time are regarded as crucial for social scientists and policymakers [ 2 ] . Data collected from Online Social Networks (OSNs) provide valuable insights for this crucial task since it can be seen as a proxy for opinions in societies. In these networks, individuals express and discuss their viewpoints to disseminate their opinions and potentially influence others’ perspectives. Therefore, the stance of users can be inferred based on their activities in OSNs; additionally, the keywords they use in their posts can express their concerns. In this paper, we propose a random walk approach to classify users and keywords in OSNs based on their stance on a controversial topic . This approach is lightweight, relying solely on keywords shared by users for the classification task. This approach only requires one keyword to represent each stance as prior knowledge, without the need for pre-determined thresholds. Hereafter, we use ’hashtag’ interchangeably with ’keyword’, but the method can be used with any token as keywords. Analysing data in OSNs to discover the stance of users and the generated content (posts) has increasingly become the focus of researchers from various disciplines, and a multitude of methods have been proposed for this task [ 2 , 3 ] . Previous work focuses mainly on supervised models, which rely on a set of data known as labelled (training) data as prior knowledge. These supervised methods could be divided into two groups: (i) content-based [ 11 , 5 ] : requiring a set of texts as labelled data and utilising the text of posts to understand the stance, and (ii) interaction-based [ 1 , 13 , 14 ] : relying on a set of users representing each stance as labelled data and using the interactions between pairs of users (e.g., likes, retweets, replies, and mentions on Twitter – now X) to understand the stance. The labelled data required in supervised methods is typically generated through a manual process, involving human judgments, which is time-consuming (particularly when tracking the evolution of public opinion over time [ 2 ] ) and highly affected by annotators’ biases. Data labelling may also lead to language- and domain-dependant models, requiring further data annotation for handling new domains and languages. Unsupervised methods [ 6 , 10 , 12 ] have also been proposed for classifying individuals’ stances without the need for labelled data. These methods utilise linguistic features extracted from post content, such as lexicons, grammatical dependencies, and the latent meanings of words in context. Alternatively, they may leverage users’ profile features to infer their stance. However, methods relying on linguistic features may encounter challenges in multilingual domains due to their dependency on language-specific characteristics [ 3 ] . Meanwhile, those utilising profile features may face difficulties in generalising across diverse social media platforms, given the variability in profile features offered by each platform. Our method employs a lightweight unsupervised approach, that is language- and profile-agnostic, setting it apart from these previous studies. Moreover, it does not rely on user interactions, which may not always be available on certain social media platforms (e.g., users sharing opinions in a Telegram group). To our knowledge, Darwish et al. [ 5 ] and Coletto et al. [ 4 ] are the only previous work addressing a classification task similar to our work. Darwish et al. [ 5 ] propose an approach that relies on predefined sets of users, each representing a particular stance. The stance of each user is then determined based on their similarity to these predefined sets. Although this method relies on keywords (hashtags) shared by users to detect stances, similar to ours, it differs in that it requires a set of users for each stance as labelled data, whereas our method relies on only one keyword for each stance. Coletto et al. [ 4 ] propose an approach that classifies keywords and users iteratively. Similar to our approach, this method relies on the keywords shared by users and requires only one keyword for each stance as prior knowledge. However, this method requires pre-defined thresholds for classification, and determining the optimal thresholds for various domains is not trivial and, in some cases, not feasible. Additionally, our experimental evaluation demonstrates that our lightweight method outperforms both of these methods. The main contribution of this paper is the lightweight classification method, which utilises a tailored random walk approach to effectively classify users and hashtags with minimal user data and prior knowledge. We apply our method, called the Lightweight Random Walk Method (LRM), to analyse conversations about the UK General Election 2019 and Brexit on Twitter (now X). Our approach shows superior performance compared to baseline methods in accurately classifying users into different stance classes and identifying the most prominent hashtags within each class. Our method also offers competitive running time compared to baseline methods. Additionally, the proposed model is utilised to track the evolution of stance classes over time in both the general election and Brexit datasets. Results obtained by tracking the evolution in the Brexit data are consistent with previous studies applying content and text analysis [ 8 , 9 ] . Although there is a lack of previous studies on analysing stance in the 2019 general election, our work corroborates with reports [ 7 ] showing quantitative analysis about this election in social media.

Read the complete text