Towards Detecting Persuasion on Social Media: From Model Development to Insights on Persuasion Strategies
Elyas Meguellati, Stefano Civelli, Pietro Bernardelle, Shazia Sadiq, Irwin King, Gianluca Demartini · 2025
Read Towards Detecting Persuasion on Social Media: From Model Development to Insights on Persuasion Strategies by Elyas Meguellati, Stefano Civelli, Pietro Bernardelle, Shazia Sadiq, Irwin King, Gianluca Demartini (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-13844.txt.
Introduction
Elyas Meguellati and co-authors build detectors for persuasion in social media content, in a 2025 paper. Political advertising shapes public opinion and election outcomes, often through subtle persuasive techniques tucked inside broader propaganda strategies. Spotting those elements backs voter awareness and democratic transparency in a crowded feed.
The work joins two linked studies side by side. One is a lightweight model for spotting persuasive content at low cost, and the other is an analysis of the persuasion strategies the model turns up. A tool that stays cheap to run can scan platforms at scale, post by post. Knowing which ones dominate helps regulators and platforms respond with evidence in hand rather than with hunches.
Catalog record
| CREATOR | Elyas Meguellati, Stefano Civelli, Pietro Bernardelle, Shazia Sadiq, Irwin King, Gianluca Demartini |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-13844
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Towards Detecting Persuasion on Social Media: From Model Development to Insights on Persuasion Strategies Elyas Meguellati, Stefano Civelli, Pietro Bernardelle, Shazia Sadiq, Irwin King, Gianluca Demartini Abstract Political advertising plays a pivotal role in shaping public opinion and influencing electoral outcomes, often through subtle persuasive techniques embedded in broader propaganda strategies. Detecting these persuasive elements is crucial for enhancing voter awareness and ensuring transparency in democratic processes. This paper presents an integrated approach that bridges model development and real-world application through two interconnected studies. First, we introduce a lightweight model for persuasive text detection that achieves state-of-the-art performance in Subtask 3 of SemEval 2023 Task 3 while requiring significantly fewer computational resources and training data than existing methods. Second, we demonstrate the model’s practical utility by collecting the Australian Federal Election 2022 Facebook Ads (APA22) dataset, partially annotating a subset for persuasion, and fine-tuning the model to adapt from mainstream news to social media content. We then apply the fine-tuned model to label the remainder of the APA22 dataset, revealing distinct patterns in how political campaigns leverage persuasion through different funding strategies, word choices, demographic targeting, and temporal shifts in persuasion intensity as election day approaches. Our findings not only underscore the necessity of domain-specific modeling for analyzing persuasion on social media but also show how uncovering these strategies can enhance transparency, inform voters, and promote accountability in digital campaigns. 1 Introduction The spread of information through digital platforms brings to light the practice of propaganda, which aims to shape public opinion to foster certain agendas. Propaganda can be observed across various media, making it challenging for information consumers to recognize, especially for those new to its nuances. Its effectiveness lies in its ability to blend seamlessly into the content, often requiring a keen eye to detect its subtle cues. Furthermore, the increasing amount of information on social media adds to the challenges for experts to manually sort through the content in order to spot and flag elements of propaganda ( Glowacki et al., 2018 ; Tardaguila et al., 2018 ) . The detection of propaganda has become a critical area of study, particularly with the rising concern over misleading information being spread at scale online. In this paper we focus on persuasive content, a key element of propaganda. Persuasion is about influencing people’s beliefs, attitudes, or actions through dialogue and reasoning. It is a process where communicators seek to convince others on certain issues, respecting their freedom to choose ( Perloff, 2017 ) . Incidents like Cambridge Analytica have shown how persuasive tactics can be amplified on social media, using data to tailor messages for political ends ( Boerboom, 2020 ) . Figure 1 illustrates various persuasive techniques employed in language to elicit distinct emotional responses 1 1 1 https://propaganda.math.unipd.it/semeval2024task4/definitions22.html . Figure 1: Examples of Persuasion techniques from the SemEval dataset with explanation of the technique. Addressing the need for nuanced persuasion detection, SemEval-2023 Task 3 organizers introduced Subtask 3, focusing on categorizing 23 persuasive techniques in articles. Our contributions include: (1) Developing a novel, more efficient, multi-label classification model for persuasion detection with reduced data requirements and a lighter transformer. (2) Curating and partially annotating a large dataset of political ads published during the 2022 Australian Federal Election on Facebook. (3) On this dataset, our model provides new insights into persuasion strategies in political advertising, demonstrating its application in practice. 2 Related Work In the domain of text analysis, the distinction between the detection of persuasion and propaganda has gradually become more defined. Historically, these domains were often conflated, given the emphasis on the identification and categorization of rhetorical techniques such as loaded language, name-calling, and emotional appeals. Early contributions, such as the work by Rashkin et al. (2017) , centered on document-level classification, categorizing texts into broad groups including trusted, satire, hoax, and propaganda. Barrón-Cedeño et al. (2019) extended this by developing a corpus to differentiate propagandistic from non-propagandistic content, analyzing the impact of writing style and readability on predicting the source of the article. The granularity of the classification increased with subsequent studies. Habernal and Gurevych (2017) , who focus on persuasion, annotated arguments with five distinct logical fallacies. This area of inquiry was further expanded by Da San Martino et al. (2019) , who introduced a corpus annotated with an extensive set of propaganda techniques and developed advanced models for span detection and classification. Their efforts were extended in later work that addressed the limitations of transformers ( Chernyavskiy et al., 2021 ) and explored interpretable propaganda detection ( Yu et al., 2021 ) . Additional studies have examined propaganda techniques in diverse contexts, such as memes ( Dimitrov et al., 2021 ) and code-switched text ( Salman et al., 2023 ) , as well as the interplay between propaganda and social coordination ( Hristakieva et al., 2022 ) and the spread of COVID-19 related propaganda on social media ( Nakov et al., 2021 ) . The introduction of SemEval-2023 Task 3 Subtask 3, as presented by Piskorski et al. (2023b) , marked a significant shift by explicitly assigning persuasion detection as a distinct subtask within the broader context of propaganda classification, alongside two other subtasks: (1) news genre categorization (objective reporting vs. opinion vs. satire) and (2) framing detection (highlighting specific aspects of content). The persuasion detection subtask leveraged a comprehensive multilingual dataset comprising of 1,612 news articles, carefully annotated with 23 persuasion techniques (i.e., a multi-label classification task), thus expanding the scope of media content computational analysis. The used baseline was a linear SVM trained using word uni-grams and bi-grams Piskorski et al. (2023a) . Within this refined framework, innovative approaches recently emerged, heavily relying on transformers and data augmentation, without significant emphasis on feature engineering. Purificato and Navigli (2023) combined an ensemble of fine-tuned transformer models, applying a weighted average to predictions for English to improve sensitivity to different persuasion techniques. Meanwhile, Hromadka et al. (2023) attained state-of-the-art (SOTA) results through minimal preprocessing and fine-tuning of the XLM-RoBERTa-large model Conneau et al. (2019) . A key aspect of their model’s performance was the focus on calibrating the confidence threshold. As compared to the existing literature, we introduce a lightweight transformer model that exhibits high levels of effectiveness on the persuasion detection subtask of SemEval-2023. Our model achieves comparable results to other top-performing models, such as APatt ( Purificato and Navigli, 2023 ) and KInIT ( Hromadka et al., 2023 ) , while focusing on data and computational efficiency. Notably, our approach requires approximately 86.8% less data, up to 77.6% fewer parameters than APatt, and 86.2% less training time as compared to KInIT. This work extends the body of knowledge on persuasion detection in digital media, also providing new insights into persuasive strategies within online political advertising. 3 Study 1: Persuasion as a Multi-Label Classification for SemEval-23 3.1 Dataset Description The SemEval-23 Task 3 dataset is a comprehensive multilingual corpus collected from various globally discussed topics, including the COVID-19 pandemic, abortion-related legislation, migration, and the Russo-Ukrainian conflict, among others. The dataset includes articles in nine languages: English, French, German, Georgian, Greek, Italian, Polish, Russian, and Spanish published between 2020 and mid-2022. The articles were sourced from both mainstream and alternative media to capture