Online Influence Campaigns: Strategies and Vulnerabilities
Andreea Musulan, Veronica Xia, Ethan Kosak-Hine, Tom Gibbs, Vidya Sujaya, Reihaneh Rabbany, Jean-François Godbout, Kellin Pelrine * · 2025
Read Online Influence Campaigns: Strategies and Vulnerabilities by Andreea Musulan, Veronica Xia, Ethan Kosak-Hine, Tom Gibbs, Vidya Sujaya, Reihaneh Rabbany, Jean-François Godbout, Kellin Pelrine * (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-10387.txt.
Introduction
Andreea Musulan and co-authors surveyed in 2025 how organized online influence campaigns manipulate public life at societal scale. They define the problem as inauthentic, coordinated manipulation by malicious actors. Drawing on the research literature, they catalogue the strategies such actors use and the weaknesses they exploit.
Three case studies of extensive campaigns underline the severity of the threat. Artificial intelligence gets special attention, since it speeds both creation and spread of harmful content. New AI capabilities open fresh risks to social cohesion worldwide. The authors aim to map not just individual tactics but the thinking behind them. That fuller picture, they argue, is what defenders need as the threat landscape evolves.
Catalog record
| CREATOR | Andreea Musulan, Veronica Xia, Ethan Kosak-Hine, Tom Gibbs, Vidya Sujaya, Reihaneh Rabbany, Jean-François Godbout, Kellin Pelrine * |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 113 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-10387
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Online Influence Campaigns: Strategies and Vulnerabilities Andreea Musulan, Veronica Xia, Ethan Kosak-Hine, Tom Gibbs, Vidya Sujaya, Reihaneh Rabbany, Jean-François Godbout, Kellin Pelrine * Abstract In order to combat the creation and spread of harmful content online, this paper defines and contextualizes the concept of inauthentic, societal-scale manipulation by malicious actors. We review the literature on societally harmful content and how it proliferates to analyze the manipulation strategies used by such actors and the vulnerabilities they target. We also provide an overview of three case studies of extensive manipulation campaigns to emphasize the severity of the problem. We then address the role that Artificial Intelligence plays in the development and dissemination of harmful content, and how its evolution presents new threats to societal cohesion for countries across the globe. Our survey aims to increase our understanding of not just particular aspects of these threats, but also the strategies underlying their deployment, so we can effectively prepare for the evolving cybersecurity landscape. 1 Introduction One of the greatest threats to social cohesion for countries worldwide stems from inauthentic, societal-scale manipulation by malicious actors . This concept broadly refers to the idea that actors, foreign or domestic, engage in efforts to influence the stability of societies by operating information-based influence and reconnaissance campaigns, while concealing their origins and harmful intentions. In this paper, we provide an overview of this concept by reviewing the current state of research on the topic and evaluating the most common mitigation strategies proposed by scholars, policymakers, and intelligence communities. The efforts of these malicious actors can be targeted towards public or private networks, online and offline. This review focuses on digital manifestations of societal-scale manipulation. Users on public networks — such as social media platforms — can be victims of deceptive campaigns deployed by malicious actors. These campaigns are meant to shape public opinion, usually during a particular event that bears consequences for a given society as a whole, such as an election. Individuals using private networks to exchange sensitive or confidential information — such as those used by government, corporations, and financial institutions — can also be victims of manipulation campaigns. The goal of malicious actors that target these networks is to obtain private information. Like public opinion manipulation on public networks, the infiltration of private networks also bears societal-scale consequences. The effects of these infiltrations go beyond compromising national security; they can lead members of the general public to question the capacity of, for example, political or financial institutions to safeguard their information. In order to maximize the effectiveness of these campaigns, malicious actors must undertake reconnaissance efforts on their targets. These actors collect and synthesize information to target specific individuals via social engineering, or develop user typologies based on the potential effectiveness of exposure to specific information and narratives. Thus, manipulation campaigns are highly pernicious to the stability of societies, as they threaten social cohesion by polarizing the general public and by compromising public trust in political institutions and leaders. While the origins of societal scale manipulation threats can differ, there are common vulnerabilities in online communities accessible to democratic citizens that can be exploited by malicious actors. It is now relatively easy to identify and target social media users who are more susceptible to manipulation by analyzing their digital footprint, including, but not limited to, their online behavior, engagement patterns, and personal profile information from social media platforms ( Moti et al., 2024 ; Hermann, 2023 ; Marengo et al., 2023 ; Simchon et al., 2023 ; Chang et al., 2023 ; McHatton and Ghazinour, 2023 ) . These vulnerabilities exist at multiple levels of abstraction, from the structural features of democratic societies to the social and psychological tendencies of individual public opinion formation. This type of targeted intervention is becoming even more sophisticated now with recent developments in generative Artificial Intelligence (AI), such as Large Language Models (LLMs). Through generative AI’s audiovisual and text generation capabilities, this technology has significantly lowered the costs of producing convincing human-like content, which can be very difficult to detect in online communities ( De Angelis et al., 2023 ; Sun et al., 2023 ; Cooke et al., 2024 ; Frank et al., 2024 ) . As a result, inauthentic, societal-scale manipulation is today considered to be one of the most important threats facing democracies worldwide ( EU, 2024 ; CSIS, 2023 ; Bengio et al., 2024 ; Torkington, 2024 ) . The risks associated with such malicious activity explain why research on this topic has expanded significantly across various domains, including law ( Susser et al., 2019 ; Spencer, 2020 ) , sociology ( Krafft and Donovan, 2020 ; Schia and Gjesvik, 2020 ; Giglietto et al., 2020 ; Mathur et al., 2023 ) , political science ( Rheault and Musulan, 2021 ; Krafft and Donovan, 2020 ; Keller and Klinger, 2019 ) , communication ( Rogers and Niederer, 2020 ; Walter and Ophir, 2023 ) , and engineering and computer science ( Cresci, 2020 ; Khaund et al., 2021 ; Ferrara, 2023 ) . Global intelligence communities have also been actively monitoring malicious actors in order to prepare for the myriad of elections around the world this year ( MTAC, 2024d ; CISA, 2022 ; Lee, 2023 ) . In fact, Russia, Iran, and China have all already been engaged in “influence operations [aimed at] elections” ( Microsoft, 2024 , 9) . For the case studies in this review, we focus on the U.S. intelligence community’s efforts to safeguard the U.S. presidential election in the fall of 2024, given its overall geopolitical importance. In this work, we aim to answer two central research questions: • First, what are the strategies and goals of malicious actors behind online, inauthentic, societal-scale manipulation? • Second, what are the most pressing types of threats posed by these actors? According to Akhtar et al. (2024) , most research on malicious activity has focused on its specific components, such as the spread of inaccurate information, automated communication agents (i.e. social bots), and coordinated campaigns. Although detailed exploration of these components individually are essential to developing fine-grained understandings of manipulation on social media, meta analyses such as the one presented in this paper and work by Akhtar et al. (2024) are also integral to illustrating the bigger picture of these threats. In contrast to the review by Akhtar et al. (2024) , here we largely focus on coordinated societal-scale manipulation campaigns. As a result, we go into greater detail with respect to the types of information involved in these campaigns as well as their methods of deployment. We also contextualize coordinated malicious activity into a broader framework of societal-scale risks by connecting social media manipulation campaigns to traditional cybersecurity threats — such as the infiltration of private networks through social engineering and phishing — more explicitly. Furthermore, we provide additional details on the motivations involved in societal-level threats by identifying specific types of actors involved and follow up our discussion of these threats with case studies. In the following section, we more systematically define inauthentic, societal-scale manipulation by malicious actors. We then present an overview of the types of manipulative content and strategies, the vulnerabilities they target, and three case studies of malicious