Structural Dynamics of Harmful Content Dissemination on WhatsApp

Yuxin Liu, M. Amin Rahimian, Kiran Garimella · 2025

Read Structural Dynamics of Harmful Content Dissemination on WhatsApp by Yuxin Liu, M. Amin Rahimian, Kiran Garimella (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-18099.txt.

Introduction

Yuxin Liu, Amin Rahimian and Kiran Garimella study how harmful content spreads inside WhatsApp groups, in work from 2025. Their data hold over five million messages from about six thousand groups in India, texts, images and videos alike. From re-share traces they rebuild the cascade of each message and compare harmful items with ordinary ones.

Harmful messages ran deeper and wider than the rest, with videos and images as the main vehicles. Yet media type alone could not explain the structural gap, which points to how the sharing network itself is shaped. The authors suggest that slowing spread means targeting re-share structure, not just content.

Catalog record

CREATORYuxin Liu, M. Amin Rahimian, Kiran Garimella
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-18099

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Structural Dynamics of Harmful Content Dissemination on WhatsApp Yuxin Liu, M. Amin Rahimian, Kiran Garimella Abstract WhatsApp, a platform with more than two billion global users, plays a crucial role in digital communication, but also serves as a vector for harmful content such as misinformation, hate speech, and political propaganda. This study examines the dynamics of harmful message dissemination in WhatsApp groups, with a focus on their structural characteristics. Using a comprehensive data set of more than 5.1 million messages–including text, images, and videos–collected from approximately 6,000 groups in India, we reconstruct message propagation cascades to analyze dissemination patterns. Our findings reveal that harmful messages consistently achieve greater depth and breadth of dissemination compared to messages without harmful annotations, with videos and images emerging as the primary modes of dissemination. These results suggest a distinctive pattern of dissemination of harmful content. However, our analysis indicates that modality alone cannot fully account for the structural differences in propagation. The findings highlight the critical role of structural characteristics in the spread of these harmful messages, suggesting that strategies targeting structural characteristics of re-sharing could be crucial in managing the dissemination of such content on private messaging platforms. 1 University of Pittsburgh 2 Rutgers University [email protected], [email protected], [email protected] ∗ Corresponding authors. 1 Introduction WhatsApp is the world’s most popular messaging app, with more than 2.78 billion monthly active users in 180 countries, and is especially dominant in countries like India. In fact, more than 500 million users in India rely on WhatsApp as their main means of communication, making it a central part of daily life for many ( Statista 2023 ) . Despite its vast user base, studying information dissemination on WhatsApp remains challenging due to its end-to-end encryption, which limits access to message content–even to the platform–and makes it difficult to monitor and track harmful material such as misinformation, hate speech, and propaganda. Due to the lack of moderation, malicious actors have exploited WhatsApp’s group chat feature to disseminate propaganda and hateful content on a large scale ( Evangelista and Bruno 2019 ; Nizaruddin 2021 ) . Recent events have highlighted the severe real-world consequences of widely distributed harmful messages on WhatsApp. Since 2014, there has been a significant increase in mob violence, often triggered by misinformation spread through WhatsApp. For example, in India, false rumors about child kidnappers circulated on WhatsApp, leading to the deaths of more than two dozen innocent people since April that year ( Arun 2019 ) . Beyond violence, WhatsApp has also become a powerful tool for political manipulation. In India, where over 500 million people use WhatsApp, both the BJP 1 1 1 The Bharatiya Janata Party is the ruling party of India and largest in terms of political representation in the Parliament and state legislatures. and the Congress 2 2 2 The Indian National Congress (INC), colloquially “the Congress”, is one of the oldest political parties in India. have been accused of spreading false or misleading information to influence the country’s 900 million large voting population, highlighting the role of the platform in shaping public opinion ( Times 2019 ) . Despite the urgency of understanding how harmful messages spread on WhatsApp, tracking their diffusion remains particularly challenging due to the end-to-end encryption of the platform. Unlike public platforms such as X (formerly Twitter) or Facebook, WhatsApp operates as a private communication network where messages are encrypted before sending and only decrypted on the receiver’s device. This end-to-end encryption ensures that even the messaging platform itself cannot access the content exchanged between users. Consequently, developing machine learning algorithms to detect the spread of harmful or false information is virtually impossible, as the platform cannot analyze the messages in transit. Without access to message content, conventional content moderation techniques, as seen on public platforms, cannot be applied. This limitation makes it extremely difficult to monitor or control the dissemination of misinformation on WhatsApp. Given the impracticality of content-based moderation, WhatsApp has changed its focus toward the structural characteristics of message dissemination to limit the spread of harmful messages. A key strategy implemented by WhatsApp is to restrict the message forwarding functionality. Specifically, each message can be forwarded to a maximum of five groups, and if the message has already been forwarded multiple times, it can only be forwarded to a single group. Furthermore, once a message has been forwarded more than five times, it is marked with the label “forwarded many times.” However, it remains an open question whether harmful messages exhibit structural dissemination patterns that are distinct from normal content. This issue is critical, as the effectiveness of WhatsApp’s structural restrictions relies on the assumption that harmful messages follow identifiable patterns, which can be targeted by these restrictions. In this paper, we built a large dataset collected by Garimella and Chauchard (2024) comprising 5,158,879 messages, including text, images, and videos, collected from 5,953 WhatsApp groups, which are a key channel for the mass dissemination of information on the platform. This dataset was collected through a field study in India, where participants gave their informed consent to share data from the WhatsApp groups that they were comfortable with, ensuring ethical compliance. To track and analyze the spread of messages, Garimella and Chauchard used privacy-preserving hashing techniques to identify multiple instances of the same message, even with slight variations. Techniques such as PDQ hashing ( Farid 2021 ) for images and videos and locality-sensitive hashing (LSH) ( Gionis et al. 1999 ) for text, allowed them to detect content variations, such as cropping or encoding changes that capture exact and modified versions of shared media. We assigned labels for misinformation, hate speech, and propaganda to a small subset of 2,000 viral pieces of content in this dataset. Taking into account the data donation-based sampling strategy, we model the message cascades as generalized tree-like structures and estimate key structural parameters, namely breadth b and depth h , to understand the dissemination process. Our analysis revealed that harmful messages have significantly greater breadth and depth compared to normal messages. In addition, these harmful messages are spread primarily through videos and images. We also estimated the scale of dissemination for different message types based on group sizes to derive population-level estimates and found that harmful messages reach a significantly larger audience compared to normal messages. These findings emphasize the need for further investigation into the structural aspects of message propagation, as they are key to developing more effective strategies to limit the spread of harmful content on the platform. To our knowledge, this is the first study to understand the spread of information on WhatsApp at such a scale. By analyzing the spread of harmful content, this work provides unique insights into how harmful content propagates more broadly and deeply compared to normal messages. 2 Contributions and Related Work Harmful messages on social networks are becoming a major issue, with a significant body of research focused on public social media platforms such as X (formerly Twitter) and Facebook. Grinberg et al. (2019) find that on Twitter, misinformation exposure is highly concentrated, with just 1% of users encountering 80% of false information. Similarly, Allen, Watts, and Rand (2024) study vaccine misinformation on Facebook and find that reports implying vaccines are

Read the complete text