Behavior Change as a Signal for Identifying Social Media Manipulation

Isuru Ariyarathne, Gangani Ariyarathne, Alessandro Flammini, Filippo Menczer, Alexander C. Nwala · 2026

Read Behavior Change as a Signal for Identifying Social Media Manipulation by Isuru Ariyarathne, Gangani Ariyarathne, Alessandro Flammini, Filippo Menczer, Alexander C. Nwala (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-03128.txt.

Introduction

Isuru Ariyarathne, Gangani Ariyarathne, Alessandro Flammini, and colleagues catch manipulative social media accounts by watching how their behavior changes. Bots and coordinated campaigns often repurpose accounts or shift tactics to dodge detection. Existing detectors rarely use that change itself as evidence.

The team encodes each account's actions as a string of symbols, splits it into segments, and measures how much behavior shifts between neighbors. Honest accounts show steady change patterns, while bots cluster at very low or very high change. Coordinated accounts look alike within one campaign yet differ across campaigns. Classifiers trained on these change profiles scored well at spotting both bots and coordinated inauthentic behavior.

Catalog record

CREATORIsuru Ariyarathne, Gangani Ariyarathne, Alessandro Flammini, Filippo Menczer, Alexander C. Nwala
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36991
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2603.03128

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Behavior Change as a Signal for Identifying Social Media Manipulation Isuru Ariyarathne, Gangani Ariyarathne, Alessandro Flammini, Filippo Menczer, Alexander C. Nwala Abstract . Social media accounts engaging in online manipulation can change their behaviors for re-purposing or to evade detection. Existing detection systems are built on features that do not exploit such behavioral patterns. Here we investigate the degree to which change in behavior can serve as a signal for identifying automated or coordinated accounts. First, we use Behavioral Languages for Online Characterization (BLOC) to represent the behavior of a social media account as a sequence of symbols that represent the account’s actions and content. Second, we segment an account’s BLOC strings and measure the changes between consecutive segments. Third, we represent an account as a feature vector that captures the distribution of behavioral change values. Finally, the resulting features are used to train and test supervised classifiers. We apply the proposed method to two detection tasks aimed at automated behavior (social bots) and coordinated inauthentic behavior (information operations). Our results reveal that the distributions of behavioral changes tend to be consistent across authentic accounts, while social bots exhibit either very low or very high behavioral change. Coordinated inauthentic accounts exhibit highly similar distributions of behavioral change within the same campaign, but diverse across campaigns. These patterns allow our classifiers to achieve good accuracy in both tasks, demonstrating the effectiveness of behavioral change as a signal for identifying online manipulation. 1. Introduction Abusive accounts on social media, like inauthentic automated (bot) or coordinated accounts, have received significant research attention due to the threats they pose to the integrity of online platforms for spreading misinformation 2 , manipulating public opinion 22 ; 3 ; 15 , and perpetrating fraud 11 . Despite many advances, identifying these deceptive accounts remains a challenging task due to their ability to evolve and adapt 14 ; 13 ; 43 . Supervised detection systems are usually built from machine-learning models that are trained on features capturing some aspects of account behaviors. Features can be derived from the content of posts 17 , user metadata 1 , network structure 29 ; 31 ; 34 , and so on. While useful, existing approaches trained on such features are typically designed to detect specific types of suspicious behaviors. Since malicious actors adjust their tactics to appear normal, switch purposes, and avoid detection, such approaches do not generalize well 42 ; 32 ; 13 . For example, Cresci et al. 12 demonstrated how coordinated accounts evolve their activity patterns over time to resemble legitimate users. Similarly, Elmas et al. 18 documented large scale account repurposing were accounts abruptly changed identity and intent. These findings suggest that behavioral change itself is a recurring tactic in online manipulation. However, behavioral change is not exclusive to malicious actors, as genuine users also naturally evolve over time. Moreover, existing methods are less adaptable in adversarial settings not because their features are incorrect, but because inauthentic accounts strategically shift behavior in ways that cause those signals to weaken or disappear. Therefore, it is important to examine whether behavioral change can be systematically used to distinguish manipulation from normal user evolution. We use the term behavioral change or behavior change to describe how online user action and content patterns differ across consecutive time spans (Section 3.2 provides a more formal definition). Our approach (Fig. 1 ) begins by representing social media accounts with Behavioral Languages for Online Characterization (BLOC) 27 . BLOC encodes the activities of a social media account as strings of symbols drawn from alphabets that represent the account’s actions or the content of its posts. (BLOC could be replaced by another representation that captures actions and content behaviors.) We segment an account’s BLOC words and measure the distance (change) between consecutive segments. We investigate multiple segmentation methods, segment selection methods, and distance measures as discussed in detail in Section 3 . We train detectors of bot and coordinated accounts using features that capture the resulting distributions of behavioral change values. Our analysis shows that organic accounts tend to have normal behavioral change patterns, exhibiting neither very repetitive behaviors nor very drastic changes. Conversely, some bot accounts exhibit unusually small change, suggesting automated behavior, while others display drastic or erratic changes, possibly when they are repurposed or to avoid detection. Coordinated inauthentic accounts belonging to the same campaign exhibit highly similar behavioral changes, signaling a lack of independence. We demonstrate the usefulness of these signals by developing supervised machine learning models that leverage behavioral change features to identify the two types of online manipulation. These results suggest that behavioral change could be leveraged to detect other forms of online abuse. We have published our code to encourage this: https://github.com/wm-newslab/behavior-change . Figure 1 . Overview of our Behavior Change methodology to identify social media manipulation. The feature vectors are used to train a model for a specific task, such as detecting automated or coordinated accounts. 2. Related Studies Social media abuse takes different forms such as cyberbullying, fraud, disinformation, impersonation using deep fakes, and so on 35 ; 26 ; 19 ; 44 ; 11 ; 16 . Since abusers often rely on automated or coordinated accounts to increase the effectiveness of their attacks, these kinds of social media abuse have received significant research attention. Predominant strategies for detecting both inauthentic automated and coordinated accounts rely on supervised and unsupervised machine-learning models to distinguish them from genuine ones 14 ; 29 . Automation detection approaches utilize classes of features that include metadata such as tweet frequency 6 , profile descriptions 1 , follower-friend ratios 21 , and network structure 5 , as well as content-based attributes like lexical patterns 23 and hashtag or URL usage 36 . While these methods have proven successful in detecting some classes of bots, they struggle due to the evolving sophistication of malicious bots. Bots can now use LLMs to generate natural language, mimic human behavior, build elaborate social networks, and interact with genuine users online 40 ; 37 . This makes simple heuristics like follower counts and posting rates unreliable, leading to detection errors 20 ; 14 ; 13 . In coordination detection, researchers aim to uncover suspiciously similar behaviors among groups of accounts, such as identical retweet patterns or synchronized posts. Network based models and clustering algorithms are often used for identifying coordinated activities on social media 5 ; 29 . Recent studies show that coordinated inauthentic accounts adjust their posting intervals 38 and modify their language to imitate genuine communities 4 , making coordinated behavior harder to detect. This ongoing evolution reflects an arms race with detection systems and highlights the need for more advanced approaches. Behavioral modeling is a promising approach in the latest generation of detection systems. Models such as Act-M 8 , MulBot 24 , BotShape 39 , and Temporal Network Logic 30 identify anomalies by examining posting intervals, changes across behavioral dimensions, and transitions in user activities over time. Moreover, methods such as Digital DNA 9 and the BLOC framework 27 encode user behaviors as sequences of symbols to reveal repetitive or coordinated patterns. 3. Measuring Change in the Behaviors of Social Media Accounts Building upon prior behavioral models, we focus on behavioral

Read the complete text