Simulating Misinformation Propagation in Social Networks using Large Language Models Conference: ACM International Conference on Information and Knowledge Management; November 10–14, 2025; Seoul, Korea CCS: Computing methodologies Natural language processing CCS: Computing methodologies Multi-agent
Raj Gaurav Maurya, Vaibhav Shukla, Raj Abhijit Dandekar, Rajat Dandekar, Sreedath Panat · 2025
Read Simulating Misinformation Propagation in Social Networks using Large Language Models Conference: ACM International Conference on Information and Knowledge Management; November 10–14, 2025; Seoul, Korea CCS: Computing methodologies Natural language processing CCS: Computing methodologies Multi-agent by Raj Gaurav Maurya, Vaibhav Shukla, Raj Abhijit Dandekar, Rajat Dandekar, Sreedath Panat (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-10384.txt.
Introduction
Raj Gaurav Maurya and four co-authors build a simulation of how misinformation spreads through social networks. Their agents are large language model personas, each tuned with biases, political leanings, and habits of trust. Articles travel from agent to agent, and each agent rewrites what it receives before passing the story on.
An auditor agent checks factual accuracy after every rewrite, giving claim-level tracking of how stories drift. Experiments with twenty-one personas across ten topics ran chains of up to thirty rewrites. Identity and ideology driven personas sped up distortion, especially in politics, marketing, and technology, while expert personas kept facts stable. Early distortions in mixed groups quickly grew into propaganda-level changes.
Catalog record
| CREATOR | Raj Gaurav Maurya, Vaibhav Shukla, Raj Abhijit Dandekar, Rajat Dandekar, Sreedath Panat |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 73 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-10384
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Simulating Misinformation Propagation in Social Networks using Large Language Models Conference: ACM International Conference on Information and Knowledge Management; November 10–14, 2025; Seoul, Korea CCS: Computing methodologies Natural language processing CCS: Computing methodologies Multi-agent systems CCS: Human-centered computing Collaborative and social computing theory, concepts and paradigms CCS: Information systems Data mining CCS: Security and privacy Human and societal aspects of security and privacy CCS: Applied computing Psychology CCS: Applied computing Sociology Raj Gaurav Maurya, Vaibhav Shukla, Raj Abhijit Dandekar, Rajat Dandekar, Sreedath Panat Abstract . Misinformation on social media thrives on surprise, emotion, and identity-driven reasoning, often amplified through human cognitive biases. To investigate these mechanisms, we model large language model (LLM) personas as synthetic agents that mimic user-level biases, ideological alignments, and trust heuristics. Within this setup, we introduce an auditor–node framework to simulate and analyze how misinformation evolves as it circulates through networks of such agents. News articles are propagated across networks of persona-conditioned LLM nodes, each rewriting received content. A question–answering (QA)-based auditor then measures factual fidelity at every step, offering interpretable, claim-level tracking of misinformation drift. We formalize a misinformation index (MI) and a misinformation propagation rate (MPR) to quantify factual degradation across homogeneous and heterogeneous branches of up to 30 sequential rewrites. Experiments with 21 personas across 10 domains reveal that identity- and ideology-based personas (e.g., religious leaders, lifestyle influencers, politically aligned individuals) act as misinformation accelerators, especially in politics, marketing, and technology. By contrast, expert-driven personas (e.g., medical professionals, investigative journalists) preserve factual stability. Controlled-random branch simulations further show that once early distortions emerge, heterogeneous persona interactions rapidly escalate misinformation to propaganda-level distortion. Our taxonomy of misinformation severity—spanning factual errors, lies, and propaganda—connects observed drift to established theories in misinformation studies. These findings demonstrate the dual role of LLMs as both proxies for human-like biases and as auditors capable of tracing information fidelity. The proposed framework provides an interpretable, empirically grounded approach for studying, simulating, and mitigating misinformation diffusion in digital ecosystems. Figure 1. How agents propagate misinformation? [Generated using Google AI Studio’s Nano Banana] Teaser figure 1. Introduction Misinformation on social media undermines public trust and information quality. Vosoughi et al. 2018 analyzed 126,000 true and false news stories on X 1 1 1 formerly, Twitter: https://x.com/ and found that false news spreads faster and farther, largely due to human behavior rather than bots. False stories are more surprising and emotional, making them more shareable even when spread by users with fewer followers. The typology by Tandoc et al. 2018 categorizes fake news into six types: satire, parody, fabrication, manipulation, advertising, and propaganda; highlighting how it mimics legitimate formats and is amplified on social media through blurred source boundaries and audience validation. Human judgment, social motives, and sharing dynamics thus remain central to its diffusion. Individual interpretation of information is shaped by beliefs, experiences, and identities ( Pennycook and Rand 2019 ) , which motivates using Large Language Models (LLMs) as synthetic agents. Trained on diverse data, LLMs capture linguistic styles, emotional tones, biases, and perspectives, enabling persona-driven simulations of real users. Similar to dynamics observed in Cinelli et al. 2020 , LLM-based personas can be conditioned to respond differently based on source credibility and ideological alignment, mirroring human trust biases. Inspired by weakly supervised veracity classification ( Leite et al. 2023 ) , our framework incorporates weighted credibility mechanisms, while Chen and Shu 2024 underscores the dual role of LLMs in both generating and detecting misinformation, informing safeguards against hallucination risks. As argued by Thapa et al. 2025 , these capabilities make LLMs promising tools in computational social science for modeling ideological bias and social amplification. Recent reviews ( Jerez-Villota et al. 2025 , e.g., ) show increasing use of digital twins and LLM-based simulations, which more authentically integrate cognitive and network interactions. Evidence from He et al. 2024 and Lin et al. 2024 on human digital twins demonstrates architectures for bidirectional user modeling, inspiring LLM-based agents that embed cognitive and social data flows. Building on Liu et al. 2024 , we extend personality-conditioned LLMs with memory and reflection to capture dynamic shifts in attitudes and propagation trends. Grounded in theories of cognition and social simulation ( Conte et al. 2012 ; Castelfranchi 2001 ) , our framework enables more realistic modeling of echo chambers and peer reinforcement than traditional approaches. Misinformation is further shaped by motivated cognition. Dash et al. 2025 show that persona-conditioned LLMs replicate identity-driven reasoning, reducing accuracy by up to 9% and aligning endorsement with political identity by up to 90%, even resisting prompt-based debiasing. These findings align with prior work on persistent misinformation effects ( Lewandowsky et al. 2012 ) . Supporting evidence from Ward et al. 2024 ; Pratelli and Petrocchi 2025 confirms that persona-conditioned LLMs embed cognitive tendencies and ideological biases, justifying their role as synthetic agents in misinformation simulations. Further, Mittelstädt et al. 2024 show that LLMs achieve human-level performance in situational judgment tests, demonstrating nuanced social reasoning. These capabilities justify their use as persona proxies in misinformation spread, where cognition, trust, identity, and network interactions co-construct propagation. By incorporating persona effects, source credibility, and social cues, simulations capture the psychological and social drivers of misinformation more realistically. Finally, LLMs also provide auditing mechanisms. Building on QAFactEval ( Fabbri et al. 2022 ) , LLM auditors can generate targeted questions and assign binary presence scores to track information retention. This interpretable and scalable evaluation approach, validated by Aher et al. 2023 , rigorously measures fidelity of information during persona-driven transformations. Thus, persona-conditioned LLMs, combined with credibility weighting and auditing, offer a powerful, empirically grounded framework for simulating and mitigating misinformation spread. In this work, we introduce an “auditor—node" framework to rigorously quantify how factual information is preserved or degraded as news articles propagate through networks of LLMs. First, we introduce our system design, the propagation model, and evaluation metrics. Then, we present and analyze the results of our experiments done on two different setups, before discussing the general implications and final conclusions: a summary of our contribution and future outlook is also provided. 2. Methodology 2.1. Simulation Framework As illustrated in Fig. 2 , our simulation consists of a network of 21 branches, each containing 30 nodes. Each node ( b,k ) corresponds to a LLM agent (conditioned with one out of 21 distinct personas) that rewrites a news article ( domain ) incoming from the node ( b,k - 1 ) above it. The original article (one of 10) is fed throughout the network by the neutral node ( b,0 or Node0 ), while an external auditor (at NodeA ) evaluates factual fidelity at every step by “asking" 10 questions and comparing with original answers. 2.1.1. Propagation Model We simulate information diffusion by propagating each of the 10 domains (one at a time) through all the 21 branches, node by node (1 to 30). After each rewrite of the news, the LLM passes a copy of the output to the next node/LLM in the branch for it to be rewritten again and another copy to the auditor for it to be evaluated against the original news (i.e., output of neutral agent at Node0 ). Formally, let the original article be denoted by S