Do LLM-Driven Agents Exhibit Engagement Mechanisms? Controlled Tests of Information Load, Descriptive Norms, and Popularity Cues
Tai-Quan Peng, Yuan Tian, Songsong Liang, Dazhen Deng, Yingcai Wu · 2026
Read Do LLM-Driven Agents Exhibit Engagement Mechanisms? Controlled Tests of Information Load, Descriptive Norms, and Popularity Cues by Tai-Quan Peng, Yuan Tian, Songsong Liang, Dazhen Deng, Yingcai Wu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-20911.txt.
Introduction
Peng and co-authors test whether language model agents show real engagement patterns in a social media simulation. Fluent, human-like output alone does not prove a theory, they note. In a Weibo-like setting, they vary information load and descriptive norms. Popularity cues, such as likes and reshares, grow inside the simulation itself. Agent engagement responds in clear ways to load and norms. Sensitivity to popularity cues changes with context, rather than staying fixed. They draw lessons for simulation based communication research, including stress tests and clear baseline design.
Catalog record
| CREATOR | Tai-Quan Peng, Yuan Tian, Songsong Liang, Dazhen Deng, Yingcai Wu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59155 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.20911
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Do LLM-Driven Agents Exhibit Engagement Mechanisms? Controlled Tests of Information Load, Descriptive Norms, and Popularity Cues Tai-Quan Peng, Yuan Tian, Songsong Liang, Dazhen Deng, Yingcai Wu Abstract Large language models make agent-based simulation more behaviorally expressive, but they also sharpen a basic methodological tension: fluent, human-like output is not, by itself, evidence for theory. We evaluate what an LLM-driven simulation can credibly support using information engagement on social media as a test case. In a Weibo-like environment, we manipulate information load and descriptive norms, while allowing popularity cues (cumulative likes and Sina Weibo–style cumulative reshares) to evolve endogenously. We then ask whether simulated behavior changes in theoretically interpretable ways under these controlled variations, rather than merely producing plausible-looking traces. Engagement responds systematically to information load and descriptive norms, and sensitivity to popularity cues varies across contexts, indicating conditionality rather than rigid prompt compliance. We discuss methodological implications for simulation-based communication research, including multi-condition stress tests, explicit no-norm baselines because default prompts are not blank controls, and design choices that preserve endogenous feedback loops when studying bandwagon dynamics. Correspondence: Dr. Tai-Quan Peng, Department of Communication, Michigan State University, East Lansing, MI 48824, USA. Email: [email protected] . Keywords: large language models, simulation, social media, information engagement 1 Introduction Computational simulation has been increasingly used to study communication processes that are difficult to observe directly ( 24 ) . Large language models (LLMs) now enable researchers to construct agents that can consume information ( 22 ) , interpret messages and context ( 12 ) , and generate human-like responses and behavioral decisions at scale ( 26 ) , opening new possibilities for controlled experimentation on human behaviors and social interactions ( 2 ) . However, methodological discussions caution that behavioral resemblance alone is insufficient grounds for inference. LLM-driven agents cannot be assumed to instantiate the same underlying mechanisms as human subjects, and their outputs require validation against the theoretical processes they are meant to model ( 9 ) . As AI-generated behavior becomes increasingly fluent and contextually appropriate, the central question shifts from plausibility to mechanism: do LLM-driven agents reproduce theoretically grounded communication processes, or do they merely generate outputs that resemble them? Recent work underscores this concern. Although LLMs can produce human-like output, they may not engage in human-like reasoning ( 6 ) . Large-scale replication efforts further suggest that LLM-based simulations can inflate effect sizes or generate patterns inconsistent with original findings ( 5 ) . These findings indicate that the validity of LLM-driven simulation cannot be assumed but must be demonstrated. Rather than evaluating simulations in terms of surface realism, the methodological challenge is to test whether established cognitive or social mechanisms emerge under controlled manipulation in LLM-driven simulations ( 11 ) . This study addresses this challenge by using social media information engagement as a theoretically grounded test case. Engagement decisions on social media are widely understood to reflect informational constraints, behavioral norms, and visible social feedback ( 7 ) , yet these mechanisms are difficult to isolate because exposure volume, foregone alternatives, and algorithmic visibility are typically unobserved and endogenous. We therefore employ an LLM-based social media simulation that experimentally varies information load and descriptive normative context while allowing social feedback signals to evolve endogenously. By separating participation thresholds from engagement allocation, we examine whether theory-implied regularities emerge and interact in ways consistent with widely tested theories of attention, social influence, and normative behavior. In this sense, the simulation is designed to serve theoretical purposes: we treat LLM agents as methodological instruments for testing engagement mechanisms under controlled conditions, while also evaluating what kinds of theoretical inference such simulation can credibly support. 2 Theoretical Framework and Research Questions Research on social media engagement emphasizes three interrelated forces: informational load, behavioral norms, and popularity cues. Users allocate attention under conditions of limited cognitive resources, form expectations about what behaviors are typical, and observe visible signals indicating which content others have already responded to. Engagement therefore reflects not only message content or network structure, but also how individuals navigate the informational and social context in which choices are made. Although each of these mechanisms is well established, isolating their independent and joint effects remains difficult in observational research. On digital platforms, information load, normative signals, and popularity cues are often endogenous to algorithmic recommendation systems and user networks. Digital trace data record realized actions, but they rarely capture the full set of posts to which users were exposed, the alternatives they ignored, or the ichoice-set conditions under which decisions were made ( 21 ) . The present study uses controlled simulation to examine whether theory-implied regularities associated with information load, descriptive norms, and bandwagon effects emerge when these contextual features are systematically varied, while allowing popularity cues to evolve endogenously. Engagement as a Two-Stage Outcome Engagement is not a single, undifferentiated act. When encountering content on social media, individuals decide whether to respond at all and, conditional on responding, which engagement form to select. We therefore treat engagement as a two-stage outcome. The first stage concerns the participation threshold—whether an individual engages with a post or remains a passive reader. The second stage concerns engagement allocation—the selection among available response forms that vary in effort and visibility. This distinction clarifies how different mechanisms may operate. Information load is expected to shape participation thresholds by increasing competition among alternatives. Descriptive norms are expected to shift engagement allocation by altering which response forms are treated as typical. Popularity cues may influence both stages by signaling prior validation, thereby generating bandwagon-consistent amplification. Information Load and Attention Constraints Information load has long been understood as a fundamental constraint on information processing. Classic psychological research demonstrates that individuals possess limited cognitive capacity, such that increases in input volume alter attention allocation and depth of processing ( 14 ) . This capacity-based perspective has been extended to mediated communication contexts through models such as the Limited Capacity Model of Motivated Mediated Message Processing, which conceptualizes media users as resource-limited processors who must allocate finite resources across concurrent informational demands ( 10 ) . In social media environments characterized by abundant exposure, higher information load is therefore expected to increase competition among posts, raise engagement thresholds, and encourage more selective responding ( 19 ; 25 ; 8 ) . In this study, information load is operationalized as the number of posts presented to agents at each decision point. This manipulation varies the size of the choice set at the moment of decision, allowing us to assess whether load-sensitive engagement regularities—especially reduced participation under higher load—emerge within an LLM-driven simulation. The focus is not on attributing human cognitive limitations to artificial agents, but on testing whether established load-related behavioral regularities are reproduced under controlled variation in choice-set size. Bandwagon Effects and Popularity Cues Bandwagon effects refer to individuals’ tendency to rely on visible indicators of others’ behavior when making decisions. On social media platforms, likes, reposts, and quotes provide publicly observable popularity cues that signal attention and endorsement. Classic models of informational influence and cascade dynamics suggest that individuals may infer content value from others’ actions, even when private evaluations are available ( 3 ; 7 ) . Empirical research further shows that early popularity cues can causally