PolicySim: An LLM-Based Agent Social Simulation Sandbox for Proactive Policy Optimization Conference: Proceedings of the ACM Web Conference 2026; April 13–17, 2026; Dubai, United Arab Emirates. Proceedings of the ACM Web Conference 2026 (WWW ’26), April 13–17, 2026, Dubai, United Arab Emirates ISBN: 979-8-4007-2307-0/2026/04 DOI: 10.1145/3774904.3792555 CCS: Computing methodologies Modeling and simulation
Renhong Huang, Ning Tang, Jiarong Xu, Yuxuan Cao, Qingqian Tu, Sheng Guo, Bo Zheng, Huiyuan Liu, Yang Yang · 2026
Read PolicySim: An LLM-Based Agent Social Simulation Sandbox for Proactive Policy Optimization Conference: Proceedings of the ACM Web Conference 2026; April 13–17, 2026; Dubai, United Arab Emirates. Proceedings of the ACM Web Conference 2026 (WWW ’26), April 13–17, 2026, Dubai, United Arab Emirates ISBN: 979-8-4007-2307-0/2026/04 DOI: 10.1145/3774904.3792555 CCS: Computing methodologies Modeling and simulation by Renhong Huang, Ning Tang, Jiarong Xu, Yuxuan Cao, Qingqian Tu, Sheng Guo, Bo Zheng, Huiyuan Liu, Yang Yang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-19649.txt.
Introduction
Huang and co-authors present PolicySim, a sandbox that simulates social platforms with language model agents. Platform policies like recommendation and filtering can deepen echo chambers. Testing them live finds risks only after harm is done. PolicySim models users and platform moves as a two-way dynamic. A user agent module is fine-tuned for platform-specific realism. An adaptive intervention module uses a contextual bandit with message passing. Experiments show faithful simulation at micro and macro levels. The sandbox supports proactive policy tuning before launch.
Catalog record
| CREATOR | Renhong Huang, Ning Tang, Jiarong Xu, Yuxuan Cao, Qingqian Tu, Sheng Guo, Bo Zheng, Huiyuan Liu, Yang Yang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56033 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.19649
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
PolicySim: An LLM-Based Agent Social Simulation Sandbox for Proactive Policy Optimization Conference: Proceedings of the ACM Web Conference 2026; April 13–17, 2026; Dubai, United Arab Emirates. Proceedings of the ACM Web Conference 2026 (WWW ’26), April 13–17, 2026, Dubai, United Arab Emirates ISBN: 979-8-4007-2307-0/2026/04 DOI: 10.1145/3774904.3792555 CCS: Computing methodologies Modeling and simulation Renhong Huang, Ning Tang, Jiarong Xu, Yuxuan Cao, Qingqian Tu, Sheng Guo, Bo Zheng, Huiyuan Liu, Yang Yang Abstract . Social platforms serve as central hubs for information exchange, where user behaviors and platform interventions jointly shape opinions. However, intervention policies like recommendation and content filtering, can unintentionally amplify echo chambers and polarization, posing significant societal risks. Proactively evaluating the impact of such policies is therefore crucial. Existing approaches primarily rely on reactive online A/B testing, where risks are identified only after deployment, making risk identification delayed and costly. LLM-based social simulations offer a promising pre-deployment alternative, but current methods fall short in realistically modeling platform interventions and incorporating feedback from the platform. Bridging these gaps is essential for building actionable frameworks to assess and optimize platform policies. To this end, we propose PolicySim, an LLM-based social simulation sandbox for the proactive assessment and optimization of intervention policies. PolicySim models the bidirectional dynamics between user behavior and platform interventions through two key components: (1) a user agent module refined via supervised fine-tuning (SFT) and direct preference optimization (DPO) to achieve platform-specific behavioral realism; and (2) an adaptive intervention module that employs a contextual bandit with message passing to capture dynamic network structures. Experiments show that PolicySim can accurately simulate platform ecosystems at both micro and macro levels and support effective intervention policy. † † cc-license: by 1. Introduction Figure 1 . Compared to A/B testing, which reactively assesses interventions by deploying and learning only after outcomes are observed, PolicySim proactively assesses and optimizes intervention policies prior to deployment via feedback. In today’s digital era, social platforms have become the core infrastructure for social interaction and information exchange ( 29 ; 26 ; 61 ) . Platform intervention policies fundamentally shape users’ interactive behaviors including information consumption, content sharing, and social engagement, through intervention mechanisms such as recommender systems ( 30 ; 71 ; 66 ; 68 ) , content filtering ( 53 ) , and exposure control ( 15 ) . Collectively, these intervention mechanisms shape users’ online experiences and exert a profound influence on opinion formation and decision-making processes ( 16 ; 10 ; 15 ) . However, inappropriate platform intervention policies can trigger unintended and even deleterious consequences, as social platforms’ inherent tendency to amplify information can magnify the negative effects of such policies beyond their initial expectations ( 30 ; 71 ; 53 ) . For instance, numerous studies have demonstrated that recommender systems can foster the emergence of echo chambers and filter bubbles ( 10 ; 6 ) , thereby suppressing cross-viewpoint dialogue and reducing stance diversity ( 5 ) . At the same time, platform interventions that prioritize user engagement may increase polarization and conflict, undermining public trust and attracting regulatory scrutiny ( 50 ) . Consequently, a key research challenge is to assess the potential social impacts of intervention policies in a proactive and systematic manner prior to deployment . Existing evaluation methods primarily rely on the A/B testing to assess intervention policies ( 17 ) , requiring direct deployment in real user environments to collect behavioral feedback, as illustrated in Figure 1 (a). However, this paradigm suffers from several limitations: (i) evaluation is reactive rather than proactive; (ii) feedback loops are often delayed and therefore cannot keep pace with rapid platform dynamics; and (iii) directly testing in real-world environments may introduce uncontrollable and potentially irreversible harmful consequences. Thus, reliance on A/B testing alone is insufficient for the prospective evaluation of intervention policies, highlighting the need for proactive, risk-aware alternatives. Recent advances in large language model (LLM)-based simulation, enabled by their strong generative and reasoning capabilities, offer a promising direction. Prior works include traditional agent-based models ( 23 ; 54 ) and LLM-based agent simulation frameworks ( 7 ; 38 ; 46 ; 67 ) . Both types of models have been used to study complex social phenomena, including opinion dynamics ( 8 ) , economic systems ( 35 ) , and social norm alignment ( 52 ) . Nevertheless, several challenges remain unresolved in current works. (i) Most simulations do not explicitly model platform intervention policies, making it difficult to accurately capture their effects. (ii) Their agent design often relies heavily on prompt engineering rather than realistic modeling of social media behavior, which limits the credibility of simulated outcomes. (iii) Existing frameworks lack principled mechanisms for leveraging simulation feedback to optimize real-world intervention policies, limiting the use of simulation outcomes for iterative improvement of real-world policies. To bridge these gaps, we present PolicySim, a LLM-based multi-agent social simulation sandbox for the proactive assessment and optimization of intervention policies. The framework captures the bidirectional dynamics between intervention strategies and ecosystem evolution, as well as the influence of interventions on user behavior patterns. To achieve this, the framework introduces a user agent module and an intervention policy module. Specifically, the user agent module is introduced as a novel paradigm for training social agents that integrates supervised fine-tuning (SFT) with direct preference optimization (DPO). This unified approach jointly enhances the behavioral faithfulness of agents to platform-specific user data and improves the distinctiveness of user intent representations. Building upon the simulation, the intervention policy module is introduced to collect rewards from the sandbox and adaptively optimize intervention policies. This module employs a contextual bandit algorithm that balances exploration and exploitation while leveraging message passing to capture dynamic user networks. We incorporate multiple intervention policies, such as recommender systems and exposure control ), deployed on X and Weibo platforms. Scale Relation IP. AI. Env. PolicySim 1000 ✓ ✓ ✓ X & Weibo Oasis ( 67 ) 1M ✓ ✓ ✗ X & Reddit Agent4rec ( 70 ) 1000 ✓ ✓ ✗ Movie Rec HiSim ( 45 ) 700 ✗ ✗ ✗ X Stopia ( 73 ) 2 ✗ ✗ ✗ - Table 1 . Comparison of our system with recent social simulation frameworks. Scale: number of LLM agents; Relation: whether follow/follower links evolve; IP/AI: presence of intervention policy and adaptive interventions; Env.: underlying platform (“–” means unspecified). Our contributions are summarized as follows: • We propose PolicySim, a LLM-based multi-agent social simulation sandbox for the proactive assessment and optimization of intervention policies. • To enhance LLM-based agent simulation fidelity, we propose, for the first time, a unified paradigm for training social agents that combines SFT and DPO, which ensures behavioral alignment with platform data while capturing diverse user intents. • To enable adaptive optimization of intervention policy, we employ a contextual bandit framework that balances exploration and exploitation, augmented with message passing to capture dynamic network structures and information flows. • Extensive experiments across multiple datasets verify the realism of agent behaviors and the effectiveness of intervention optimization, showing that PolicySim enables scalable and proactive assessment of intervention policies. The paper is organized as follows. § 2 presents the social simulation sandbox, comprising user-agent and intervention-policy modules. Building on this sandbox, § 3 introduces adaptive intervention