APS: Bias-Controlled Adaptive Prototype Simulation for Population-Scale LLM Agents

Quan Zheng , Yan Gao , Shaobin He , Haoxiang Guan Yuanhe Tian , Jie Feng , Ming Wang , Shuxin Zheng , Zhen Liu Beijing Normal University Zhongguancun Academy, Beijing, China Zhongguancun Institute of Artificial Intelligence [email protected], [email protected] · 2026

Read APS: Bias-Controlled Adaptive Prototype Simulation for Population-Scale LLM Agents by Quan Zheng , Yan Gao , Shaobin He , Haoxiang Guan Yuanhe Tian , Jie Feng , Ming Wang , Shuxin Zheng , Zhen Liu Beijing Normal University Zhongguancun Academy, Beijing, China Zhongguancun Institute of Artificial Intelligence [email protected], [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-27419.txt.

Introduction

Quan Zheng and colleagues scale LLM-agent population simulation with Adaptive Prototype Simulation. The framework queries core prototypes, singleton tails, and shadow-audit agents instead of every agent each round, correcting bias from audit residuals. In a 10 million-agent opinion run it cuts online calls more than 380-fold while closely matching the full-LLM reference.

Catalog record

CREATORQuan Zheng , Yan Gao , Shaobin He , Haoxiang Guan Yuanhe Tian , Jie Feng , Ming Wang , Shuxin Zheng , Zhen Liu Beijing Normal University Zhongguancun Academy, Beijing, China Zhongguancun Institute of Artificial Intelligence [email protected], [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31104
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.27419

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

APS: Bias-Controlled Adaptive Prototype Simulation for Population-Scale LLM Agents Quan Zheng , Yan Gao , Shaobin He , Haoxiang Guan Yuanhe Tian , Jie Feng , Ming Wang , Shuxin Zheng , Zhen Liu Beijing Normal University Zhongguancun Academy, Beijing, China Zhongguancun Institute of Artificial Intelligence [email protected], [email protected] Abstract LLM-agent simulation offers a flexible computational tool for studying population response trajectories that depend on scenario events, memory, demographics, and evolving social context. However, full multi-round simulation scales linearly with both population size and horizon, requiring every agent to query the LLM at every round. We propose Adaptive Prototype Simulation (APS) , a framework that reframes scalable LLM-based simulation as a recurrent oracle-allocation problem. APS retains the designated LLM as the online transition oracle while querying adaptive core prototypes, selected singleton-tail agents, and shadow-audit agents. Prototype responses induce local response surfaces for nearby agents, reducing online LLM calls without replacing the underlying transition model. To control approximation bias, shadow-audit residual correction estimates propagation residuals for aggregate correction and future budget allocation, while tail-protected singleton routing directly queries selected isolated, heterogeneous, or high-curvature regions that are vulnerable to smoothing. Theoretically, we treat APS as an estimator for full-scale high-precision individual social simulation, and decompose its errors into prototype-coverage error, shadow-audit residual-correction error, local-propagation bias, and temporal context mismatch. Under the reported protocols, APS gives lower reference-aligned distributional discrepancy than scale-oriented and same-budget baselines while reducing online LLM calls, with ablations and compact robustness checks diagnosing the main bias-control mechanisms. In a 10M-agent, multi-round public-opinion simulation, APS achieves a 381.1 × 381.1\times reduction over full simulation, with reference-aligned final-round JSD 0.094 against the corresponding full-LLM reference. 1 Introduction Large language models make it possible to build social agents whose responses depend on scenario prompts, memory, demographics, and evolving social context ( park2023generative ; wang2024surveyagents ; guo2024multiagent ) . This can expand classical agent-based modeling beyond hand-crafted transition rules ( epstein1996growing ; macy2002factors ; castellano2009statistical ) , but it creates a computational bottleneck: simulating N agents for T rounds requires O(NT) online LLM calls. Existing strategies either keep rich prompts but simulate only small “micro-societies” ( park2023generative ; li2023camel ) , or reduce repeated LLM calls through serving optimizations, routing, or learned proxies ( frantar2023gptq ; leviathan2023fast ; chen2023frugalgpt ; kwon2023efficient ; guan2025earthscale ) . These lines reduce different costs, but they do not by themselves provide a recurrent population-transition estimator that keeps the specified LLM in the online loop while accounting for propagation bias, tail smoothing, and temporal context mismatch. We propose Adaptive Prototype Simulation (APS) , a framework for scalable LLM-agent population simulation that treats scaling as recurrent LLM-oracle allocation. APS selects representative prototypes, queries their LLM-induced responses under the current scenario and social context, and applies these transitions to similar agents. Across rounds, APS reallocates prototype budgets using stratum size, residual error, and local similarity and curvature diagnostics rather than a fixed representative schedule. Compared with prior cost-reduction strategies for large-scale simulation, APS reduces online calls without replacing the specified LLM transition with a trained proxy; queried prototype LLM responses remain the semantic anchors for same-round propagation. The key challenge is approximation bias. Agents assigned to similar prototypes can still exhibit different LLM-induced transitions, and this mismatch can affect later prompts through recurrent states and neighbor summaries. APS uses two complementary bias-control mechanisms. Shadow-audit residual correction uses shadow-audit queries to estimate discrepancies between local-response-surface predictions and individual LLM responses; these residuals correct aggregate transition estimates and inform future budget allocation toward high-error, high-curvature, or low-recall regions. Tail-protected singleton routing directly queries selected isolated feature-space agents and removes them from the smoothing operator, reducing the risk that selected isolated, heterogeneous, or high-curvature feature-space regions are absorbed by dominant prototypes. We study the computational problem of approximating the population transition induced by full LLM-agent simulation, not the behavioral-validity problem of proving that LLMs model human populations. The central idea is to turn prototype propagation from an unchecked compression heuristic into an audited oracle-allocation loop: prototypes anchor same-round semantics, tail-protected singleton routing reduces smoothing of selected isolated agents, and shadow-audit residuals correct aggregate estimates while steering future queries. APS is specified by oracle anchoring, tail-protected singleton routing, shadow-audit residual correction, and the separation of recurrent hard states from audit-corrected reporting; the partitioner and local-response-surface operator are replaceable implementation choices, and our empirical claims are limited to the reported protocols. Our contributions are organized in three layers: • APS framework for population-scale LLM agents. APS keeps the LLM as the online transition oracle, queries adaptive core prototypes each round, and propagates their same-round transitions to the full population while maintaining recurrent social context. Its allocation rule dynamically shifts prototype budgets across strata according to residual error, local similarity diagnostics, and stratum size, rather than fixed representative quotas. • Bias control for prototype propagation. APS reduces approximation bias introduced by prototype propagation through shadow-audit residual correction and tail-protected singleton routing. Shadow-audit residuals correct aggregate estimates and inform future budget allocation toward high-error, high-curvature, or low-recall regions; tail-protected singleton routing directly queries selected isolated agents vulnerable to prototype smoothing. • Analysis and large-scale evaluation. We formalize the dynamic LLM transition estimand, decompose error into prototype coverage, shadow-audit residual-correction, core local-propagation, and temporal context mismatch terms, and evaluate APS through a 10M-agent, 8-round simulation with 381.1\times fewer calls, same-budget baselines, ablations, a 10K trajectory check, and scenario, LLM backend, and stratification backend robustness checks. 2 Related Work Generative agents and related systems show that LLMs can drive memory-based routines, social interaction, role play, and survey-like behavior in small-to-medium populations ( park2023generative ; li2023camel ; chen2024agentverse ; zhou2024sotopia ; argyle2023out ; aher2023using ; park2024generative1000 ; ashery2025emergent ) . As researchers use LLM agents to study population-level regularities closer to real-world social dynamics, recent surveys document this shift, and large-scale systems and the large population models framework scale simulation via platforms, learned surrogates, differentiable population-scale frameworks, and topology-aware grouping ( gao2024llmabm ; mou2024individual ; gao2024s3 ; vezhnevets2023concordia ; tang2024gensim ; piao2025agentsociety ; guan2025earthscale ; chopra2025largepopulationmodels ; xu2026toposim ) . This shift makes cost a central bottleneck, and serving work lowers per-call inference cost through quantization, speculative decoding, routing, and memory management ( frantar2023gptq ; leviathan2023fast ; chen2023frugalgpt ; sheng2023flexgen ; kwon2023efficient ) . However, cost-reduction strategies often trade off LLM anchoring or error control: learned proxies move the transition rule into trained models, grouped representatives or static propagation leave unqueried agents dependent on local approximations, and serving-level optimizations reduce per-call cost without defining a recurrent population-transition estimator with propagation-bias diagnostics. Compared with these lines of work, APS addresses the cost–fidelity gap by keeping the specified LLM as the online transition oracle while reducing online calls through adaptive prototype simulation. It queries core prototypes and singleton-tail agents, propagates same-round prototype responses through local response surfaces, and dynamically allocates prototype budgets using stratum size, residual error, and local similarity diagnostics. For error control, shadow-audit residual correction estimates propagation residuals for aggregate correction and future budget allocation, while tail-protected singleton routing directly queries selected isolated, heterogeneous, or high-curvature feature-space regions vulnerable to smoothing. Additional related-work details are discussed in Appendix . 3 Adaptive Prototype Simulation Figure 1: Overview of Adaptive Prototype Simulation (APS). Each round, APS builds prompts from profiles, scenario events, pre-round

Read the complete text