On Learning Closed-Loop Probabilistic Multi-Agent Simulator
Juanwu Lu, Rohit Gupta, Ahmadreza Moradipari, Kyungtae Han, Ruqi Zhang, Ziran Wang · 2025
Read On Learning Closed-Loop Probabilistic Multi-Agent Simulator by Juanwu Lu, Rohit Gupta, Ahmadreza Moradipari, Kyungtae Han, Ruqi Zhang, Ziran Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-00384.txt.
Introduction
Juanwu Lu and five co-authors built in 2025 a probabilistic simulator that lets virtual traffic agents react to each other in a loop. Testing self-driving cars needs scenes that are varied, realistic and interactive. Their framework, NIVA, rests on a hierarchical Bayesian model. It samples each next step from a mixture of Gaussian options, conditioned on what has been observed so far.
The authors show the design unifies older trajectory predictors and newer closed-loop simulators under one Bayesian reading. It also gives users knobs for intentions and driving styles, which helps craft targeted tests. On the Waymo Open Motion data, the simulator matched the standing method's performance. The team presents it as a scalable base for evaluating driving software. Richer control may help find rare, dangerous cases before road testing.
Catalog record
| CREATOR | Juanwu Lu, Rohit Gupta, Ahmadreza Moradipari, Kyungtae Han, Ruqi Zhang, Ziran Wang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-00384
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
On Learning Closed-Loop Probabilistic Multi-Agent Simulator Juanwu Lu, Rohit Gupta, Ahmadreza Moradipari, Kyungtae Han, Ruqi Zhang, Ziran Wang Abstract The rapid iteration of autonomous vehicle (AV) deployments leads to increasing needs for building realistic and scalable multi-agent traffic simulators for efficient evaluation. Recent advances in this area focus on closed-loop simulators that enable generating diverse and interactive scenarios. This paper introduces Neural Interactive Agents (NIVA), a probabilistic framework for multi-agent simulation driven by a hierarchical Bayesian model that enables closed-loop, observation-conditioned simulation through autoregressive sampling from a latent, finite mixture of Gaussian distributions. We demonstrate how NIVA unifies preexisting sequence-to-sequence trajectory prediction models and emerging closed-loop simulation models trained on Next-token Prediction (NTP) from a Bayesian inference perspective. Experiments on the Waymo Open Motion Dataset demonstrate that NIVA attains competitive performance compared to the existing method while providing embellishing control over intentions and driving styles. I Introduction I-A Background Despite the rapid advancement of autonomous driving technologies, we expect a prolonged transitional period in which human-driven vehicles (HDVs) and autonomous vehicles (AVs) coexist [ 1 ] . In such mixed traffic, human behavior is often heterogeneous and unpredictable, while AVs are required to plan and execute optimal trajectories based on well-defined criteria. These complex, multi-agent interactions are critical to traffic safety and demand robust evaluation and prototyping tools for AV development. Fleet-based empirical testing remains the industry standard but is expensive, time-consuming, and lacks reproducibility. Log-replay datasets [ 2 , 3 ] address these issues by replaying recorded motions of surrounding agents during test drives. However, these datasets do not allow log-replay agents to respond to the evolving behavior of the AV, leading to unrealistic and ineffective evaluations [ 4 ] . Consequently, there is growing interest in interactive, closed-loop traffic simulation [ 5 ] . Traditional simulation methods—often deterministic and open-loop—fail to capture the inherent uncertainty, multimodality, and dynamic interactivity of real-world traffic. This has motivated a wave of learning-based approaches that model traffic as a stochastic process. Recent progress in closed-loop simulation with learning-based models has achieved state-of-the-art accuracy in multi-agent trajectory prediction. However, many of these models act as black boxes, offering limited interpretation and control over the underlying dynamics. This opacity makes it difficult to diagnose fidelity issues, refine behavior conditionally, or adapt models to new scenarios [ 6 ] . To address these limitations, recent work has incorporated probabilistic modeling [ 7 , 8 ] and explored ways to represent social interactions and agent preferences during future trajectory generation [ 9 ] . Fig. 1 : Overview of our simulation framework. NIVA models disentangled latent factors governing behavior styles, discrete intentions, and next-step dynamics for multi-agent interaction. I-B Related Works Early efforts focused on open-loop modeling using recorded trajectories [ 10 , 11 ] , which lacked the ability to account for dynamic and interactive behaviors. Recent benchmarks [ 5 ] have exposed these limitations, driving interest toward closed-loop simulation frameworks. The key distinction lies in conditioning: open-loop models predict future trajectories based solely on past observations, while closed-loop models continuously condition actions on evolving states as the simulation unfolds. Closed-loop modeling poses new challenges in recursive generation and scenario consistency. Early works addressed this using Markovian or recurrent models [ 4 , 7 ] . More recently, Transformer-based architectures have gained traction due to their scalability and success in autoregressive generation [ 12 , 13 , 14 ] . Some works even explore adapting pre-trained Large Language Models (LLMs) for scenario generation [ 15 ] . In parallel, generative probabilistic models have proven effective in simulating complex stochastic systems, from weather forecasting [ 16 ] to particle interactions [ 17 ] . Unlike deterministic simulators, probabilistic models explicitly learn the distribution of observations, allowing them to capture multi-modality, constraints, and uncertainty. Mixtures of Gaussians are commonly used to model the multimodal nature of human behavior [ 11 , 18 ] , while others have used probabilistic modeling to improve generalization [ 19 ] , quantify uncertainty [ 8 ] , and enable controllable scenario generation [ 9 ] . Despite these achievements, two key limitations remain underexplored. First, open-loop and closed-loop simulation models are typically treated as separate modeling paradigms—one-shot generation vs. autoregressive generation—without a unified probabilistic framework that bridges both. Meanwhile, existing models often function as opaque black boxes, limiting insight and control over the underlying behavioral dynamics. This impedes interpretability, scenario debugging, and adaptation to novel environments. I-C Contributions To address these gaps, we propose Neural Interactive Agents (NIVA), a unified probabilistic framework for multi-agent traffic simulation. Our approach reformulates the simulation task as learning a factorized generative process over behavior styles, discrete intentions, and agent dynamics. As illustrated in Fig. 1 , NIVA is a hierarchical probabilistic model that disentangles latent variables corresponding to (i) continuous behavior styles , (ii) discrete intentions , and (iii) the high-dimensional representation of the next-step actions constrained by the surrounding traffic. At its core is a decoder-only Transformer with adaptive Layer Normalization , where the normalization parameters are dynamically modulated by the latent style and intention variables. This design enables NIVA to generate multi-agent interactions conditioned on interpretable behavioral factors while unifying open-loop and closed-loop generation via hierarchical generative process. We validate our framework on the Waymo Open Motion Dataset [ 2 ] , demonstrating that NIVA achieves competitive performance with state-of-the-art baselines, while learning semantically meaningful, disentangled latent spaces that can be sampled for diverse and realistic behavior generation. Fig. 2 : The proposed Neural Interactive Agents (NIVA) architecture has three encoders for map geometry, traffic signals, and trajectory observations. Encoded features are inputs for a three-level hierarchical Bayesian model. The Adaptive-Norm Transformer in the transition model has attention layers learning correlations between agent and map and among agents, and adaptive layer normalization to condition dynamics on behavior style and intentions. II Problem Statement TABLE I : Table of Notations Notation Explanation N Number of simulated traffic participants. T_{h} Number of time steps observed in the history. T_{p} Number of time steps to simulate in the future. \boldsymbol{o}_{t}^{n} Motion state of n -th agent at time step t . \mathbf{O}_{t} A collection of all motion state observation at time step t . \boldsymbol{m}_{j} j -th map feature. \mathbf{M} A collection of map features. \mathbf{b} A continuous random variable encoding driving styles. \mathbf{z} A discrete random variable encoding intentions. \boldsymbol{s}_{t}^{n} Latent motion state representation of n -th agent at time t . \mathbf{S}_{t} The collection of all latent motion state s at time t . p(\cdot) Probability density in generative process. q(\cdot) Probability density in variational distributions. \mathcal{N}(\mu,\sigma^{2}\mathbf{I}) Gaussian distribution with diagonal covariance matrix. This paper proposes a probabilistic multi-agent traffic simulator. We focus on simulating realistic driver behaviors conditioned on observations from a fixed perception system. For readability, Table I lists the notations used in this paper. Nomenclature A traffic simulator is a model that allows the generation of scenarios described by the road infrastructure and the motion of traffic participants. We define the following terms: • A scenario consists of observations of N traffic participants, where we have observed T_{h} timesteps and would like to simulate for the consecutive T_{p} timesteps. • An observation at the time step t , denoted by the