Simulation Agent: A Framework for Integrating Simulation and Large Language Models for Enhanced Decision-Making

Jacob Kleiman, Kevin Frank, Joseph Voyles, Sindy Campagna · 2025

Read Simulation Agent: A Framework for Integrating Simulation and Large Language Models for Enhanced Decision-Making by Jacob Kleiman, Kevin Frank, Joseph Voyles, Sindy Campagna (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-13761.txt.

Introduction

Jacob Kleiman, Kevin Frank, Joseph Voyles, and Sindy Campagna join two tools that each cover the other's weakness. Simulations copy real systems faithfully but baffle non-experts. Language models chat in plain words but lack a grounded sense of cause and effect. Their 2025 framework, Simulation Agent, wires the two together.

In their design, users talk to the language model, which runs the simulation behind the scenes. The simulation, in turn, keeps the model's answers tied to a structured model of the world. The authors present the pairing as a base for testing ideas with real data across many fields. Decision makers could explore what-if questions in plain language, with the math checked by the model underneath.

Catalog record

CREATORJacob Kleiman, Kevin Frank, Joseph Voyles, Sindy Campagna
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-13761

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Simulation Agent: A Framework for Integrating Simulation and Large Language Models for Enhanced Decision-Making Jacob Kleiman, Kevin Frank, Joseph Voyles, Sindy Campagna Abstract Simulations, although powerful in accurately replicating real-world systems, often remain inaccessible to non-technical users due to their complexity. Conversely, large language models (LLMs) provide intuitive, language-based interactions but can lack the structured, causal understanding required to reliably model complex real-world dynamics. We introduce our simulation agent framework, a novel approach that integrates the strengths of both simulation models and LLMs. This framework helps empower users by leveraging the conversational capabilities of LLMs to interact seamlessly with sophisticated simulation systems, while simultaneously utilizing the simulations to ground the LLMs in accurate and structured representations of real-world phenomena. This integrated approach helps provide a robust and generalizable foundation for empirical validation and offers broad applicability across diverse domains. INDEX TERMS – AI, Agent, Simulation Model, Digital Twin, LLM 1 Introduction Acting as conceptual frameworks or computational systems, simulations are crucial for representing the dynamics of complex environments. By simulating system structures, interactions, and feedback loops, they empower scenario analysis, forecasting, and informed decision-making, serving as practical and detailed virtual representations of real-world systems [ 14 ] . These tools replicate essential system behaviors, causal relationships, and dynamic feedback, enabling in-depth analysis and exploration within controlled, virtual environments [ 21 ] . However, these modeling techniques, while powerful, often present usability and accessibility barriers to non-technical users due to their inherent complexity [ 18 ] . As highlighted in research on user-focused cross-domain testing, challenges related to usability and accessibility can significantly impact the interpretability and practical effectiveness of software systems, especially AI-driven ones [ 3 ] . Consequently, running simulations and exploring various scenarios frequently requires substantial technical expertise and manual intervention. Such complexity hinders users’ ability to effectively interpret simulation outputs, limiting the models’ accessibility, flexibility, and broader practical application. The absence of intuitive, user-friendly interfaces can further restrict their usefulness, particularly in fast-paced business contexts where decision-makers require rapid, comprehensible insights. Ultimately, even the most accurate simulation models may fail to inform decision-making if its outputs remain inaccessible, difficult to interpret, or opaque to the intended users. In parallel, LLMs have been explored as potential simulation models due to their natural language interfaces and impressive generative capabilities [ 20 ] . However, relying solely on LLMs as representative models can present some challenges. LLMs often lack a fundamental understanding of real-world physics and structured, dynamic processes [ 8 ] . This deficiency leads to ”hallucinations” - fabricated or factually incorrect outputs - when LLMs are prompted to act as world models [ 26 ] . The non-transparent nature of LLM outputs, lacking verifiable data or clear reasoning, further undermines their reliability for critical decision-making in business and other high-stakes domains [ 11 ] [ 22 ] . Trust and accuracy are necessary in these contexts; therefore, standalone LLMs can be insufficient. Addressing the limitations of simulations and LLMs as independent tools, we propose our simulation agent framework, an integrated, versatile approach designed to combine their strengths. Our framework leverages simulations to provide accurate system representations grounded in real-world dynamics. Concurrently, it employs AI Agents, LLMs enhanced with additional capabilities such as external data access, tool usage, and contextual reasoning and memory, as intelligent interpreters and facilitators. This significantly enhances the adaptability, flexibility, and usability of the overall system. By granting the AI Agent access to simulation models and embedding contextual knowledge of their construction and operation, our simulation agent framework empowers users to navigate simulations, interpret complex results, and test diverse scenarios through natural language interactions. This integration helps make sure that while simulations maintain precision and fidelity, the AI Agent unlocks their accessibility, making sophisticated system analysis available even to non-technical users. Our framework, therefore, offers a robust and adaptable approach capable of supporting effective and informed decision-making across complex and dynamic environments that generalizes to any type of model and use case. 2 Related Works Recent research at the intersection of simulation modeling and LLMs reflects a growing interest in bridging natural language interfaces with sophisticated computational environments. Broadly, related efforts can be organized into two themes: (1) enabling AI agents to autonomously make decisions and take actions within simulated environments, and (2) harnessing LLMs to improve the usability and explainability of complex modeling processes. Below, we discuss these areas and highlight the gaps that motivate our framework. 2.1 AI-Driven Agents in Simulated Environments A key line of research has explored integrating LLMs to create believable, autonomous agents capable of rich interactions within simulated worlds [ 4 ] . For instance, previous work demonstrates AI-driven agents that exhibit convincing human-like behaviors within interactive sandbox environments, complete with memory, reflection, and planning [ 17 ] . These generative agents autonomously engage in social interactions, showing emergent behaviors that mimic real-world complexities. Similarly, LLMs have been leveraged to simulate diverse users for product design, systematically uncovering a breadth of user requirements through orchestrated interactions among agents [ 1 ] . Such an approach captures latent user needs that might otherwise be missed through conventional methods. Related research has further underscored the versatility of LLM-based agents by developing language-instructible embodied agents that operate across diverse 3D environments, grounding language understanding in perception and action [ 19 ] . Expanding these ideas to social and organizational modeling, recent studies demonstrate how coupling agent-based simulation with LLMs offers rich, context-aware interactions among simulated agents, capturing nuanced dialogues and decision-making processes [ 5 ] . However, grounding these agents in empirically valid models remains challenging, particularly due to a) risks of hallucinations that compromise model fidelity and b) a lack of real evidence supporting decisions. Collectively, this research highlights how LLM-driven agents serve as adaptable, interactive layers for simulated environments but also emphasizes ongoing challenges in robust grounding and transparency. Previous research also has explored using multi-agent systems to interact with simulations for optimizing parameter configurations. For example, Xia et al. (2024) introduced agents with specialized roles - observation, reasoning, decision-making, and summarization - designed to control model execution and optimize outcomes [ 23 ] . In contrast, our simulation agent framework goes beyond optimization. It supports broader analytical exploration by running multiple scenarios in parallel via API calls, without modifying the simulation’s internal code - a key limitation of prior methods. This makes our framework more flexible and easier to integrate across diverse simulation models. 2.2 LLMs for Usability, Explainability, and Model Construction As simulation models grow more complex, researchers have investigated how LLMs can enhance model usability and interpretability. Recent studies explore generating natural-language explanations of model behaviors, facilitating insights for decision-makers without deep technical expertise [ 16 ] . This aligns with the broader need for making simulation results comprehensible to non-technical stakeholders. Additionally, AI agents have been used to streamline specialized simulations by helping technical users with code editing, case configuration, and execution, reducing complexity and improving accessibility [ 25 ] . However, the system referenced was tied to a specific software, lacked simulation model agnosticism, and was designed solely for technical users. Additional efforts have focused on automating the development of system dynamics models by leveraging LLMs. These approaches extract causal structures from text and translate

Read the complete text