SOCRATES: Simulation Optimization with Correlated Replicas and Adaptive Trajectory Evaluations

Haoting Zhang 1,3 Haoxian Chen 2,3 Donglin Zhan 2 Hanyang Zhao 2 Henry Lam 2 Wenpin Tang 2 David Yao 2 Zeyu Zheng 1 1 University of California, Berkeley 2 Columbia University 3 Amazon {haoting_zhang, zyzheng}@berkeley.edu {hc3136, donglin.zhan, hz2684, henry.lam, wt2319, yao}@columbia.edu · 2025

Read SOCRATES: Simulation Optimization with Correlated Replicas and Adaptive Trajectory Evaluations by Haoting Zhang 1,3 Haoxian Chen 2,3 Donglin Zhan 2 Hanyang Zhao 2 Henry Lam 2 Wenpin Tang 2 David Yao 2 Zeyu Zheng 1 1 University of California, Berkeley 2 Columbia University 3 Amazon {haoting_zhang, zyzheng}@berkeley.edu {hc3136, donglin.zhan, hz2684, henry.lam, wt2319, yao}@columbia.edu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-00685.txt.

Introduction

Haoting Zhang and seven co-authors let language models design optimization procedures for costly stochastic simulations. Simulation optimization already spans ranking-and-selection for finite choices and surrogate methods for continuous ones, but picking and mixing those tools for a new system is expert work. Their system, SOCRATES, automates that strategy work in two stages, with models reasoning over text and performance traces.

First, an ensemble of digital copies is built, guided by causal discovery from a written description of the system. Candidate algorithms then race cheaply on those copies. A language model studies their trajectories and composes a fitted, adaptive hybrid schedule, which can still be revised mid-run if real performance deviates. The pipeline targets sample efficiency on complex problems in engineering practice.

Catalog record

CREATORHaoting Zhang 1,3 Haoxian Chen 2,3 Donglin Zhan 2 Hanyang Zhao 2 Henry Lam 2 Wenpin Tang 2 David Yao 2 Zeyu Zheng 1 1 University of California, Berkeley 2 Columbia University 3 Amazon {haoting_zhang, zyzheng}@berkeley.edu {hc3136, donglin.zhan, hz2684, henry.lam, wt2319, yao}@columbia.edu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE63 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-00685

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SOCRATES: Simulation Optimization with Correlated Replicas and Adaptive Trajectory Evaluations Haoting Zhang 1,3 Haoxian Chen 2,3 Donglin Zhan 2 Hanyang Zhao 2 Henry Lam 2 Wenpin Tang 2 David Yao 2 Zeyu Zheng 1 1 University of California, Berkeley 2 Columbia University 3 Amazon {haoting_zhang, zyzheng}@berkeley.edu {hc3136, donglin.zhan, hz2684, henry.lam, wt2319, yao}@columbia.edu Abstract The field of simulation optimization (SO) encompasses various methods developed to optimize complex, expensive-to-sample stochastic systems. Established methods include, but are not limited to, ranking-and-selection for finite alternatives and surrogate-based methods for continuous domains, with broad applications in engineering and operations management. The recent advent of large language models (LLMs) offers a new paradigm for exploiting system structure and automating the strategic selection and composition of these established SO methods into a tailored optimization procedure. This work introduces SOCRATES (Simulation Optimization with Correlated Replicas and Adaptive Trajectory Evaluations), a novel two-stage procedure that leverages LLMs to automate the design of tailored SO algorithms. The first stage constructs an ensemble of digital replicas of the real system. An LLM is employed to implement causal discovery from a textual description of the system, generating a structural ‘skeleton’ that guides the sample-efficient learning of the replicas. In the second stage, this replica ensemble is used as an inexpensive testbed to evaluate a set of baseline SO algorithms. An LLM then acts as a meta-optimizer, analyzing the performance trajectories of these algorithms to iteratively revise and compose a final, hybrid optimization schedule. This schedule is designed to be adaptive, with the ability to be updated during the final execution on the real system when the optimization performance deviates from expectations. By integrating LLM-driven reasoning with LLM-assisted trajectory-aware meta-optimization, SOCRATES creates an effective and sample-efficient solution for complex SO optimization problems. \workshoptitle MLxOR: Mathematical Foundations and Operational Integration of Machine Learning for Uncertainty-Aware Decision-Making 1 Introduction Figure 1: Pipeline of SOCRATES: Stage 1 learns an ensemble of operational AI replicas; Stage 2 employs these inexpensive replicas to evaluate and revise SO algorithms. The final SO algorithm is tailored to the real system before deployment, and an online adaptation is feasible when needed. Stochastic systems can exhibit complex structures where system performance is not an analytical function of the decision variables but rather a surface that can only be evaluated through noisy samples. In many applications, the goal is to search the feasible set of decision variables in order to optimize system performance, which motivates the field of simulation optimization (SO) by regarding collecting system samples as simulations eckman2023simopt ; peng2025review . For problems with a finite set of decisions, ranking-and-selection procedures are designed to efficiently allocate simulation budgets to identify the best decision with statistical confidence ni2017efficient ; hong2021review ; keslin2024ranking ; bai2025calibrating . When the decision variables are within in a continuous space, surrogate model-based algorithms are employed to approximate the system performance to optimize barton2009simulation ; zhang2021neural ; hong2021surrogate ; a leading representative is Bayesian optimization frazier2018bayesian ; cakmak2020bayesian ; chen2023pseudo ; zhan2025collaborative , which employs a probabilistic model, such as a Gaussian process chen2013enhancing ; barton2014quantifying ; ryzhov2016convergence ; zhang2023bayesian ; zhang2023contextual ; li2023inference , to guide the optimization in a sample-efficient manner. Additionally, for highly non-structural and complex system performance, meta-heuristics methods provide a flexible and scalable framework zhou2013sequential ; hu2014model . On the other hand, most SO methods remain general-purpose black-box procedures. Because samples are costly and noisy, there has been comparatively limited work on tailoring SO algorithms to specific problem instances or domains, leaving per-instance adaptation underexplored. These open challenges create an opportunity for large language models (LLMs) to inject structure and prior knowledge into the SO pipeline. A key frontier involves leveraging LLMs’ extensive pre-training and semantic reasoning abilities to translate natural language problem descriptions into optimization components. Research in this area has progressed from foundational benchmarks that parse problem statements into mathematical representations nl4opt2022 to advanced multi-agent frameworks that break down the modeling pipeline into specialized roles like formulation, planning, and code generation thind2025optimai . Concurrently, a significant research trend focuses on fine-tuning LLMs on domain-specific data to create specialized optimization assistants, enhancing both performance and data privacy orlm2024 ; jiang2025llmopt . Beyond formulation and algorithm execution supported by LLMs, another paradigm employs LLMs as engines for methodological discovery, where program-synthesis and evolutionary loops produce verifiable new algorithms and heuristics wu2024survey . Such approaches have yielded novel discoveries in mathematical sciences and improved heuristics for complex optimization problems by evolving semantic reasoning with executable implementations under automated evaluation funsearch2024 ; eoh2024icml ; surina2025evotune . Building on these opportunities, we propose SOCRATES (Simulation Optimization with Correlated Replicas and Adaptive Trajectory Evaluations) —an LLM-driven meta-optimizer krus2003optimizing that evaluates and refines SO algorithms prior to deployment on complex, expensive-to-sample stochastic systems. Our procedure has two stages. First, we use an LLM’s reasoning ability to infer a structural “skeleton” from the system’s textual description, which guides data-efficient, structure-aware learning of an ensemble of system replicas (Sec. 2.1 ). This learning supports flexible selection of AI models and methods; we term the replicas Operational AI Replicas (OARs) . These OARs have an affinity to digital twins wang2020simulation ; matta2023digital , yet are purpose-built for evaluating and revising operations prior to deployment. In the second stage (Sec. 2.2 ), using the learned replicas as a testbed, we iteratively invoke LLMs as a meta-optimizer to analyze optimization-trajectory ensembles and select and refine a final SO algorithm. The resulting SO algorithm is tailored to the problem’s structure before deployment on the expensive real system. Finally, the procedure is adaptive: during execution on the real system, if the observed trajectory deviates from expectation, the twin ensemble can be updated and the optimization strategy revised for the remaining budget. A similar adaptive-feedback loop appears in Rich Preference Optimization (RPO) zhao2025fine , where the system iteratively critiques, edits, and relabels preferences to refine a diffusion model. The entire pipeline is summarized in Figure 1 . 2 Methodology 2.1 OAR Construction via LLM–Guided Causal Skeleton and EM Learning Problem setting. We build an OAR from two inputs: (i) a textual specification \mathcal{P} with system components, mechanism, constraints, etc. in natural language and (ii) a historical dataset \mathcal{H}=\{(x_{i},y_{i})\}_{i=1}^{N} of controllable inputs x and observed objective y . A key challenge is the mismatch between system complexity and data scarcity (limited observations for expensive sampling). To address this, we 1) leverage LLMs to build a causal ‘skeleton’ that represents the system structure and 2) implement a expectation-maximization (EM)-type data-efficient learning procedure: 2.1.1 Step 1: Causal Skeleton Inference with LLMs We first use LLMs to infer a causal skeleton G=(V,E) over the system variables listed in the textual description \mathcal{P} . Here, V is the set of variables listed in \mathcal{P} , E denotes the set of edges that represent the causal relations between variables v\in V , and G is a directed acyclic graph (DAG) that summarizes the causal relations and mechanism of the system. To infer the DAG from the textual description \mathcal{P} , a breadth-first search (BFS) causal discovery procedure over variables V involves the following steps: 1. Initialization: Prompt the LLM with all variable names/descriptions and ask it to select the set of exogenous variables (not caused by any others). These seed a BFS queue.

Read the complete text