From Control to Foresight: Simulation as a New Paradigm for Human–Agent Collaboration Conference: CHI 2026 Workshop on Human-Agent Collaboration; April 13–17, 2026; Barcelona, Spain CHI 2026 Workshop on Human-Agent Collaboration, April 13–17, 2026, Barcelona, Spain ISBN: 978-1-4503-XXXX-X/2018/06
Gaole He, Brian Y. Lim · 2026
Read From Control to Foresight: Simulation as a New Paradigm for Human–Agent Collaboration Conference: CHI 2026 Workshop on Human-Agent Collaboration; April 13–17, 2026; Barcelona, Spain CHI 2026 Workshop on Human-Agent Collaboration, April 13–17, 2026, Barcelona, Spain ISBN: 978-1-4503-XXXX-X/2018/06 by Gaole He, Brian Y. Lim (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-11677.txt.
Introduction
He and Lim argue that human-agent collaboration needs foresight, not just control. Today's users approve or fix single agent actions to cut immediate risk. They get no view of what those choices cause later, so they must guess later effects in their heads. The pair propose simulation-in-the-loop: users and agents explore simulated futures together before any decision lands. Trying paths in simulation turns reactive fixes into informed exploration. It also helps users surface hidden constraints and preferences along the way.
Catalog record
| CREATOR | Gaole He, Brian Y. Lim |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 12898 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.11677
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
From Control to Foresight: Simulation as a New Paradigm for Human–Agent Collaboration Conference: CHI 2026 Workshop on Human-Agent Collaboration; April 13–17, 2026; Barcelona, Spain CHI 2026 Workshop on Human-Agent Collaboration, April 13–17, 2026, Barcelona, Spain ISBN: 978-1-4503-XXXX-X/2018/06 Gaole He, Brian Y. Lim Abstract . Large Language Models (LLMs) are increasingly used to power autonomous agents for complex, multi-step tasks. However, human-agent interaction remains pointwise and reactive: users approve or correct individual actions to mitigate immediate risks, without visibility into subsequent consequences. This forces users to mentally simulate long-term effects, a cognitively demanding and often inaccurate process. Users have control over individual steps but lack the foresight to make informed decisions. We argue that effective collaboration requires foresight, not just control. We propose simulation-in-the-loop, an interaction paradigm that enables users and agents to explore simulated future trajectories before committing to decisions. Simulation transforms intervention from reactive guesswork into informed exploration, while helping users discover latent constraints and preferences along the way. This perspective paper characterizes the limitations of current paradigms, introduces a conceptual framework for simulation-based collaboration, and illustrates its potential through concrete human-agent collaboration scenarios. 1. Introduction Equipped with toolkits such as browser search and machine access, large language models (LLMs) have shown promising potential to interact with the world and assist with more complex, multi-step tasks—ranging from travel planning to code generation ( 15 ; 18 ) . To ensure reliable and accountable outcomes, LLM agents are often supervised by humans ( 5 ; 8 ) : the agent proposes a sequence of actions, and the human is asked to approve or correct decisions at key junctures. However, this form of collaboration rests on an implicit assumption: that humans can act as oracles ( 12 ; 4 ) , making sound decisions with minimal context. In practice, when humans are inserted into multi-step workflows, they are asked to make critical decisions with limited information—without visibility into how their approval/action might shape subsequent outcomes ( 3 ) . Without visibility into downstream consequences, human intervention becomes short-sighted rather than informed collaboration ( 11 ) . In these cases, humans are forced to rely on intuition or mental simulation, both of which are prone to error—especially as task complexity grows. This limitation is especially pronounced in long-horizon tasks, where early decisions cascade into future outcomes in ways that are difficult to anticipate ( 9 ) . For example, a seemingly plausible choice ( e.g., booking a tight connection flight) can propagate through the planning horizon, amplifying or constraining downstream possibilities. Yet current human-agent interactions do not proactively support reasoning about these ripple effects. Without such support, users are left to mentally simulate alternative futures, a process that is cognitively demanding and notoriously unreliable, especially when tasks involve long-range dependencies and stochastic outcomes. For instance, a delayed flight can cascade into missed connections. Worse still, this narrow view forecloses serendipity ( 13 ) : when humans see only the immediate next step and react to it, they miss the opportunity to discover unexpected but valuable alternatives that lie off the agent’s proposed path. This results in a substantial asymmetry: while LLM agents can explore possible actions ( e.g., tree-based search over the action space ( 10 ; 1 ) ) and their subsequent impacts, the human collaborator is given access to only a single path through that tree—the trajectory proposed by the agent. We argue that addressing this asymmetry requires more than just giving humans control over actions—it requires giving them foresight into the consequences of those actions. Control without foresight is like driving at night with no headlights: you can turn the wheel, but you cannot see what lies ahead. To this end, we propose simulation-in-the-loop collaboration, an interaction paradigm that allows humans and agents to preview counterfactual future trajectories before committing to decisions. By generating and visualizing possible outcomes across multiple paths, simulation transforms human intervention from reactive guesswork into proactive exploration. It also creates space for serendipity: as users explore simulated futures, they may discover valuable alternatives or latent constraints that were not apparent from the agent’s initial proposal. In this paper, we (1) articulate the limitations of existing pointwise interaction paradigms, (2) introduce a conceptual framework and design space for simulation-based collaboration, and (3) illustrate the approach through concrete scenarios with LLM agents and other planning tasks. 2. Simulation-in-the-loop Collaboration We introduce simulation-in-the-loop collaboration, an interaction paradigm in which humans and agents jointly explore simulated future trajectories before committing to real-world actions. 2.1. Concept and Definition First, we introduce four core concepts that ground our framework: • Agentic Workflow : The unit of analysis is a multi-step task performed by an LLM agent under human oversight ( e.g., travel planning). The workflow proceeds through a sequence of actions, during which the agent may request human input. For simplicity, we can view it as a step-by-step planning-execution process ( 8 ; 5 ) : at each step, the agent predicts an action, and the human may approve, modify, or override it before execution. • Action Space : At each step, the agent considers multiple possible actions ( e.g., search flights, search relevant news, and search social media), each leading to different downstream trajectories. LLM agents inherently explore such trees during planning—through beam search ( 14 ) , Monte Carlo tree search ( 2 ; 1 ) , or implicit generation of alternatives—but this exploration typically remains internal and invisible to the human. • Simulation : We define simulation as the agent’s ability to externalize this internal exploration: before committing to a decision, the agent generates and presents multiple future trajectories for human preview. Simulation is not planning (which seeks an optimal path) but rather exploration for sensemaking—making the tree of possibilities visible and navigable. • Simulated Impact : Each simulated trajectory is annotated with key outcomes—risks, opportunities, trade-offs, uncertainties—that help humans compare alternatives. Simulated impact translates abstract futures into concrete, decision-relevant outcomes, enabling foresight rather than guesswork. Figure 1. Comparison of interaction paradigms at a decision point. (Left) Traditional pointwise collaboration: the human sees only the agent's proposed action and must decide without downstream visibility. (Right) Simulation-in-the-loop: the agent externalizes multiple possible futures with simulated impacts, enabling informed comparison and serendipitous discovery. 2.2. Illustrative Scenario We ground our framework in one concrete scenario—a multi-city trip planning. As visualized in Figure 1 , the simulation acts as an intermediate layer between agent proposals and human commitment. At a decision point, the agent must choose whether to book a tight connection between flights. In the current human-agent collaboration mode, the agent would simply propose its preferred option i.e., Path A: a direct flight with a 1-hour layover—and ask for feedback. The user, seeing only that this option is available and cheaper than alternatives, might approve without realizing the downstream risk or that lower-risk alternatives even exist. With simulation-in-the-loop, the agent externalizes multiple alternatives (Paths A-D in Figure 1 ). Path A (the agent’s proposal) is annotated with a simulated impact: 30\% delay risk due to short connection time. Path B, a later flight with a longer layover, shows no delay risk but adds \$50 cost. By comparing these simulated outcomes, the human discovers a risk they hadn’t considered and can make