Scalable Environments Drive Generalizable Agents

Jiayi Zhang, Fanqi Kong, Guibin Zhang, Maojia Song, Zhaoyang Yu, Jianhao Ruan, Jinyu Xiang, Bang Liu, Chenglin Wu, Yuyu Luo · 2026

Read Scalable Environments Drive Generalizable Agents by Jiayi Zhang, Fanqi Kong, Guibin Zhang, Maojia Song, Zhaoyang Yu, Jianhao Ruan, Jinyu Xiang, Bang Liu, Chenglin Wu, Yuyu Luo (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-18181.txt.

Introduction

Jiayi Zhang's 2026 position paper argues that agents that cope well need varied worlds to train in, not just more runs or tasks. More experience under fixed rules leaves agents brittle when interfaces, dynamics, observations, or feedback change. The paper splits three kinds of growth by what each changes in the rule set that runs the world. It contrasts hand-coded builders, prized for control and checkability, with world models that learn to make worlds, prized for breadth, and sketches learning rules that carry across worlds.

Catalog record

CREATORJiayi Zhang, Fanqi Kong, Guibin Zhang, Maojia Song, Zhaoyang Yu, Jianhao Ruan, Jinyu Xiang, Bang Liu, Chenglin Wu, Yuyu Luo
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41401
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.18181

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Scalable Environments Drive Generalizable Agents Jiayi Zhang, Fanqi Kong, Guibin Zhang, Maojia Song, Zhaoyang Yu, Jianhao Ruan, Jinyu Xiang, Bang Liu, Chenglin Wu, Yuyu Luo Abstract Generalizable agents should adapt to diverse tasks and unseen environments beyond their training distribution. This position paper argues that such generalization requires environment scaling: expanding the distribution of executable rule-sets that agents interact with, rather than only increasing trajectories or tasks within fixed benchmarks. Current scaling practices largely focus on collecting more experience or broader task sets under fixed interaction rules, leaving agents brittle when underlying interfaces, dynamics, observations, or feedback signals change. The core challenge is therefore a world-level distribution shift: agents need systematic exposure to environments with meaningfully different executable rule-sets. To clarify this challenge, we propose a unified taxonomy that separates trajectory scaling, task scaling, and environment scaling by their primary deliverables and by what changes in the executable rule-set. Building on this taxonomy, we synthesize construction paradigms for scalable environments, contrasting programmatic generators that prioritize controllability and verifiability with generative world models that offer broader coverage and open-endedness. We further outline how environment scaling can be coupled with stateful learning mechanisms, emphasizing learned update rules for cross-environment adaptation. We conclude by discussing alternative perspectives and argue that scalable environments provide the essential substrate for measurable and controllable progress toward robust general agents. 1 Introduction Figure 1: Bottleneck shifts as we scale agents: from static data to interactive worlds. Different scaling targets yield different primary gains: LM data improves language and knowledge; trajectories improve policy competence; tasks improve environment generalization within a fixed rule set; environments enable cross-environment adaptation under changing rules and interfaces. Progress in general agents increasingly depends on acquiring diverse, high-quality experience through interaction, not only on scaling model parameters or static corpora [ 23 , 28 ] . Humans and artificial agents improve by acting in environments, observing consequences, and accumulating knowledge [ 10 , 38 , 39 , 22 ] . This shifts the bottleneck from model capacity to experience supply, namely, how to generate interaction data that reliably drives continual improvement. A defining feature of general intelligence is competence across environments, transferring skills under changes in executable rules, including action interfaces, transition dynamics, and observation processes. Humans exhibit this because our accessible environment distribution is effectively unbounded; we can enter and create new digital and physical worlds with different rules, tools, and interaction patterns [ 40 ] . Crucially, humans do not merely accumulate experience; we actively explore and manipulate new environments to infer latent rules and affordances, building a highly adaptive world model [ 37 ] that supports fast skill acquisition and robust adaptation even in previously unseen worlds [ 25 ] . In contrast, today’s Language agents are typically trained and evaluated within a narrow set of fixed environments, and their performance often collapses when these rules shift. This is not merely a shortage of data within one benchmark; it is a world distribution shift problem. Recent work increasingly uses the term environment scaling to describe heterogeneous practices: scaling trajectories in a fixed benchmark [ 21 , 18 ] , expanding task sets under fixed rules [ 30 , 17 ] , or constructing new worlds with different rules altogether [ 29 , 6 , 33 , 43 ] . This conceptual overload obscures what is being scaled and makes comparisons difficult. Trajectory scaling and task scaling are valuable and often necessary, but they mainly strengthen competence within a fixed rule set. Without a systematic way to expand the environment distribution itself, the field risks overfitting to a few worlds while leaving cross-environment competence underspecified. Scaling experience in a fixed world cannot substitute for scaling the world’s agents must learn to live in. Fig. 1 summarizes this bottleneck shift by mapping each scaling target to its primary gain, from language and knowledge, to policy competence, to environment generalization, and ultimately to cross-environment adaptation as rules and interfaces vary. Our position is that scalable environments drive generalizable agents : they provide a systematic way to generate, compose, and evaluate families of executable environments with meaningfully different rules. This is distinct from scaling trajectories or tasks within a fixed world. Rather than only improving competence under one rule set, environment scaling targets cross-world adaptation by exposing agents to changes in interfaces, dynamics, feedback, and social structure. As these factors vary, previously effective behaviors may fail, forcing agents to infer new rules and update their strategies through interaction. Scalable environments therefore make adaptation trainable and measurable through controlled rule shifts, while also supporting meta-learning, dynamics inference, and modular skill reuse across heterogeneous settings. In this paper, we organize the landscape and outline a path forward. First, we introduce an operational taxonomy that distinguishes trajectory scaling, task scaling , and environment scaling by their primary deliverables and what changes in the executable rule-set. Second, we synthesize two major paradigms for scaling environments: programmatic generators that emphasize controllability and verifiability, and generative world models that offer broad coverage and open-endedness. And we discuss their tradeoffs and design principles. Third, we clarify boundary cases where terminology diverges and summarize implications for learning under heterogeneity. Our goal is to provide a unifying lens and a concrete call-to-action: environments should be treated as first-class artifacts that can be scaled, verified, and measured. Contributions. • We argue that cross-environment competence is a prerequisite for general agents, and that scalable environments are therefore inevitable rather than optional. • We propose an operational taxonomy that distinguishes trajectory, task, and environment scaling, including decision rules for boundary cases. • We synthesize programmatic and generative paradigms for environment scaling and extract practical design principles and tradeoffs. Figure 2: Scalable environments as a substrate for scaling agents. We organize scaling into trajectory, task, and environment regimes (A) with corresponding deliverables (B), relate them to learning mechanisms and capability (C), and summarize the generate–interact–learn–scale loop (D). 2 Preliminaries We introduce a lightweight formulation that fixes notation for agent environment interaction. We model an environment as an executable rule set and an agent as a stateful system with a mental state that can be updated from experience. This view will serve as the basis for distinguishing trajectory, task, and environment scaling in Sec. 3 . Environment as an executable rule set. We model an environment \mathcal{E} as an executable specification of interaction rules, which determines what actions are available, how the world evolves, what the agent observes, and what outcome signals the environment returns: \mathcal{E}\triangleq\big(\mathcal{S},\;\mathcal{A},\;T,\;\mathcal{O},\;\Omega,\;\mathcal{Y}\big). (1) Here \mathcal{S} is the state space; \mathcal{A} the action interface defined by an interface contract such as tools, APIs, or commands; T the transition dynamics; \mathcal{O} the observation space with observation interface \Omega ; and \mathcal{Y} the environment signal space. The environment signal may include rewards or scores, verifier outputs such as unit tests, termination flags, and structured execution outcomes. This definition emphasizes that an environment is not merely a collection of tasks, but a reproducible causal process that maps actions to transitions, observations, and outcome signals. Although E is written as a construction-level executable object, the distinction relevant to agent learning is behavioral. Two implementations may use different hidden state spaces S or internal transition code T , yet induce the same

Read the complete text