WMAttack: Automated Attack Search for Adversarial Evaluation of World-Model Agents

Zhixiang Guo, Siyuan Liang, Shi Fu, Cheng Guo, András Balogh, Márk Jelasity, Dacheng Tao · 2026

Read WMAttack: Automated Attack Search for Adversarial Evaluation of World-Model Agents by Zhixiang Guo, Siyuan Liang, Shi Fu, Cheng Guo, András Balogh, Márk Jelasity, Dacheng Tao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-23220.txt.

Introduction

Guo and six coauthors present WMAttack, an automated attack-search framework for world-model agents. Weak hand-tuned attacks overstate robustness. WMAttack searches attack families, budgets, steps, restarts, plus allocation rules. Self-Correcting Attack Search refines proposals using reward, action, runtime, and rollout feedback. Representation-Guided Attack Retrieval reuses past configurations from similar tasks. On Atari and DeepMind Control, WMAttack finds stronger attacks. It lifts reward dip from 0 point 497 to 1 point 034 on DreamerV3 Atari and from 0 point 319 to 0 point 682 on DeepMind Control.

Catalog record

CREATORZhixiang Guo, Siyuan Liang, Shi Fu, Cheng Guo, András Balogh, Márk Jelasity, Dacheng Tao
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE61348
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.23220

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

WMAttack: Automated Attack Search for Adversarial Evaluation of World-Model Agents Zhixiang Guo, Siyuan Liang, Shi Fu, Cheng Guo, András Balogh, Márk Jelasity, Dacheng Tao Abstract Despite the growing use of world models as decision-making agents, their adversarial robustness remains underexplored due to the lack of dedicated automated evaluation methods. A key obstacle is that attack evaluation must be both accurate and efficient: weak manually tuned attacks can overestimate robustness, while exhaustive hyperparameter search is prohibitively expensive because each candidate requires closed-loop rollouts through learned latent dynamics. We introduce WMAttack , an automated attack-search framework for adversarial evaluation of world-model agents. WMAttack formulates robustness evaluation as a finite-budget search over attack configurations, including attack families, perturbation budgets, optimization steps, restarts, and allocation rules. To improve search accuracy, Self-Correcting Attack Search (SCAS) refines the attack proposal distribution using feedback from reward degradation, action instability, runtime cost, and rollout variability. To improve search efficiency, Representation-Guided Attack Retrieval (RGAR) retrieves effective historical configurations from representation-similar tasks, providing a warm start for unseen environments. We provide a theoretical explanation showing that proposal refinement improves finite-budget search when it shifts probability mass toward high-utility attacks. Across Atari and DeepMind Control tasks, WMAttack consistently discovers stronger attacks than the evaluated baselines, improving normalized reward drop from 0.497 0.497 to 1.034 1.034 on DreamerV3 Atari and from 0.319 0.319 to 0.682 0.682 on DMC. Ablations further show that RGAR improves initial candidate quality and SCAS improves final attack utility under fixed evaluation budgets. 1 Introduction World models have emerged as a foundational paradigm for decision-making agents, enabling sample-efficient planning and prediction through learned latent dynamics [ 18 , 19 , 22 ] . Their growing use has also motivated safety-oriented world-model methods that incorporate constraints, uncertainty, or Lyapunov-style critics into model-based reinforcement learning [ 26 , 3 , 54 ] . However, superior performance on visual control [ 42 ] , Atari [ 6 ] , and continuous-control benchmarks [ 23 ] does not guarantee robustness. Recent work on robust latent representations, latent safety filters, and surprise-based rejection further suggests that failures often arise from representation shift and out-of-distribution transitions [ 41 , 40 , 58 ] . Small, budget-constrained perturbations can propagate through learned latent representations and predictive dynamics [ 37 , 16 , 17 ] , latent transition models [ 57 ] , policies [ 55 ] , or adversarially corrupted planning objectives and trajectory rankings [ 52 , 27 , 39 , 11 ] , leading to unstable decisions or severe performance degradation. Despite these risks, we still lack a dedicated automated attack-search framework [ 34 ] to systematically evaluate world-model agents across diverse tasks, models, and attack families. This raises a critical question: how can we efficiently expose and quantify the failure modes of world-model agents under adversarial conditions? Evaluating robustness in this context is challenging because attack efficacy is highly sensitive to both environment dynamics and adversarial hyperparameters [ 51 , 24 , 38 ] . World-model environments differ in observation spaces, reward scales, temporal structures, and policy sensitivities [ 23 , 45 ] , while robustness itself involves return degradation, action instability, and latent representation drift [ 55 , 44 , 4 ] . Manual tuning is therefore unreliable and inefficient: weak attacks may create pseudo-robustness, while exhaustive search is computationally prohibitive because each candidate may require closed-loop rollouts and repeated latent-dynamics computation [ 8 , 10 , 30 ] . An effective evaluation method must balance accuracy and efficiency by avoiding cold-start search and adaptively refining configurations from agent feedback. These challenges motivate an automated framework that leverages cross-task experience and concentrates limited evaluation budgets on high-impact adversarial regions. Figure 1: Overview of WMAttack effectiveness across tasks and world-model agents. Metrics are min-max normalized for visualization only; larger radius indicates stronger attack or search outcome, with exact values reported in Tables 1 and 2 . In this work, we propose WMAttack , an automated attack-search framework for adversarial evaluation of world-model agents. Rather than relying on fixed attacks or heuristic manual tuning, WMAttack formulates robustness evaluation as a finite-budget search problem over adversarial configurations, including perturbation budgets, optimization steps, restarts, schedules, and allocation rules. To navigate this large search space, WMAttack employs a two-stage optimization process. First, Representation-Guided Attack Retrieval (RGAR) exploits intrinsic similarities between world models by projecting diverse dynamics into a unified latent representation space and retrieving effective historical attack configurations as a warm start for new tasks. This enables cross-task experience transfer and improves initialization over zero-knowledge starting points. Second, Self-Correcting Attack Search (SCAS) iteratively refines the attack strategy by using multi-dimensional feedback, such as reward degradation and action instability, as corrective signals to update a proposal distribution over the attack parameter space. By shifting probability mass toward regions of higher adversarial efficacy, WMAttack concentrates its search on potent configurations, reduces redundant trials, and provides a theoretical basis for discovering stronger attacks under a fixed evaluation budget. Our contributions are summarized as follows: • We formulate adversarial robustness evaluation for world models as a finite-budget attack-configuration search problem, where the goal is to efficiently identify high-impact attacks over diverse tasks, models, attack methods, and hyperparameter settings. • We develop WMAttack , an automated attack-search framework that combines Representation-Guided Attack Retrieval (RGAR) with Self-Correcting Attack Search (SCAS) , and provide a theoretical explanation for why feedback-driven proposal refinement can improve attack-search efficiency. • We evaluate WMAttack on 46 DreamerV3 Atari and DeepMind Control tasks, where it discovers stronger attacks than random search and a Claudini-style baseline, and further report cross-model evaluations on DreamerV2, TD-MPC2, and IRIS, showing that it discovers stronger attacks than random search and a Claudini-style autoresearch baseline, with consistent gains in reward drop, action instability, and scalarized attack utility. 2 Related Work 2.1 World Models in Reinforcement Learning World models are a central framework in model-based reinforcement learning, enabling agents to learn predictive latent dynamics for planning and decision making. Unlike vision-language-action models that often map multimodal inputs directly to actions through foundation models [ 7 ] , RL-based world models emphasize environment dynamics, imagination, and sample-efficient control. Early methods such as PlaNet [ 19 ] and Dreamer [ 20 ] introduced recurrent state-space models for learning compact latent representations from pixels. Subsequent systems, including DreamerV2 and DreamerV3, scaled latent imagination to Atari, continuous control, and diverse RL domains [ 21 , 22 ] . More recent architectures replace or augment recurrent dynamics with Transformer-based sequence modeling, as in IRIS and STORM [ 37 , 57 ] , or generative transition models, as in DIAMOND [ 1 ] . Our work focuses on this class of RL-based world-model agents because their decisions are mediated by learned latent dynamics: perturbations to observations can propagate through the encoder, transition model, and policy, making closed-loop adversarial evaluation especially important [ 56 , 46 , 28 ] . 2.2 Adversarial Robustness and Evaluation Adversarial examples show that small, bounded perturbations can cause severe failures in neural models [ 15 , 49 , 32 ] . In reinforcement learning, the problem is more complex because perturbations affect actions, future states, and long-horizon returns. Prior work formalizes observation attacks through the State-Adversarial MDP framework [ 55 ] and shows that policies are

Read the complete text