Better Decisions through the Right Causal World Model
Elisabeth DilliesDepartment of Cognitive ScienceSorbonne University [email protected], Quentin DelfosseDepartment of Computer ScienceTechnical University Darmstadt [email protected] Jannis BlümlDepartment of Computer ScienceTechnical University DarmstadtRaban EmundsDepartmen · 2025
Read Better Decisions through the Right Causal World Model by Elisabeth DilliesDepartment of Cognitive ScienceSorbonne University [email protected], Quentin DelfosseDepartment of Computer ScienceTechnical University Darmstadt [email protected] Jannis BlümlDepartment of Computer ScienceTechnical University DarmstadtRaban EmundsDepartmen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-07257.txt.
Introduction
Elisabeth Dillies and co-authors build in 2025 a tool that pulls true cause world models out of play worlds for learn agents. Such agents oft ride false links in their train worlds, which breaks when the world shifts a shade. A cause true model could steer them to the marks that count.
Their tool first reads things and their traits from the raw views. Sign math then fits how things shift and which links rule those shifts. A chat model tags the marks with sense names. Old game worlds test the pull: marks prove true and firm. Plans gain from the cause frame.
Catalog record
| CREATOR | Elisabeth DilliesDepartment of Cognitive ScienceSorbonne University [email protected], Quentin DelfosseDepartment of Computer ScienceTechnical University Darmstadt [email protected] Jannis BlümlDepartment of Computer ScienceTechnical University DarmstadtRaban EmundsDepartmen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 17 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-07257
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Better Decisions through the Right Causal World Model Elisabeth DilliesDepartment of Cognitive ScienceSorbonne University [email protected], Quentin DelfosseDepartment of Computer ScienceTechnical University Darmstadt [email protected] Jannis BlümlDepartment of Computer ScienceTechnical University DarmstadtRaban EmundsDepartment of Computer ScienceTechnical University DarmstadtFlorian Peter BuschDepartment of Computer ScienceTechnical University DarmstadtKristian KerstingDepartment of Computer ScienceTechnical University Darmstadt Abstract Reinforcement learning (RL) agents have shown remarkable performances in various environments, where they can discover effective policies directly from sensory inputs. However, these agents often exploit spurious correlations in the training data, resulting in brittle behaviours that fail to generalize to new or slightly modified environments. To address this, we introduce the Causal Object-centric Model Extraction Tool (COMET), a novel algorithm designed to learn the exact interpretable causal world models (CWMs). COMET first extracts object-centric state descriptions from observations and identifies the environment’s internal states related to the depicted objects’ properties. Using symbolic regression, it models object-centric transitions and derives causal relationships governing object dynamics. COMET further incorporates large language models (LLMs) for semantic inference, annotating causal variables to enhance interpretability. By leveraging these capabilities, COMET constructs CWMs that align with the true causal structure of the environment, enabling agents to focus on task-relevant features. The extracted CWMs mitigate the danger of shortcuts, permitting the development of RL systems capable of better planning and decision-making across dynamic scenarios. Our results, validated in Atari environments such as Pong and Freeway, demonstrate the accuracy and robustness of COMET, highlighting its potential to bridge the gap between object-centric reasoning and causal inference in reinforcement learning. Keywords: reinforcement learning, world model, object-centric, causality 1 Introduction Figure 1: Deep RL agents learn undetectable shortcut. A deep (PPO) agent reaches the maximum score and selects the correct action in the depicted state of the training environment. The explanation map further leads external reviewers to think that the agent “understands” that it should return the ball behind the enemy (Left). In the test environment, where the enemy is hidden, the agent decides to go down, preventing it from catching the ball (Right). This illustrates that the agents learned to rely on the enemy’s vertical position as an estimation of the ball’s position. Machine learning systems often tend to exploit spurious correlations in the training data ( Schramowski et al. 2020 ; Stammer et al. 2021 ) . This is no different in RL settings, where agents learn misaligned policies that fail to learn the originally intended tasks by relying on shortcuts ( di Langosco et al. 2022 ; Suau et al. 2024 ) . Such shortcut learning even occurs in the most simple Pong Atari game, for which Delfosse et al. 2024c showed that both deep and symbolic RL agents are subject to misalignment. In Pong, the enemy is programmed to vertically align itself with the ball, leading to a quasi perfect correlation between the two objects vertical positions. RL agents thus learn to rely on the vertical position of the enemy to situate the ball position and effectively return it, as depicted in Figure 1 . These shortcuts prevent the agents from generalizing, even to simplified versions of the environments, for which humans have no problem adapting. For example, if the enemy is hidden, or stops moving when the ball is going towards the player, the RL agents’ performances drop. These misgeneralization to simpler scenarios are not specific to Pong, but are recurrent throughout the arcade learning environments ( Delfosse et al. 2024a ) . Many form of interpretable object-centric algorithms have recently been developed. They first extract object-centric (or symbolic) states, then rely on first order logic ( Delfosse et al. 2023a ) , polynomial approximations and LLM explanations ( Luo et al. 2024 ) or decision trees ( Kohler et al. 2024 ) . They have been shown to be competitive alternatives to opaque approaches, performing on par with deep agents. Importantly, they provide some form of interpretability, that allow experts to detect and correct their potential misalignment behaviors. Yoon et al. 2023 demonstrate the higher robustness of object-centric agents in improving generalization and reducing reliance on spurious correlations. However, object-centric symbolic reasoning does not break up correlations like the one between the enemy’s paddle and the ball in Pong. If the enemy starts behaving differently, an agent relying on this spurious correlation and focusing on the enemy paddle will fail to return the ball, while an agent moving based on the ball position and velocity will not be affected by the correlation break. The difference between the relevance of both observable features ( i.e. the enemy paddle and ball vertical positions) for our intended agent behavior lies in the true causal relations. If the agent utilizes these causal relationships in a causal world model, the independence of such mechanisms ( Peters et al. 2017 ) ensures that the desired behaviour ( i.e. returning the ball) applies in modified environments ( e.g. with an enemy stopping after returning the ball). By disentangling these relationships, the agent can focus on task-relevant features, fostering the development of policies that generalize across diverse scenarios, including those with novel dynamics or adversarial interventions. Even if novel benchmarks for exposing such misgeneralizations have been developed to test RL agents’ robustness, ( e.g. ( Delfosse et al. 2024a ) in the Atari domain), methods to automatically detect and correct spurious correlations are still underexplored. Integrating causal reasoning into RL agents offers a pathway toward human-like adaptability Yang et al. 2024 ; Lei et al. 2024 . By abstracting relevant features and modeling the causal structures underlying the observed phenomena, RL agents could autonomously overcome the limitations of shortcut-driven strategies. In this paper, we introduce the C ausal O bject-centric M odel E xtraction T ool (COMET). Using their internal states, COMET aims to extract the interpretable causal world models (CWMs) of simulated environments. COMET detects the objects from the observation and then models causal relationships between the depicted objects’ properties and the internal state ( e.g. the RAM) that the emulated environment relies on to produce the observations. It then learns to extract when and how these variables are updated by the environment. It retrieves the relevant internal variables and uses the common reasoning abilities of an LLM to annotate these relevant internal states (thus improving its interpretability). 2 Method The algorithm, detailed in Algorithm 1 , outlines the process for extracting a causal world model (CWM) using COMET. This method integrates object-centric reasoning with symbolic regression and semantic inference to map environmental dynamics comprehensively. Below, we describe each stage of the extraction process. Overall, COMET extracts object-centric CWM by: 1. Mapping the internal state values to the objects’ properties, 2. Modeling how this internal state evolves, 3. Annotating the relevant variables with their meaning. COMET requires an executable environment, an executable policy (potentially random) and a large language model (LLM) for common sense reasoning. It first generates rollouts from the policy, retrieving the environment’s internal states (EIS) and rendered RGB observations. It then uses an object discovery method (such as ( Delfosse et al. 2023b ; Zhao et al. 2023 ) ) to extract the objects from each frame. Each object consists of a set of properties (such as the \texttt{x},\texttt{y},\texttt{w},\texttt{h} bounding box coordinates or the value of objects