Causal-PIK: Causality-based Physical Reasoning with a Physics-Informed Kernel
Carlota Parés-Morlans, Michelle Yi, Claire Chen, Sarah A. Wu, Rika Antonova, Tobias Gerstenberg, Jeannette Bohg · 2025
Read Causal-PIK: Causality-based Physical Reasoning with a Physics-Informed Kernel by Carlota Parés-Morlans, Michelle Yi, Claire Chen, Sarah A. Wu, Rika Antonova, Tobias Gerstenberg, Jeannette Bohg (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-22861.txt.
Introduction
A robot that must move real objects faces a hard start: it cannot know in advance how each push will play out. Carlota Parés-Morlans and co-authors offer a 2025 method that learns cause and effect by trying actions and watching the results. Their system uses a search rule shaped by basic physics to pick each next try with care.
Tests on two known puzzle sets, one with virtual tools and one with falling blocks, show strong gains. The method reached the goal in fewer tries than prior best systems. The team also ran a fresh study with human players on the block puzzles. Their system held its own even on tasks that strain people. For builders of learning machines, the work links smart search with a feel for how the world moves.
Catalog record
| CREATOR | Carlota Parés-Morlans, Michelle Yi, Claire Chen, Sarah A. Wu, Rika Antonova, Tobias Gerstenberg, Jeannette Bohg |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-22861
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Causal-PIK: Causality-based Physical Reasoning with a Physics-Informed Kernel Carlota Parés-Morlans, Michelle Yi, Claire Chen, Sarah A. Wu, Rika Antonova, Tobias Gerstenberg, Jeannette Bohg Abstract Tasks that involve complex interactions between objects with unknown dynamics make planning before execution difficult. These tasks require agents to iteratively improve their actions after actively exploring causes and effects in the environment. For these type of tasks, we propose Causal-PIK, a method that leverages Bayesian optimization to reason about causal interactions via a Physics-Informed Kernel to help guide efficient search for the best next action. Experimental results on Virtual Tools and PHYRE physical reasoning benchmarks show that Causal-PIK outperforms state-of-the-art results, requiring fewer actions to reach the goal. We also compare Causal-PIK to human studies, including results from a new user study we conducted on the PHYRE benchmark. We find that Causal-PIK remains competitive on tasks that are very challenging, even for human problem-solvers. Figure 1: Example puzzles from the Virtual Tools ( Allen et al. 2020 ) and PHYRE ( Bakhtin et al. 2019 ) benchmarks. For Virtual Tools, the objective is to place one of the blue action objects from the left to have a red ball fall into the green area. For PHYRE, the objective is to place a red ball of variable radius in the environment to have the green and blue objects touch for at least 3 seconds. The runs highlighted in red are failed attempts and the runs highlighted in green are successful attempts. 1 Introduction Consider trying to solve a physical reasoning puzzle from the Virtual Tools benchmark, like those shown in Figure 1 . Your goal is to have the red ball end up in the green region. To make that happen, you need to choose one of the three objects from the top left, place it somewhere in the scene, and let gravity and causality do the rest. Which object would you choose and where would you place it? Research in cognitive science suggests that humans solve tasks like these by building internal models of the physical world ( Battaglia et al. 2013 ; Smith et al. 2018 ; Ota et al. 2021 ; Zhou et al. 2023 ) . These models encode our causal understanding of the domain – our beliefs about how one event leads to another. While predicting the exact sequence of events is difficult, our physical intuition allows us to estimate the immediate causal effects of our actions, such as which object will move and in which direction. In addition, we rapidly learn from the outcomes of previous actions ( Allen et al. 2020 ) . If the red ball almost landed in the goal region, we would slightly change our action and try again. If it was way off, we might try something completely different. Inspired by people’s rapid learning in such tasks, we develop a method that leverages physical intuitions to efficiently solve physical reasoning tasks. Researchers have developed several benchmarks for evaluating the physical reasoning capabilities of AI agents ( Melnik et al. 2023 ) . These benchmarks range from predicting the stability of a stack of blocks from an image to recognizing violations of physical principles. In this work, we focus on single-intervention physical reasoning tasks, where an agent chooses what action to take at the beginning of an episode and then observes the action’s effects on the environment. We focus on the Virtual Tools ( Allen et al. 2020 ) and PHYRE ( Bakhtin et al. 2019 ) benchmarks, which despite looking deceivingly simple in their 2D form, are very hard to solve even for humans ( Allen et al. 2020 ) . These tasks involve complex physical interactions between objects, which without complete information about the environment dynamics make it impossible for agents to plan the exact solution without active exploration. Agents must interact with the environment to actively obtain information about the object dynamics. The main challenge is to reason about the causal consequences of one’s actions, to leverage this knowledge in order to make effective decisions about what actions to try, and to rapidly learn from previous attempts. We propose Causal-PIK, a method that leverages physical intuition and causality to solve single-intervention physical reasoning tasks in as few trials as possible. Our method uses Bayesian optimization to reason about causality via a Physics-Informed Kernel to obtain an expressive posterior distribution over the environment dynamics. This allows an agent to efficiently explore the search space and intelligently select what actions to evaluate next. Causal-PIK minimizes the number of physical interactions required. We demonstrate that Causal-PIK significantly outperforms state-of-the-art models on the single-intervention physical reasoning tasks from the Virtual Tools ( Allen et al. 2020 ) and PHYRE ( Bakhtin et al. 2019 ) benchmarks, finding solutions in the fewest number of attempts. 2 Related Work Physical Reasoning: Researchers have developed several benchmarks towards the goal of improving physical reasoning capabilities in machine-learning models ( Melnik et al. 2023 ) . We evaluate Causal-PIK on the PHYRE ( Bakhtin et al. 2019 ) and Virtual Tools ( Allen et al. 2020 ) benchmarks. Both benchmarks use a physics simulator and capture a variety of complex interaction mechanisms. Furthermore, both contain a large set of puzzle variations, allowing us to study generalization across diverse environments. Both PHYRE and Virtual Tools have inspired several methods for solving physical reasoning puzzles. A number of works ( Harter et al. 2020 ; Girdhar et al. 2020 ; Ahmed et al. 2021 ; Qi et al. 2021 ; Li et al. 2022 ) that evaluate on PHYRE leverage forward prediction models, also called dynamics models or world models, to predict the outcomes of actions. They use dynamics models to score actions and then execute the most promising actions until one succeeds. Like these works, Causal-PIK also uses a dynamics model to reason about the action outcomes. However, unlike these prior methods, Causal-PIK uses observations from previous trials to inform future action selection via Bayesian optimization. Instead of using a dynamics model to directly choose actions, we use dynamics predictions to instill physical intuition into kernel updates during Bayesian optimization. We show that our method solves PHYRE in fewer attempts than any of these prior methods. The ‘Sample, Simulate, Update’ model (SSUP) ( Allen et al. 2020 ) attempts to solve the Virtual Tools benchmark. It samples actions from an object-based prior, simulates the sampled actions in a noisy physics engine to find the best action to try, executes the action, and updates the model’s belief using information from both simulation and execution. SSUP uses a Gaussian mixture model for guidance, but it doesn’t embed information about how actions are related via their effects, making SSUP search less efficient. In contrast, our work builds on active learning methods, such as Bayesian optimization, and successfully incorporates additional guidance for action selection by introducing a Physics-Informed Kernel. This significantly lowers how many trials are needed to succeed. Bayesian optimization: Causal-PIK uses Bayesian optimization (BO), a global search method for optimizing black-box functions ( Shahriari et al. 2015 ; Wang et al. 2023 ) . Similar to how we use BO to efficiently find puzzle-solving actions, BO has been used in robotics to reduce the