Bayesian Inverse Physics for Neuro-Symbolic Robot Learning
Octavio Arriaga, Rebecca Adam, Melvin Laux, Lisa Gutzeit, Marco Ragni, Jan Peters, Frank Kirchner · 2025
Read Bayesian Inverse Physics for Neuro-Symbolic Robot Learning by Octavio Arriaga, Rebecca Adam, Melvin Laux, Lisa Gutzeit, Marco Ragni, Jan Peters, Frank Kirchner (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-08756.txt.
Introduction
Octavio Arriaga and co-authors argue, in a position paper published in 2025, that robots need physics and symbols inside their learning. Deep learning has advanced robot skills, yet models still struggle in new, shifting places and need much data. The authors propose a hybrid frame they call Bayesian inverse physics for neuro-symbolic learning.
The frame pairs differentiable physics, which lets robots simulate the world cheaply, with Bayesian reasoning that keeps track of uncertainty. Meta-learning adds fast adaptation to fresh tasks. Together, these parts could let robots reason about new situations, explain their choices, and keep learning over time. The paper maps a research road toward that goal, with milestones for modeling, inference, and adaptation. It is a call to the field as much as a design.
Catalog record
| CREATOR | Octavio Arriaga, Rebecca Adam, Melvin Laux, Lisa Gutzeit, Marco Ragni, Jan Peters, Frank Kirchner |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-08756
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Bayesian Inverse Physics for Neuro-Symbolic Robot Learning Octavio Arriaga, Rebecca Adam, Melvin Laux, Lisa Gutzeit, Marco Ragni, Jan Peters, Frank Kirchner Abstract Real-world robotic applications, from autonomous exploration to assistive technologies, require adaptive, interpretable, and data-efficient learning paradigms. While deep learning architectures and foundation models have driven significant advances in diverse robotic applications, they remain limited in their ability to operate efficiently and reliably in unknown and dynamic environments. In this position paper, we critically assess these limitations and introduce a conceptual framework for combining data-driven learning with deliberate, structured reasoning. Specifically, we propose leveraging differentiable physics for efficient world modeling, Bayesian inference for uncertainty-aware decision-making, and meta-learning for rapid adaptation to new tasks. By embedding physical symbolic reasoning within neural models, robots could generalize beyond their training data, reason about novel situations, and continuously expand their knowledge. We argue that such hybrid neuro-symbolic architectures are essential for the next generation of autonomous systems, and to this end, we provide a research roadmap to guide and accelerate their development. 1 Introduction One of the most remarkable features of human cognition is its ability to continuously estimate and interact with the world using limited information ( Griffiths et al. 2024 ; Tenenbaum et al. 2011 ; Pinker 1984 ) . Humans can recognize an object after seeing it just once and manipulate objects they have never previously encountered ( Gopnik 2012 ; Lake et al. 2011 ) . Achieving this level of adaptability is critical across the full range of robotic applications. The next generation of industrial and service robots must interact seamlessly with humans and adapt to dynamic surroundings ( Lake et al. 2017 ; Rabinowitz et al. 2018 ) . In healthcare, for example, assistive robots could infer patient needs with minimal supervision, helping to alleviate the growing demand for medical care in an aging world population ( Łukasik et al. 2020 ; Macis et al. 2022 ) . The need for autonomy with scarce data is even more pronounced in extreme settings. Disaster response robots must navigate unpredictable environments, underwater systems must deal with shifting currents and poor visibility, and space robots face large communication delays and harsh, unpredictable conditions. All of these domains require the ability to reason under uncertainty and adapt autonomously to new circumstances ( Nesnas et al. 2021 ; Obura et al. 2019 ) . Despite all advances in deep learning, current state-of-the-art robot learning lacks these capabilities. Most state-of-the-art algorithms in computer vision and robot learning rely on methods that require massive training datasets with billions of samples or years of simulated experience to solve a set of constrained predefined tasks ( Lake et al. 2017 ) . These models struggle to adapt across tasks and environments, making them inefficient and limiting their real-world applicability ( Gigerenzer 2022 ; Pearl 2018 ; Marcus and Davis 2019 ; Sünderhauf et al. 2018 ) . Moreover, relying on data-driven black-box models is not only inefficient when known physical approximations exist, but also raises critical safety concerns when robots operate and collaborate in close proximity to humans ( Valdenegro-Toro 2021 ) . These challenges raise two critical questions: • Why should we ignore the most accurate predictive models that we have of our world? • Why should we trust the probabilities of a model that we do not understand? To answer these fundamental questions, this paper argues for an alternative approach that extends current learning and robot perception algorithms by combining and scaling the following ideas: 1. Uncertainty-aware models through Bayesian inference, posterior sampling, and variational inference ( Ghahramani 2015 ; Jaynes 2003 ; Parr et al. 2022 ) . 2. Physics-informed modeling , combining differentiable physics and graphics-based simulators with neural networks to enhance generalization, efficiency, and physical consistency ( Toussaint et al. 2018 ; Arriaga et al. 2024 ; Lutter et al. 2020 ; Heiden et al. 2021 ) . 3. Program synthesis , building higher model abstractions with neural program search and transdimensional sampling ( Griffiths et al. 2024 ; Ellis et al. 2020 ; Cusumano-Towner et al. 2020 ) . The synthesis of these components provides a direct path to address our previous questions, paving the way for more capable and safe autonomous systems. 2 Limitations of Foundation Models for Robotics In the following section, we present three positions regarding the limitations of foundation models applied to robotics. Those limitations include sample and model complexity, safety, and lack of integrated physical knowledge. However, foundation models have significantly contributed to robotics, including perceptual feature extraction ( Oquab et al. 2023 ) , zero-shot instance segmentation ( Kirillov et al. 2023 ) , and language models ( Dubey et al. 2024 ) . Our conclusions ultimately point to an integrative approach combining foundation models, uncertainty quantification, and integrated physical and symbolic knowledge. 2.1 Large Data and Model Complexity • Performance increases with more data, yet it remains insufficient for robot autonomy. The transformer models’ performance strongly depends on the number of samples and the model size ( Kaplan et al. 2020 ) . Experimental studies have shown that this increase in model performance follows a power-law scaling relationship for both data and the number of parameters ( Hoffmann et al. 2022 ; Kaplan et al. 2020 ) . However, both extensive data and large model sizes constitute two of the biggest challenges in using neural networks for robotics. Specifically, there is no internet-scale repository of human-generated robot data, making large-scale learning challenging. Additionally, achieving full autonomy while preserving user privacy necessitates real-time models that run on-device without reliance on external servers. Moreover, highly dynamic and unpredictable environments, such as those found underwater or in space, often lack any pre-existing data, forcing systems to operate under completely unknown conditions. Current frontier LLMs are estimated to have increased their training data 100-fold since 2020, up to tens of trillions of tokens in 2024 ( Brown et al. 2020 ; Dubey et al. 2024 ) . Moreover, Cottier et al. 2024 estimated computational costs for training LLMs to have increased between 50- and 100-fold since 2020, from hundreds of thousands of USD up to tens of millions in 2024, ultimately resulting in a total estimated cost of more than 100M USD for current frontier models such as GPT4 and Gemini 1.0 Ultra ( Cottier et al. 2024 ) . While current frontier models are closed source, and their exact training data and size remain undisclosed, the latest open-source models, such as Llama 3, were trained using 15.6 trillion tokens using a transformer model with 405 billion parameters ( Dubey et al. 2024 ) . Two of the latest open-source vision-language-action (VLA) models for robotics, OpenVLA ( Kim et al. 2024 ) and RT-2-X ( Collaboration 2024 ) , consist of 7B and 55B and were trained on 970K and 1M+ demonstration trajectories, respectively. Although trajectories and tokens are not comparable one-to-one, the order of magnitude between both these types of datasets remains considerably large. Furthermore, these robot datasets ignore torque control and operate only in the task space ( Kim et al. 2024 ; Brohan et al. 2022 ) ; thus, limiting the applicability to many other robotics tasks that require force feedback. The success of foundation