Dynamic Markov Blanket Detection for Macroscopic Physics Discovery
Jeff Beck, Maxwell J. D. Ramstead · 2025
Read Dynamic Markov Blanket Detection for Macroscopic Physics Discovery by Jeff Beck, Maxwell J. D. Ramstead (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-21217.txt.
Introduction
Jeff Beck and Maxwell Ramstead build a tool for finding objects and their rules inside messy physical systems, in a paper published in two thousand twenty-five. Their starting point is the free energy principle and its idea of a Markov blanket, a boundary that sets a thing apart from its surroundings.
The team takes a modeling approach that treats hidden causes as unknowns to be inferred from data. Their method, dynamic Markov blanket detection, learns from partial views of fine-scale motion. It sorts the small parts of a system by the role each one plays at a given moment. Labels come from a form of Bayesian attention built into the method. The payoff is a way to spot large-scale objects, group them into types, and state the rules each type follows.
Catalog record
| CREATOR | Jeff Beck, Maxwell J. D. Ramstead |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 81 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-21217
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Dynamic Markov Blanket Detection for Macroscopic Physics Discovery Jeff Beck, Maxwell J. D. Ramstead Abstract The free energy principle (FEP), along with the associated constructs of Markov blankets and ontological potentials, have recently been presented as the core components of a generalized modeling method capable of mathematically describing arbitrary objects that persist in random dynamical systems; that is, a mathematical theory of “every” “thing.” Here, we leverage the FEP to develop a mathematical physics approach to the identification of objects, object types, and the macroscopic, object-type-specific rules that govern their behavior. To do so, we draw out the deep connections between Markov blankets, reinforcement learning, system identification theory, and macroscopic physics discovery. More specifically, we use the statistics of Markov blankets to operationalize two conditions for system equivalence in the literature, and to develop an approach to subsystem discovery, i.e., how to best partition a system into subsystems, and how to best classify (sub)systems. Using the statistics of Markov blankets, we demonstrate that two subsystems of a given system are weakly equivalent if their blankets share the same steady state statistics or reward rate; and strongly equivalent if the time evolution or paths of their boundaries have the same statistics. This allows us to formally define object types in terms of how they interact with their environment. It also allows us to reframe the problems of systems identification and macroscopic physics discovery as a problem of Markov blanket detection. We take a generative modeling approach and use variational Bayesian expectation maximization to develop a dynamic Markov blanket detection algorithm that is capable of identifying and classifying macroscopic objects, given partial observation of microscopic dynamics. This unsupervised algorithm uses Bayesian attention to explicitly label observable microscopic elements according to their current role in a given system, as either the internal or boundary elements of a given macroscopic object; and it identifies macroscopic physical laws that govern how the object interacts with its environment. Because these labels are dynamic or evolve over time, the algorithm is capable of identifying complex objects that travel through fixed media or exchange matter with their environment. This approach leads directly to a flexible class of structured, unsupervised algorithms that sensibly partition complex many-particle or many-component systems into collections of interacting macroscopic subsystems, namely, “objects” or “things.” We derive a few examples of this kind of macroscopic physics discovery algorithm and demonstrate its utility with simple numerical experiments, in which the algorithm correctly labels the components of Newton’s cradle, a burning fuse, the Lorenz attractor, and a simulated cell. A Preprint August 24, 2026 1 Introduction In this paper, we reconsider approaches to system identification and typification used in systems identification theory, engineering, and statistical physics using the tools of information theory, in particular, the constructs of Markov blankets and ontological potential functions that have been developed in the literature on the free energy principle (FEP). Inspired by recent derivations of classical and statistical mechanics from information theoretic principles [ 31 , 10 ] , we present a novel derivation of the FEP, foregrounding how it can be used to write down “ontological potential functions” that define object types or phenotypes. This approach is based upon a consideration of the relative entropy formulation of Jaynes’ principle of maximum caliber [ 41 , 36 , 42 ] , with constraints imposed upon the boundary or Markov blanket of a macroscopic object or subsystem of a certain type. We show that these Markov blanket constraints fully characterize the interactions between an object or object type and the other objects in its environment, thereby formalizing the behavioral profile of a subsystem in terms of the effects that it has on other subsystems. This approach subsumes the more standard approaches to identification and typification of physical objects in contemporary reinforcement learning, system identification theory, and macroscopic physics discovery. The problem of identification and typification of systems and subsystems is deceptively simple. In plain language, traditional systems identification theory asks the question: How can one characterize the complex interactions and behavior of a many-component system using a simple black box function approximator? In the standard approach to systems identification, the user identifies a subsystem as a connected subset of a large multi-component complex system and then characterizes the relationship between the inputs to and outputs from the subsystem. For example, in reinforcement learning, the inputs to a system are the observations of the agent and the outputs are its actions. The function that maps inputs to outputs is called the “policy” and in this context, two agents that execute the same policy perform the same actions given the same input conditions and, therefore, are considered to be equivalent. More generally, two subsystems with the same input-output relationship can then be said to be subsystems of the same type. Other than providing a means of typing subsystems, the utility of this approach lies in its ability to provide a compact description of a complex subsystem, by modeling it as a simple transfer function or as a low-dimensional dynamical system. This usually involves “black-boxing” the internal components of an overall system: that is, drawing a boundary around a many-object or many-component system, and then determining a (hopefully simplified) mathematical expression that summarizes the effect of the complex goings-on inside the boundary, in terms of their effects on the boundary of the subsystem, i.e., in terms of its input-output relationship to other subsystems. In this setting, the boundary itself is an arbitrary, user-defined boundary that separates the subsystem of interest from other subsystems. The definition of systems equivalence used in reinforcement learning is the one from systems identification theory: Two systems are then said to be of the same type if they have the same input-output relationship or policy, regardless of the details of their inner workings. In statistical physics, a similar notion of equivalence between macroscopic systems isused. Two systems are said to be of the same type if they can be modeled by the same dynamical system or energy function (Hamiltonian or Lagrangian). The main difference between the systems identification approach and the statistical physics approach is the latter’s use of a coarse-graining procedure to simplify complex microscopic dynamics. This procedure begins by drawing an arbitrary boundary around a connected volume of microscopic particles and identifying macroscopic state variables that summarize the activity of the microscopic components (e.g., temperature, pressure, and density) inside the volume. Rules or laws that relate internal state variables to the net flux of conserved quantities at the boundary are then derived from knowledge of microscopic dynamics. Because flux is a conserved quantity, different volumes can then be connected to yield field equations that govern a larger system that is itself made up smaller subsystems that use the same flux variables. A macroscopic system of a given type can then be identified as consisting of the connected volumes that can be modeled using the same flux-state relationship, i.e., it is a bucket of water because each fluid element in the bucket has the same flux-state relationship. This extends the state space to a field that is dependent on the shape of the macroscopic object and establishes the bucket as providing boundary conditions. The free energy principle (FEP) has been