Maximum entropy for dynamic processes on networks
Noam Abadi, Franco Ruzzenenti · 2025
Read Maximum entropy for dynamic processes on networks by Noam Abadi, Franco Ruzzenenti (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-04240.txt.
Introduction
Noam Abadi and Franco Ruzzenenti apply an information theory frame to change processes on networks in a 2025 paper. Such processes cover the spread of news, shifts in opinion, and epidemics. They are hard to study in bulk, because small changes at the start can send them down very different paths. The frame, called maximum caliber, picks the statistics that match what is known while assuming the least beyond it.
The pair focus on processes driven by contact between groups of different types on the network. They check the frame's predictions against simulations of varied processes on varied networks. A shortcut version of the dynamics eases the math a lot. That shortcut can even recover classic population models that are not usually seen as network models.
Catalog record
| CREATOR | Noam Abadi, Franco Ruzzenenti |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 80 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-04240
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Maximum entropy for dynamic processes on networks Noam Abadi, Franco Ruzzenenti Abstract Dynamic processes on networks are fundamental to understanding modern-day phenomena such as information diffusion and opinion polarization on the internet or epidemics spreading through society. However, such processes are notoriously difficult to study broadly as small changes in initial conditions, the process, or the network can lead to very different evolution trajectories. Here we apply the information-theoretic framework of maximum caliber to study the statistics of such systems analytically, focusing on processes that can be interpreted as driven by interactions between populations of different types of individuals in the network. We verify the dynamics deduced from maximum caliber by using simulations of different processes on different networks, introduce an approximation of the dynamics that significantly simplifies the problem, and show that the approximation can be used to recover well-established models of population dynamics that are typically not thought of as taking place on networks. Preprint: APS/123-QED I Introduction In recent years, diffusion processes on networks have received a great deal of attention, describing, for example, epidemic and rumour propagation or opinion polarization [ 1 , 2 , 3 , 4 , 5 , 6 ] . Diffusion models study how entities as diverse as chemical substances, biological species, or information spread as they interact with each other and their surroundings [ 7 , 8 ] . Networks allow the capturing of arbitrary connection structures such as molecular bonds between atoms, trophic relations between species, or friendship relations in social media by representing components as nodes and connections between them as links [ 9 , 10 , 11 , 12 , 13 , 14 ] . A diffusion process on a network is thereby a process spreading throughout the components of a network, so that the links determine which entities can interact at a given moment. Moreover, the structure of the network can also evolve, either responding to the interactions or independently [ 15 , 16 ] . This evolution, and that of the process on the evolving structure, often exhibit random characteristics. The development of maximum entropy networks has proved a robust framework to produce network models of financial, biological and social systems, capturing their random nature statistically [ 17 , 18 , 19 , 20 , 21 , 22 ] . However, as maximum entropy is an equilibrium theory, it is not directly applicable to dynamic processes. Maximum caliber [ 23 ] is an extension of maximum entropy to out-of-equilibrium statistics [ 24 , 25 , 26 , 27 , 23 ] . It can be seen as an information-theoretic analogy to the maximum entropy production principle of thermodynamics [ 28 , 29 ] , and is therefore well-positioned to extend the success of maximum entropy networks to dynamic settings. However, its application to random dynamic networks is not easy to find in existing literature. Recently, we have applied the principle to describe random Markovian evolution of network structures [ 30 ] , and the same idea has been used to enhance community detection in networks in a non-Markovian setting [ 31 ] . Here, we show that maximum caliber can also be used to capture the evolution of dynamical processes spreading through networks. We focus on processes that can be interpreted as population dynamics, understanding a population as a collection of individuals classified into different groups depending on how they interact with others, such as predatory and prey animals, or individuals infected, recovered, and susceptible to a disease. With this, we extend the application of maximum caliber from the dynamics of the network structure to processes on it. For this, the rest of this paper is structured as follows: in the next section, we describe dynamic processes on networks as considered for the rest of this paper, their implementation as stochastic simulations, and their analytical description through maximum caliber. In the following section, we compare results from simulations of three specific processes to those obtained by maximum caliber, with results from three different network topologies to highlight the flexibility of the method with respect to the process and the network. Finally, we discuss the general implications of our results and future work on the application of maximum caliber to networks that is not carried out in this paper. II Methods The focus of this work is dynamic processes on networks where S discrete states \mathcal{S}=\{0,1,2,...,S-1\} spread in discrete time t through nodes of a directed network with no self-loops. Each node is occupied by a single state at each time, meaning that the state of all nodes can be captured by a state vector \vec{s}(t)\in\mathcal{S}^{N} with N components, each representing the state s_{i}(t)\in\mathcal{S} of a node i at time t . The system evolves in two steps. The first is choosing a link of the network, which determines the pair of nodes that interact. Once the pair of nodes is chosen, the second step is to choose a new pair of states for them, while all other nodes in the network remain unaltered. The choice of a link in the network, instead of a pair of nodes directly, reflects that the pairs of nodes that can interact are restricted to this connection structure. For example, our choice of excluding self-loops means that self-interactions never take place. Beyond this, links can be chosen in arbitrary ways from a particular connection structure. For instance, we might randomly select among all links originating from nodes in specific states, or explicitly vary how we choose a link over time. How a link in the network is chosen thus reflects our assumptions on how the underlying connection structure restricts interactions. The states in the set \mathcal{S} correspond to possible types of individuals in the system. For example, we may take \mathcal{S}=\{0,1,2\} to represent prey and predators with 1 and 2 respectively, and 0 for empty nodes. The choice of assigning one state to each node, namely occupying it by a maximum of one individual, makes reference to the fact that we account for the structure of connections between individuals from the smallest possible scale. If we were to consider interactions between nodes that can hold more than one individual in one or more states, for example ecosystems in different geographical locations, then we should account for the assumed interaction structure within the nodes, even if approximated for example by a regular or fully connected network. This choice influences the internal dynamics of each node as much as the connections between them, representing for example migration patterns, would influence the overall dynamics of the network. The interpretation of node states also gives a clearer meaning to the updates of interacting pairs of nodes. For example, consider a predator prey system where a node i occupied by a predator s_{i}=2 is chosen to interact with a node j occupied by a prey s_{j}=1 , so the pair of interacting states before the update is (s_{i},s_{j})=(2,1) . Imagine that after the interaction, the states are (s_{i}^{\prime},s_{j}^{\prime})=(0,2) . Because no other node in the network can change its state, the prey has been removed and the predator has taken its place leaving an empty node behind. The transition (2,1)\rightarrow(0,2) can then be interpreted as a