Maximum entropy temporal networks
Paolo Barucca · 2025
Read Maximum entropy temporal networks by Paolo Barucca (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-02098.txt.
Introduction
Paolo Barucca builds a maximum entropy theory for temporal networks with continuous timestamps. Temporal networks record directed interactions as they occur over time. Few studies model that timing directly in continuous time. His approach maximizes entropy under basic constraints to get the least biased network ensemble.
The ensemble splits neatly into global time processes times a static edge probability from a standard maximum entropy graph. That split yields closed form likelihoods plus degree, clustering, and motif expectations. Edge timing follows non-homogeneous Poisson processes whose rates come from path entropy optimization. Those processes beat plain Poisson timing on likelihood, while edge labels recover strength constraints. Links to Hawkes calibration, renewal theory, and graph networks are discussed.
Catalog record
| CREATOR | Paolo Barucca |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-02098
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Maximum entropy temporal networks Paolo Barucca Abstract Temporal networks consist of timestamped directed interactions rather than static links. These links may appear continuously in time, yet few studies have directly tackled the continuous-time modeling of networks. Here, we introduce a maximum entropy approach to temporal networks and with basic assumptions on constraints, the corresponding network ensembles admit a modular and interpretable representation: a set of global time processes—an inhomogeneous Poisson or a Hawkes process—and a static maximum-entropy (MaxEnt) edge, e.g. node pair, probability. This time × \times edge labels factorization yields closed-form log-likelihoods, degree/unique-edge expectations, and yields a whole class of effective generative models. We provide maximum-entropy derivation of a log-linear Hawkes/NHPP intensity for temporal networks via functional optimization over path entropy, connecting inhomogeneous Poisson modeling -e.g. Hawkes models- to MaxEnt network ensembles. Global Hawkes time layers consistently improve log-likelihood over generic NHPP, while the MaxEnt edge labels recover strength constraints and reproduce expected unique-degree curves. We discuss the limitations of this unified framework and how it could be integrated with calibrated community/motif tools, Hawkes calibration procedures, and (neural) kernel estimation. I Introduction Temporal networks -time-stamped interactions on a fixed or evolving node set-are a fundamental representation of social, economic, and biological systems. A central challenge in network theory is to build models that are interpretable , principled , and predictive . For static networks, maximum entropy ensembles have been introduced to account for degree/strength patterns, higher-order constraints Jaynes 1957 ; Csiszár 1975 ; Cimini et al. 2019 ; Newman 2018 , providing an ensemble of networks that is compatible with simple (explainable) network-level, community-level or, node-level quantities. On the other hand, the importance of principled clustering in networks via block models and mesoscale structure identification has been investigated in many works Karrer and Newman 2011 ; Rohe et al. 2016 ; Sussman et al. 2012 ; Newman 2001 . At the same time, self-exciting point processes originated in Hawkes’ seminal work, Hawkes 1971 , have been shown to be an effective modeling assumption to reproduce burstiness and self-exciting behavior in a number of studies since Ogata 1988 ; Bacry et al. 2015 ; Bacry and Muzy 2016 ; Filimonov and Sornette 2012 . The interaction between temporal covariances and Hawkes excitation has been leveraged for causal graph inference and clustering Achab et al. 2017 ; Mercuri et al. 2024 . Temporal networks have been studied in the literature Masuda and Lambiotte 2016 ; Clemente et al. 2023 , to account for distinctive burstiness, memory, limited attention, and specific temporal patterns, e.g. temporal motifs. Recently, a maximum entropy approach has been introduced to model temporal networks in discrete time Clemente et al. 2023 . Despite the presence of advanced models for the calibration of multivariate Hawkes processes, Bacry and Muzy 2016 ; Achab et al. 2017 ; Soliman et al. 2022 , and for the modeling of static network ensembles, there is no principled maximum entropy model for temporal networks in continuous time. We here introduced a unified framework that combines the maximum-entropy (MaxEnt) principle for temporal network with the introduction of constraints on the point-process governing the event times. This approach provides an ensemble of temporal networks conditioned on a given set of simple constraints in the observed network quantities, whilst also providing a realistic set of timestamp patterns. The factorization that follows from the maximum entropy approach allows us to (i) encode domain knowledge via linear constraints (e.g., strengths, unique edges, block structure) while (ii) capturing burstiness through a global Hawkes time process. We derive closed-form likelihoods, analytical expectations for unique degrees, and practical fitting routines (IPFP + bisection), and we validate the framework across diverse datasets (here presenting results on the Enron email dataset). Our contribution fills this gap by proposing a continuous-time maximum entropy approach that (i) defines the relevant entropy function for inhomogeneous Poisson processes adding a set of specific edge constraints (ii) block-mask constraints informed by clustering, and (iii) a clean decomposition of the likelihood between time and edge labels that simplifies estimation and comparison. II Methodology: Maximum–Entropy Temporal Networks Let [0,T] be the observation window. A non–homogeneous Poisson process (NHPP) with intensity \lambda(t)\geq 0 is the point process for which: (i) the number of events on any set A\subset[0,T] is Poisson with mean \Lambda(A):=\int_{A}\lambda(t)\,dt ; and (ii) disjoint sets are independent. If 0<t_{1}<\dots<t_{n}<T are the observed times, the log–likelihood is \log p(\{t_{k}\}\mid\lambda)\;=\;\sum_{k=1}^{n}\log\lambda(t_{k})\;-\;\int_{0}^{T}\lambda(t)\,dt. (1) Taking expectation w.r.t. the same process and using Campbell’s theorem, \mathbb{E}\sum_{k}f(t_{k})=\int_{0}^{T}f(t)\lambda(t)\,dt , yields the negative expected log–likelihood (a.k.a. Poisson entropy functional ) \mathcal{H}[\lambda]\;:=\;-\mathbb{E}\big[\log p\big]\;=\;\int_{0}^{T}\big(\lambda(t)\log\lambda(t)-\lambda(t)\big)\,dt\;+\;\text{const.} (2) II.1 Maximum-entropy principle for temporal networks We seek \bm{\Lambda}(t) that maximizes entropy subject to constraints related to sufficient statistics of interest. Throughout, we consider constraints of two types: (i) structural/node/edge label constraints that concern how mass is apportioned across edges (e.g., expected edge counts or node strengths), and (ii) temporal constraints that govern the global timeline (e.g., the inter-event kernel). We leverage the standard result that exponential-family models arise from maximum entropy with linear constraints. II.2 Temporal networks as marked NHPPs Consider a directed network with node set \mathcal{V} and edge set \mathcal{E}\subseteq\mathcal{V}\times\mathcal{V} . Each temporal event is a pair (t,m) with time t\in[0,T] and mark m=(i\!\to\!j)\in\mathcal{E} . The model is a marked NHPP with edge–specific intensities \lambda_{ij}(t)\geq 0 and superposed (global) intensity \Lambda(t):=\sum_{(i,j)\in\mathcal{E}}\lambda_{ij}(t) . Denote the integrated intensities (“expected counts”) by \mu_{ij}\;:=\;\int_{0}^{T}\lambda_{ij}(t)\,dt. (3) II.3 Maximum entropy with linear constraints We construct the maximum–entropy (MaxEnt) ensemble by minimizing \sum_{ij}\mathcal{H}[\lambda_{ij}] subject to linear constraints of two types: (i) time–dependent constraints on instantaneous totals; and (ii) time–independent constraints on the integrals ( 3 ). In addition to the per edge constraints, we use node strengths s_{i}^{\rm out}=\sum_{j}\mu_{ij} and s_{j}^{\rm in}=\sum_{i}\mu_{ij} , and possibly block–pair totals C_{ab}=\sum_{i\in a}\sum_{j\in b}\mu_{ij} for a node partition \mathcal{B} . For imposing constraints on admissible edges, including a potential block-structure, we introduce a binary mask M_{ij}\in\{0,1\} that encodes the allowed support \mathcal{S}=\{(i,j):M_{ij}=1\} ( forbidden edges have \lambda_{ij}\equiv 0 ). Partitioned time–dependent constraints. Let \mathcal{P}=\{E_{r}\}_{r=1}^{R} be a partition of edges ( E_{r}\cap E_{r^{\prime}}=\varnothing , \cup_{r}E_{r}=\mathcal{E} ). For each part E_{r} we prescribe a target time profile G_{r}(t)\geq 0 : \sum_{(i,j)\in E_{r}}\lambda_{ij}(t)\;=\;G_{r}(t),\qquad r=1,\dots,R,\;\;t\in[0,T]. (4) Special cases include a single global profile ( R=1 , G_{1}=\Lambda ) or sender–specific profiles (take E_{r}=\{(i,j):i=r\} ). II.4 Lagrangian and Euler–Lagrange equation Introduce time–dependent multipliers \alpha_{r}(t) for ( 4 ) and time–independent multipliers for mark–side constraints. The full Lagrangian is \displaystyle\mathcal{L}\;=\; \displaystyle-\sum_{(i,j)\in\mathcal{S}}\!\int_{0}^{T}\!\big(\lambda_{ij}\log\lambda_{ij}-\lambda_{ij}\big)\,dt (5) \displaystyle+\sum_{r=1}^{R}\int_{0}^{T}\alpha_{r}(t)\!\Big(\sum_{(i,j)\in E_{r}\cap\mathcal{S}}\lambda_{ij}(t)-G_{r}(t)\Big)\,dt \displaystyle+\sum_{(i,j)\in\mathcal{S}}\Theta_{ij}\Big(\!\int_{0}^{T}\lambda_{ij}\,dt-\mu_{ij}^{\star}\Big)+\sum_{i}\theta_{i}^{\rm out}\Big(\sum_{j}\!\int_{0}^{T}\lambda_{ij}\,dt-s_{i}^{\rm out,\star}\Big) \displaystyle+\sum_{j}\theta_{j}^{\rm in}\Big(\sum_{i}\!\int_{0}^{T}\lambda_{ij}\,dt-s_{j}^{\rm in,\star}\Big)+\sum_{a,b\in\mathcal{B}}\zeta_{ab}\Big(\sum_{i\in a}\sum_{j\in b}\!\int_{0}^{T}\lambda_{ij}\,dt-C_{ab}^{\star}\Big). Stationarity w.r.t. \lambda_{ij}(t) for (i,j)\in\mathcal{S} and r(i,j) the unique part with (i,j)\in E_{r(i,j)} gives \frac{\delta\mathcal{L}}{\delta\lambda_{ij}(t)}\;=\;-\log\lambda_{ij}(t)-1+\alpha_{r(i,j)}(t)+\Psi_{ij}\;=\;0, (6) Where we grouped the Lagrangian multipliers into the log–linear mark potential \Psi_{ij}\;=\;\Theta_{ij}\;+\;\theta_{i}^{\rm out}\;+\;\theta_{j}^{\rm in}\;+\;\zeta_{g(i),g(j)}\;+\;\log M_{ij}, (7) where any subset of terms can be used depending on the model (set absent multipliers to zero). Hence we derive the multi–profile factorization \boxed{\;\lambda_{ij}(t)\;=\;\phi_{r(i,j)}(t)\,w_{ij},\qquad\phi_{r}(t):=e^{\alpha_{r}(t)},\quad w_{ij}:=e^{\Psi_{ij}-1}.\;} (8) Thus the MaxEnt solution always separates time and marks : each partition has its own time profile \phi_{r} , while all time–independent constraints determine the weights w_{ij} . II.5 Enforcing the constraints Define W_{r}:=\sum_{(i,j)\in E_{r}\cap\mathcal{S}}w_{ij} and \Lambda_{r}:=\int_{0}^{T}\phi_{r}(t)\,dt . The partition constraints ( 4 ) imply \phi_{r}(t)\;=\;\frac{G_{r}(t)}{W_{r}},\qquad r=1,\dots,R. (9) Time–independent constraints act on the integrals: \mu_{ij}\;=\;\int_{0}^{T}\lambda_{ij}(t)\,dt\;=\;\Lambda_{r(i,j)}\,w_{ij}, (10) together with chosen margins (edge totals, strengths, block totals). In practice, ( 10