Hybrid Energy-Based Models for Physical AI: Provably Stable Identification of Port-Hamiltonian Dynamics
Simone Betteti, Luca Laurenti · 2026
Read Hybrid Energy-Based Models for Physical AI: Provably Stable Identification of Port-Hamiltonian Dynamics by Simone Betteti, Luca Laurenti (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-00277.txt.
Introduction
Betteti and Laurenti build hybrid energy-based models for learning port-Hamiltonian dynamics with proven stability, expanding safe designs through absorbing invariance. Unlike classical Lyapunov theory, this property allows richer designs. They extend the theory to nonsmooth units via Clarke derivatives and derive rules for radial growth without bound, exposing an expressivity trade-off in standard models. A hybrid design with a moving visible layer and static hidden layers proves absorbing invariance and extends the proofs there, tested on deformed multi-well and ring systems with altered metrics.
Catalog record
| CREATOR | Simone Betteti, Luca Laurenti |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40197 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.00277
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Hybrid Energy-Based Models for Physical AI: Provably Stable Identification of Port-Hamiltonian Dynamics Simone Betteti, Luca Laurenti Abstract Energy-based models (EBMs) implement inference as gradient descent on a learned Lyapunov function, yielding interpretable, structure-preserving alternatives to black-box neural ODEs and aligning naturally with physical AI. Yet their use in system identification remains limited, and existing architectures lack formal stability guarantees that globally preclude unstable modes. We address this gap by introducing an EBM framework for system identification with stable, dissipative, absorbing invariant dynamics. Unlike classical global Lyapunov stability, absorbing invariance expands the class of stability-preserving architectures, enabling more flexible and expressive EBMs. We extend EBM theory to nonsmooth activations by establishing negative energy dissipation via Clarke derivatives and deriving new conditions for radial unboundedness, exposing a stability-expressivity tradeoff in standard EBMs. To overcome this, we introduce a hybrid architecture with a dynamical visible layer and static hidden layers, prove absorbing invariance under mild assumptions, and show that these guarantees extend to port-Hamiltonian EBMs. Experiments on metric-deformed multi-well and ring systems validate the approach, showcasing how our hybrid EBM architecture combines expressivity with sound and provable safety guarantees by design. 1 INTRODUCTION Energy-based models (EBMs) are a class of machine-learning architectures in which neural dynamics arise as the gradient flow of a Hopfield-type Lyapunov function. Rooted in the pioneering work of 8 and 17 ; 18 , EBMs encode meaningful data patterns as stable equilibria of a dissipative dynamical system, ensuring convergence towards stored representations through gradient descent on an energy landscape. However, the classical Hopfield construction offered limited expressive capacity for modern learning tasks, with the number of retrievable patterns scaling as N/\log(N) for networks of size N ( 25 ) . Recent generalizations of Hopfield networks ( 21 ; 16 ) have dramatically expanded their applicability. Modern EBMs preserve the foundational energy-based structure while exhibiting formal parallels with Transformer architectures ( 28 ) , enabling an exponential scaling of capacity in N ( 10 ) . Their alignment with contemporary neural architectures has facilitated successful deployments across standard machine-learning domains such as image classification ( 15 ) , image generation ( 1 ; 26 ) , and in-context learning ( 31 ) . Canonically, learning in energy-based models relies on optimizing the network parameters to map relevant data-class centroids to stable equilibria and their associated basin of attraction in the energy landscape. Despite their dynamical foundation, EBMs have rarely been deployed for system identification, a domain where the underlying objective of capturing the evolution of nonlinear systems from data is inherently dynamical. System identification ( 2 ; 23 ) sits at the interface of control theory and optimization and has progressively integrated machine-learning components ( 6 ) to accommodate increasingly complex real-world systems. This emerging direction, now widely referred to as physical AI , has driven notable progress in robotics ( 27 ) , power-grid modeling ( 5 ) , and industrial manufacturing ( 11 ) . Yet, the safety-critical nature of these domains demands not only expressive models, but also structural guarantees of stability and robustness ( 9 ) . Recent efforts with dissipative neural networks and stable neural ODEs address this need by enforcing parameter constraints ( 12 ; 32 ) . Notably, recent work on learning Port-Hamiltonian dynamics ( 24 ; 29 ) has centered on learning optimality and empirical benchmarking, with limited attention to stability guarantees or architectural considerations. In summary, existing neural identifiers either lack formal stability guarantees outside the energy and dissipative frameworks or require strong smoothness and convexity assumptions. Contributions. This work introduces an energy-based system identification framework that reconciles stability with expressive modeling. Its main contributions are: • a generalized Lyapunov stability analysis for EBMs with nonsmooth activations, establishing energy dissipation via Clarke derivatives and revealing a structural stability-expressivity trade-off; • a hybrid EBM architecture with dissipative, absorbing invariant visible-layer dynamics, guaranteeing bounded trajectories while avoiding the restrictive conditions imposed by fully recurrent EBMs, and static hidden layer maps for fast and efficient inference; • a Port-Hamiltonian extension enabling identification of nonlinear dynamics under state-dependent metrics and rotational perturbations, validated on metric-deformed multi-well and ring systems. Section II presents the necessary preliminaries. Section III introduces EBMs and formulates the problem. Section IV extends classical C^{2} dissipation results to locally Lipschitz activations and establishes new conditions for radial unboundedness. Section V develops the hybrid architecture and proves absorbing invariance, including its Port-Hamiltonian generalization. Section VI reports numerical validation, and Section VII concludes with future directions. 2 PRELIMINARIES Notation. \mathbbold{1}_{d} denotes the d -dimensional vector with all ones, \mathbbold{0}_{d} the d -dimensional vector with all zeros, while \mathcal{I}_{d} denotes the identity matrix in d×d . We denote compact subsets of d as sets \mathcal{B}\subset\joinrel\subset\real^{d} , and their boundary as \partial\mathcal{B} . For two real vectors x,y of the same dimension, x^{\top}y denotes the standard inner product. Let f:\real^{d}\to\real ; for f\in C^{k}(\real^{d}) , the function is k -times continuously differentiable. For f\in C^{2}(\real^{d}) , the gradient of f is denoted as \nabla f , and the Hessian as D(\nabla f)=D^{2}f . The partial derivative of f with respect to the variable x_{i} is denoted as \partial f/\partial{x_{i}} . \Theta bounds the growth of f\sim\Theta(g) through the existence of constants a,b>0 such and a function g such that a\ g(x)<f(x)<b\ g(x) . Given functions g:\real^{n}\to\real^{d} and f:\real^{d}\to\real , we denote the composition of the two functions as f\circ g(y) , for y\in\real^{n} . The abbreviation a.e. stands for almost everywhere, that is for all \mathcal{B}\subset\real^{d} except zero measure sets. Given a matrix A\in\real^{d\times d} , we denote with A^{\top} its transpose. In case A is symmetric, \uplambda_{\min}(A),\ \uplambda_{\max}(A)\in\real denote its minimum and its maximum eigenvalue. We denote with B_{r}(x)\subset\real^{d} the ball of radius r>0 and center x\in\real^{d} . 2.1 Lie and Clarke’s derivatives Definition 1 (Lie derivative) . Let X:\real^{N}\to\real^{N} be a locally Lipschitz continuous vector field and let \Phi_{X}:\real_{\geq 0}\to\real^{N} denote the associated local flow. For a smooth function g:\real^{N}\to\real , the Lie derivative of g along X is defined as \mathcal{L}_{X}g(x)=\frac{d}{dt}|_{t=0}(g\ \circ\Phi_{X}^{t})(x), (1) and coincides with the directional derivative \mathcal{L}_{X}g(x)=\nabla_{X}g(x)=\nabla_{x}g(x)^{\top}X(x). (2) Lie derivatives ( 22 , Chapters 3, 9) will be central for the characterization of the negative definiteness of the energy function along the trajectories generated by the EBM dynamics. We extend the notion of derivatives to nonsmooth functions by recalling Clarke’s generalized gradient and directional derivative ( 7 ) , which apply to any locally Lipschitz function. Definition 2 (Generalized gradient) . Let f:\real^{N}\to\real be a locally Lipschitz function. The generalized gradient of f at x\in\real^{N} is denoted as \partial f(x) and is the convex hull of the set of limits \lim_{k\to+\infty}\nabla f(x+h_{k}), (3) with h_{k}\xrightarrow{k\to+\infty}\mathbbold{0}_{N} and f differentiable at x+h_{k}\in\real^{N} for all k\in\mathbb{N} . Definition 3 (Generalized directional derivative) . Let f:\real^{N}\to\real be a locally Lipschitz function and take v\in\real^{N} . Then the Clarke’s generalized directional derivative at x\in\real^{N} is defined as \displaystyle f^{\circ}(x;v) \displaystyle=\lim_{h\to\mathbbold{0}_{N}}\sup_{\updelta\to 0}\frac{f(x+h+\updelta v)-f(x+h)}{\updelta} (4) \displaystyle=\max_{\upxi\in\partial f(x)}\upxi^{\top}v. (5) In particular, combining ( 2 ) with ( 5 ), the Clarke Lie derivative of a locally Lipschitz function f along a vector v is given by \mathcal{L}_{v}f(x):=f^{\circ}(x;v)=\max_{\xi\in\partial f(x)}\xi^{\top}v, (6) extending the classical smooth definition to the nonsmooth setting. 2.2 Conjugate (Legendre) transform Definition 4 (Conjugate transform) . Let