Lagrangian-based Equilibrium Propagation: generalisation to arbitrary boundary conditions & equivalence with Hamiltonian Echo Learning

Guillaume Pourcel 1 , Debabrota Basu 2,⋆ , Maxence Ernoult 3,⋆ , Aditya Gilra 4,⋆ · 2025

Read Lagrangian-based Equilibrium Propagation: generalisation to arbitrary boundary conditions & equivalence with Hamiltonian Echo Learning by Guillaume Pourcel 1 , Debabrota Basu 2,⋆ , Maxence Ernoult 3,⋆ , Aditya Gilra 4,⋆ (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-06248.txt.

Introduction

Pourcel, Basu, Ernoult, and Gilra extend a brain-like learning method so it can handle inputs that change over time. The method, equilibrium propagation, trains energy-based models by letting them settle, but its math covered only fixed inputs. Their 2025 work rebuilds the method on a broader action-based frame that follows the whole path of the system.

Different end conditions then give different learning rules, and many turn out impractical to build. One known family, Hamiltonian echo learning, falls out as a special case. The authors show it is the only version they found that keeps the traits that make the method attractive for hardware. Those traits are forward-only running, few passes at any model size, and learning from local signals alone.

Catalog record

CREATORGuillaume Pourcel 1 , Debabrota Basu 2,⋆ , Maxence Ernoult 3,⋆ , Aditya Gilra 4,⋆
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE98 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-06248

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Lagrangian-based Equilibrium Propagation: generalisation to arbitrary boundary conditions & equivalence with Hamiltonian Echo Learning Guillaume Pourcel 1 , Debabrota Basu 2,⋆ , Maxence Ernoult 3,⋆ , Aditya Gilra 4,⋆ Abstract 1 1 footnotetext: University of Groningen (Netherlands), Univ. Lille, Inria, CNRS, Centrale Lille, UMR 9189 - CRIStAL (France), [email protected] 2 2 footnotetext: Univ. Lille, Inria, CNRS, Centrale Lille, UMR 9189 - CRIStAL (France), [email protected] 3 3 footnotetext: No affiliation when project started, now at Google DeepMind (France), [email protected] 4 4 footnotetext: Centrum Wiskunde & Informatica (Netherlands), the University of Sheffield (UK), [email protected] $\star$ $\star$ footnotetext: Equal authorship, listed in alphabetical order. Equilibrium Propagation (EP) is a learning algorithm for training Energy-based Models (EBMs) on static inputs which leverages the variational description of their fixed points. Extending EP to time-varying inputs is a challenging problem, as the variational description must apply to the entire system trajectory rather than just fixed points, and careful consideration of boundary conditions becomes essential. In this work, we present Generalized Lagrangian Equilibrium Propagation (GLEP), which extends the variational formulation of EP to time-varying inputs. We demonstrate that GLEP yields different learning algorithms depending on the boundary conditions of the system, many of which are impractical for implementation. We then show that Hamiltonian Echo Learning (HEL) – which includes the recently proposed Recurrent HEL (RHEL) and the earlier known Hamiltonian Echo Backpropagation (HEB) algorithms – can be derived as a special case of GLEP. Notably, HEL is the only instance of GLEP we found that inherits the properties that make EP a desirable alternative to backpropagation for hardware implementations: it operates in a “forward-only” manner ( i.e. using the same system for both inference and learning), it scales efficiently (requiring only two or more passes through the system regardless of model size), and enables local learning. 1 Introduction The search for an alternative to backpropagation. Historically, feedforward networks alongside backpropagation have accidentally dominated the deep learning landscape over the last decade as the result of a “hardware lottery” ( Hoo 20 ) : algorithms fitting the best available hardware win. Digital CPU/GPU/TPU JYP+ 17 architectures provide the flexibility to implement any feedforward computational graph, including the exact implementation of backpropagation, though at the cost of digital overhead, complex memory hierarchies and resulting data movement. In the short run, this motivates for instance the search for “IO–aware” algorithms DFE+ 22 to mitigate High-Bandwidth Memory (HBM) accesses, as well as quantization algorithms to further reduce the memory bandwidth and computational cost of verbatim backpropagation for on-device applications LZC+ 22 , among many other approaches going beyond the scope of this paper. In the longer run, a radically different approach is the search for alternative learning algorithms that move away from the digital paradigm and instead directly exploit the analog physics of the underlying hardware ( JNv 23 ; LWWM 24 ) . An important direction of research to achieve this goal is the development of learning algorithms which unify inference and learning within a single physical circuit ( S+ 86 ; Spa 92 ; FFS 07 ; SB 17 ; GG 17 ; RKLH 22 ; Hin 22 ; LPM 23 ; DBS+ 24 ) . This challenge, which we herein motivate for alternative hardware design, historically originated from neurosciences : biological neural networks face similar constraints, as backpropagation is widely considered biologically implausible for training neural networks ( RHW 86 ; LSM+ 20 ) . For instance, the strict implementation of backpropagation in biological systems would require a dedicated side network sharing parameters from the inference circuit to propagate error derivatives backward through the system, a problem coined weight transport ( LCTA 16 ; AWH+ 19 ) . The search for backprop alternatives therefore holds promise for both providing insights into how the brain might learn RLB+ 19 ; PCG+ 23 and designing energy-efficient analog hardware MRS+ 24 . Equilibrium Propagation and its limitations. Equilibrium Propagation (EP) SB 17 is a learning algorithm using a single circuit for inference and gradient computation and yielding an unbiased, variance-free gradient estimation – which is in stark contrast with alternative approaches relying on the use of noise injection S+ 86 ; Spa 92 ; FFS 07 ; RKLH 22 . A fundamental requirement of EP is that the models are use should be energy-based , e.g. the model prediction is implicitly given as the minimum of some energy function. Therefore, EP falls under the umbrella of implicit learning algorithms such as implicit differentiation (ID) BB 08 which train implicit models BKK 19 to have steady states mapping static input–output pairs. EP is endowed with strong theoretical guarantees SB 19 ; EGQ+ 19 as it can be shown to be equivalent to a variant of ID called Recurrent Backpropagation Alm 89 ; Pin 89 , which can be regarded as an instantiation of Backpropagation Through Time (BPTT) through equilibrium computation. While EP has been predominantly explored on Deep Hopfield Networks Ros 60 ; Hop 82 ; SB 17 ; EGQ+ 19 ; LES+ 21 ; LZ 22 ; SEKK 23 ; NE 24 , the application of EP to resistive networks ( KPM+ 20 ; Sce 24 ) has ushered in an exciting direction of research for learning algorithms amenable to analog hardware, with projected energy savings of four order of magnitudes YKWK 23 . Yet, a major conundrum is to extend EP to time-varying inputs . One straightforward approach would be to consider well-crafted EBMs which adiabatically evolve with incoming inputs – i.e. at each time step, the system settles to equilibrium under the influence of the current input and of the steady state reached under the previous input. Such EBMs would formally fall under the umbrella of Feedforward-tied EBMs (ff-EBMs) ( NE 24 ) , which read as feedforward composition of EBM blocks and are reminiscent of fast associative memory models BHM+ 16 . However, this approach is tied to a very specific class of models, would be costly to simulate ( i.e. computing a steady state for each incoming input) and would be memory costly ( i.e. it would require storing the whole sequence of steady states and traversing them backwards for EP-based gradient estimation). A more general approach to extend EP to the temporal realm is to instead consider dissipative-free systems and pick their action as an energy function ( Sce 21 ; Ken 21 ) , which we herein refer to as Lagrangian-based EP (LEP). In the LEP setup, the energy minimizer is no longer a steady state alone but the whole physical trajectory . However, existing LEP proposals remain theoretical and did not lead to any practical algorithmic prescriptions due to the need to carefully handle complex boundary conditions arising in the underlying variational problem. This limitation raises our first key question: Question 1: Can LEP be generalised to design efficient and practically-implementable learning algorithms for time-varying inputs? Hamiltonian-based approaches. In parallel to EP research, learning algorithms grounded in reversible Hamiltonian dynamics have emerged as another promising direction of research. One such algorithm, Hamiltonian Echo Backpropagation (HEB, ( LPM 23 ) ), was developed with theoretical physics tools to train the initial conditions of physical systems governed by field equations for static input-output mappings. More recently,

Read the complete text