Thermodynamics-Inspired Computing with Oscillatory Neural Networks for Inverse Matrix Computation

G. Tsormpatzoglou, F. Sabo and A. Todri-Sanial* · 2025

Read Thermodynamics-Inspired Computing with Oscillatory Neural Networks for Inverse Matrix Computation by G. Tsormpatzoglou, F. Sabo and A. Todri-Sanial* (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-22544.txt.

Introduction

George Tsormpatzoglou, Filip Sabo, and Aida Todri-Sanial explore a new kind of computer built from linked oscillators, units that swing in rhythm like pendulums. Such networks are usually used as Ising machines to solve hard scheduling puzzles. The team instead asks whether they can do basic linear algebra, namely finding the inverse of a matrix.

Their design borrows ideas from thermodynamics, the physics of heat and energy flow. Using a simple near-linear view of a classic model of synced oscillators, they show on paper that the network's resting state encodes the matrix inverse. Computer tests back up the math. The authors also map out the settings where the method is most accurate, a step toward fast, low-power analog hardware.

Catalog record

CREATORG. Tsormpatzoglou, F. Sabo and A. Todri-Sanial*
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-22544

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Thermodynamics-Inspired Computing with Oscillatory Neural Networks for Inverse Matrix Computation G. Tsormpatzoglou, F. Sabo and A. Todri-Sanial* Abstract We describe a thermodynamic-inspired computing paradigm based on oscillatory neural networks (ONNs). While ONNs have been widely studied as Ising machines for tackling complex combinatorial optimization problems, this work investigates their feasibility in solving linear algebra problems, specifically the inverse matrix. Grounded in thermodynamic principles, we analytically demonstrate that the linear approximation of the coupled Kuramoto oscillator model leads to the inverse matrix solution. Numerical simulations validate the theoretical framework, and we examine the parameter regimes that computation has the highest accuracy. I Introduction Linear algebra is involved in many engineering problems, and its importance has been amplified by recent advances in AI [ 1 , 2 ] . Training AI models requires algorithms which depend heavily on linear algebra operations such as solving linear systems of equations or inverting matrices, which take up a significant portion of time and energy [ 3 ] . Currently, the best hardware architectures available for computing linear algebra calculation are Graphical Processing Units (GPUs). GPUs computing power have allowed for much of the advancements in AI, however, they have limitations. Specifically, as the matrix and vector dimensions d increase, the time-complexity scales with O(d^{3}) [ 4 ] . Computing architecture has remained largely unchallenged since its foundational principles set by von Neumann in late 50’s [ 5 ] . Von Neumann architecture suffers mainly from the separation between the processing unit and memory, leading to the so-called memory wall [ 6 ] . This bottleneck results in increased latency, excessive thermal dissipation and large power consumption. Moreover, with Moore’s law reaching its limit [ 7 ] , research for alternative hardware has been developing. This paper describes a novel computing paradigm based on thermodynamic principles with coupled oscillatory neural networks [ 8 ] . With continuous device scaling, signal voltage and noise levels in transistors and logic gates continue to reduce and approaching the magnitude levels of thermal fluctuations, which in principle can help make computation become even more energy efficient such as perform logic operations in levels of k_{B} T [ 9 ] . However, in classical computing based on von Neumann architectures, comparable levels of voltage signals and noise is undesirable and makes deterministic computation even more challenging to distinguish signals from noise, hence, typically circuits are over designed to allow sufficient signal noise ratio for reliable computation. Going beyond classical deterministic computation, new models for computing are being explored and developed, such as neuromorphic, probabilistic, adiabatic, and quantum computing, among others [ 10 , 11 , 12 , 13 ] . This paper introduces a novel computing paradigm rooted in thermodynamics principles [ 14 , 9 , 15 , 16 ] which are emulated through a physical system of coupled electrical oscillators [ 8 ] . Thermodynamic computing leverages thermal fluctuations for computing and applies to systems both in and far from equilibrium [ 16 , 17 , 18 ] . Thus, rather than over-designing computing hardware to suppress or mitigate noise and thermal fluctuations, in thermodynamic computing, they are useful and harnessed as integral components to the computing framework. We propose a thermodynamically inspired computing by engineering a physical system of coupled oscillators that evolves towards thermal equilibrium for performing computations. The essence is that thermal fluctuations enable state changes for the system to evolve towards equilibrium. Fluctuations such as noise, heat or variations are omnipresent in nature and also in electronic circuits. This raises the question of harnessing these multi-scale fluctuations to allow a physical system of coupled oscillators to evolve and reach stability for solving a problem of interest. Recent works also explored thermodynamic computing and its physical implementations such as RLC-based circuits or mechanical-based systems [ 4 , 19 ] . In [ 4 , 17 ] , are first to report that a linear system of equations and inverse matrices can be solved with systems that have certain attributes, using principles of thermodynamics. Alternatively, in our work, we explore a system of coupled electrical harmonic oscillators for computing the inverse matrix. Coupled oscillators exhibit fascinating phase dynamics from in-phase to out-of-phase, allowing information to be encoded in phase differences between signals [ 20 ] . Intrinsically, coupled oscillator systems minimize their energy as they evolve and reach ground states [ 21 ] . This energy minimization has made them suitable for performing associative memory tasks such as pattern retrieval [ 22 , 23 , 24 , 25 , 26 ] . Additionally, they have been implemented as Ising machines, notably [ 21 , 27 , 28 ] and also finite state machines [ 29 ] . ONNs have displayed a remarkable ability to find efficient solutions to problems such as pattern recognition, image processing and combinatorial optimization such as Max-Cut or Traveling Salesman Problem, notably [ 8 , 30 , 31 , 32 , 33 ] . In this work, we apply thermodynamic principles to coupled oscillators by leveraging their intrinsic dynamics, rapid evolution and energy minimizing behavior to compute the inverse matrix problem [ 4 ] . To this end, we employ the framework of coupled oscillators modeled by the Kuramoto formalism [ 34 ] . Given the thermodynamic nature of the system, a complete analysis requires stochastic formulations. These stochastic methods are essential to retrieve the needed information from the ONNs. II Background Here, we present the theoretical background to describe the dynamics of coupled oscillators and the stochastic principles, which together enable thermodynamically inspired computations in ONNs. II-A Theoretical Background on ONNs An in-depth review on ONN computing can be found in [ 8 ] . Here, we focus primarily on coupled sinusoidal oscillators [ 20 ] , though the proposed approach is general enough to be applied to other types of oscillator model. The dynamics of coupled sinusoidal oscillators can be described using the Kuramoto model as [ 34 , 29 ] : \frac{d\phi_{i}}{dt}=-K\sum_{j}J_{ij}\sin{(\phi_{i}-\phi_{j})}, (1) where \phi_{i} is the phase of each oscillator, J_{ij} is the matrix with the coupling of the oscillators and K is the overall connection strength. Harmonic injection with the same frequency as oscillator frequency is added to the i -th oscillator with strength K_{s_{i}} [ 35 ] resulting in: \frac{d\phi_{i}}{dt}=-K\sum_{j}J_{ij}\sin{(\phi_{i}-\phi_{j})}-K_{s_{i}}\sin{(\phi_{i})}. (2) Next, we derive the ONN energy by applying the global Lyapunov function [ 35 ] of the Kuramoto equation ( 2 ) and it has the following form: E(\phi(t))=-\frac{1}{2}K\sum_{i}\sum_{j}J_{ij}\cos{(\phi_{i}-\phi_{j})}-\sum_{i}K_{s_{i}}\cos{(\phi_{i})}. (3) Coupled oscillator dynamics evolves until they reach a steady state or the ground state in their energy landscape. The energy gradient comprises the derivatives of the Lyapunov function as follows: \frac{\partial E(\phi(t))}{\partial\phi_{i}}=K\sum_{j}J_{ij}\sin(\phi_{i}-\phi_{j})+K_{s_{i}}\sin(\phi_{i}). (4) The ONN energy decreases over time indicating that the coupled oscillators are moving toward a stable configuration and also serves as an indicator for the degree of synchronization among oscillators. It is important to note that the inputs to ONNs can be encoded through the initial phase differences among oscillators, coupling strengths or the injected harmonic noise [ 20 ] . II-B Theoretical Background on Stochastics A linear system from classical physics has a general form of potential energy function with the following form: U(x)=\frac{1}{2}x^{T}Ax-b^{T}x, (5) where x is a vector with d degrees

Read the complete text