The Phase Is the Gradient: Equilibrium Propagation for Frequency Learning in Kuramoto Networks

Mani Rash Ahmadi · 2026

Read The Phase Is the Gradient: Equilibrium Propagation for Frequency Learning in Kuramoto Networks by Mani Rash Ahmadi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-10272.txt.

Introduction

Ahmadi proves that in a Kuramoto network at stable equilibrium, weak nudging shifts phases along the loss gradient for natural frequencies. Equality holds as nudging strength fades to zero. Earlier work set frequency aside as learnable. On layered architectures, frequency learning beats coupling-weight learning among converged seeds, 96 percent versus about 83 percent at matched counts. Random starts fail about half the time from the loss landscape, not gradient error. Topology-aware spectral seeding removes the failures, lifting the task from 46 to all 100 seeds.

Catalog record

CREATORMani Rash Ahmadi
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40939
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.10272

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The Phase Is the Gradient: Equilibrium Propagation for Frequency Learning in Kuramoto Networks Mani Rash Ahmadi Abstract We prove that in a coupled Kuramoto oscillator network at stable equilibrium, the physical phase displacement under weak output nudging is the gradient of the loss with respect to natural frequencies, with equality as the nudging strength β → 0 \beta\to 0 . Prior oscillator equilibrium propagation work explicitly set aside natural frequency as a learnable parameter ( Wang et al. 2024 ) ; we show that on sparse layered architectures, frequency learning outperforms coupling-weight learning among converged seeds (96.0% vs. 83.3% at matched parameter counts, p = 1.8 × 10 − 12 p=1.8\times 10^{-12} ). The ∼ \sim 50% convergence failure rate under random initialization is a loss-landscape property, not a gradient error; topology-aware spectral seeding eliminates it in all settings tested (46/100 → \to 100/100 seeds on the primary task; 50/50 on a second task, K K -only training, and a larger architecture). 1 Introduction The digital infrastructure for training neural networks is built on a single assumption: that computing parameter gradients requires a computation distinct from, and more expensive than, inference. The backward pass of backpropagation stores every intermediate activation, runs the transpose Jacobian layer by layer, and coordinates globally via the chain rule. For a transformer with L layers and hidden dimension d , the backward pass costs approximately 4Nd floating-point operations per token—twice the forward pass—and requires storing O(L\cdot d) activations in high-bandwidth memory ( Korthikanti et al. 2023 ) . At the scale of GPT-3, this means 1,287 MWh of training energy and \sim 118 GiB of activation storage per training step ( Patterson et al. 2021 ) . The machine learning community is aware of this cost. The response has been a proliferation of digital workarounds: quantization to 1.58-bit ternary weights eliminates matrix multiplication ( Ma et al. 2024 ) ; state-space models replace quadratic attention with linear dynamics ( Gu and Dao 2023 ) ; mixture-of-experts activates only 2% of parameters per token ( Shazeer et al. 2017 ) ; KV-cache compression reduces memory from O(N) to constant size ( Liu et al. 2024 ) ; and energy-based transformers replace single-pass softmax with iterative gradient descent on an energy surface, achieving better out-of-distribution generalization in 3 forward passes ( Gladstone et al. 2025 ) . Each of these techniques addresses a specific bottleneck of the digital training pipeline. We show that coupled oscillator networks sidestep one of these bottlenecks entirely: the gradient of a loss function with respect to oscillator parameters is physically encoded in the equilibrium phase response, requiring no backward pass, no stored activations, and no chain rule. Specifically, we prove a phase-gradient identity for Kuramoto oscillator networks: weakly nudging the output toward a target causes every oscillator’s phase to shift by exactly the loss gradient with respect to its natural frequency ( Theorem 6 , Figure 1 ). The proof reveals that the Jacobian of the Kuramoto equilibrium is the negative of a coupling-weighted graph Laplacian, connecting gradient propagation to diffusion on the coupling graph. This identity is an instance of equilibrium propagation ( Scellier and Bengio 2017 ) applied to Kuramoto dynamics with natural frequency as the learnable parameter—a parameter that all prior oscillator EP work explicitly set aside. This paper makes three contributions: 1. The phase-gradient identity ( Section 4 ). We derive the exact gradient formula for natural frequencies via the implicit function theorem, revealing the Laplacian structure of the equilibrium Jacobian. The identity is verified to machine precision (cosine similarity =1.000000 ) across networks of 6 to 200 oscillators using three scipy-based cross-checks (two-phase, analytical, and finite-difference) plus a computationally independent PyTorch autograd reimplementation. 2. Conditional advantage of natural frequency on sparse architectures ( Section 6.3 ). Across 100 seeds, all-seed accuracy is indistinguishable between \omega -only and K -only ( p=0.98 ). Conditioned on training convergence, \omega -only achieves 96.0% vs. 83.3% at matched parameter counts (7 vs. 7; p=1.8\times 10^{-12} , Welch’s t -test). Tripling K ’s parameter budget does not close the gap. This is a sparse-architecture result; coupling-only learning achieves state-of-the-art accuracy on dense networks ( Wang et al. 2024 ; Rageau and Grollier 2025 ) . 3. Convergence diagnosis and spectral seeding ( Section 6.4 ). The \sim 50% convergence failure rate under random initialization is consistent with loss-landscape multistability, not gradient error: the same seeds fail across five distinct training configurations (Cochran’s Q=0 ). In the sparse layered settings tested, we eliminate this failure via spectral seeding : initializing \omega from the eigenvectors of the coupling graph Laplacian, weighted by output separation and inverse eigenvalue. This raises the fraction of seeds exceeding 60% final test accuracy from 46/100 to 100/100 on the primary task, and achieves 50/50 across a second vowel task, K -only training, and a larger architecture. This work connects three lines that have not previously been unified. Hoppensteadt and Izhikevich ( Hoppensteadt and Izhikevich 1999 ) showed that Kuramoto oscillator networks have Hopfield-like associative memory properties and proposed oscillator hardware, but used only Hebbian learning. Scellier and Bengio ( Scellier and Bengio 2017 ) proved that equilibrium propagation computes exact gradients in energy-based systems, but the framework does not identify which parameters to learn or reveal the gradient structure for specific dynamics. Wang et al. ( Wang et al. 2024 ) applied EP to phase oscillators but explicitly set aside natural frequency as a learnable parameter. We complete the arc: the gradient that Hoppensteadt’s oscillators could not compute, that Scellier’s framework guarantees exists, and that Wang’s implementation set aside, was in the phase displacement all along. 2 Related Work Equilibrium propagation. Scellier and Bengio ( Scellier and Bengio 2017 ) proved that for energy-based models at equilibrium, the gradient of a cost function with respect to model parameters can be estimated from the difference between a free-running and a weakly nudged equilibrium. Scellier ( Scellier 2018 ) later generalized EP to vector field dynamics without an energy function. Ernoult et al. ( Ernoult et al. 2019 ) proved that EP gradients match backpropagation-through-time gradients exactly in RNNs with static input. Zucchet and Sacramento ( Zucchet and Sacramento 2022 ) unified EP with implicit differentiation in a bilevel optimization framework, showing that EP is a physical implementation of the general IFT-based gradient computation. Our derivation is an instance of this framework applied to Kuramoto dynamics; the value of the specific instantiation is that it reveals the Jacobian-as-Laplacian structure, identifies \omega as a learnable parameter that prior work explicitly set aside, and enables machine-precision verification of gradient exactness. EP in oscillator networks. Wang, Wanjura, and Marquardt ( Wang et al. 2024 ) applied EP to XY-coupled phase oscillators, optimizing coupling weights W_{ij} and bias phases \psi_{i} on XOR and MNIST tasks (94.1% on 8\times 8 MNIST with a layered architecture). They explicitly set aside natural frequencies, noting that frequency dispersion “may lead to the absence of stable fixed points.” Rageau and Grollier ( Rageau and Grollier 2025 ) extended oscillator EP to handle frequency dispersion, achieving 97.8% on full MNIST in the synchronized case and 96–97% under dispersion, with coupling-only learning. Gower et al. ( Gower et al. 2025a ; Gower

Read the complete text