Harnessing intuitive local evolution rules for physical learning

Roie Ezraty 1 , Menachem Stern 2 , Shmuel M. Rubinstein 1 1 Racah Institute of Physics, Hebrew University of Jerusalem, Jerusalem 9190401, Israel 2 AMOLF, Science Park 104, 1098 XG Amsterdam, The Netherlands [email protected] · 2025

Read Harnessing intuitive local evolution rules for physical learning by Roie Ezraty 1 , Menachem Stern 2 , Shmuel M. Rubinstein 1 1 Racah Institute of Physics, Hebrew University of Jerusalem, Jerusalem 9190401, Israel 2 AMOLF, Science Park 104, 1098 XG Amsterdam, The Netherlands [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-19561.txt.

Introduction

Roie Ezraty, Menachem Stern, and Shmuel Rubinstein wrote a 2025 paper on teaching physical systems to learn. The catalog creator field mixes in their institute addresses, but the head gives the three authors. Machine learning on computers burns much power, so researchers seek materials that learn by their own physics. Their scheme controls only a system's boundary inputs and outputs.

Inside, the material follows simple local rules that cut wasted power as it settles. Their learning rule mirrors a classic early algorithm for training a single-layer network. Computer tests showed the scheme can handle any linear task, in both fitting and sorting, and does best when the local rule is nonlinear. The work needs no big memory or complex wiring inside the material.

Catalog record

CREATORRoie Ezraty 1 , Menachem Stern 2 , Shmuel M. Rubinstein 1 1 Racah Institute of Physics, Hebrew University of Jerusalem, Jerusalem 9190401, Israel 2 AMOLF, Science Park 104, 1098 XG Amsterdam, The Netherlands [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-19561

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Harnessing intuitive local evolution rules for physical learning Roie Ezraty 1 , Menachem Stern 2 , Shmuel M. Rubinstein 1 1 Racah Institute of Physics, Hebrew University of Jerusalem, Jerusalem 9190401, Israel 2 AMOLF, Science Park 104, 1098 XG Amsterdam, The Netherlands [email protected] Abstract Machine Learning, however popular and accessible, is computationally intensive and highly power-consuming, prompting interest in alternative physical implementations of learning tasks. We introduce a training scheme for physical systems that minimize power dissipation in which only boundary parameters (i.e. inputs and outputs) are externally controlled. Using this scheme, these Boundary-Enabled Adaptive State Tuning Systems (BEASTS) learn by exploiting local physical rules. Our scheme, BEASTAL (BEAST-Adaline), is the closest analog of the Adaline algorithm for such systems. We demonstrate this autonomous learning in silico for regression and classification tasks. Our approach advances previous physical learning schemes by using intuitive, local evolution rules without requiring large-scale memory or complex internal architectures. BEASTAL can perform any linear task, achieving best performance when the local evolution rule is non-linear. I Introduction Artificial Intelligence and Machine Learning revolutionized our lives in the last decades; from performing elaborate mathematical computations to playing chess at highest levels Baktash and Dawodi 2023 and predict protein structure Senior et al. 2020 . Artificial-Neural-Networks (ANNs) are at the forefront of these advancements; Inspired by the structure of the brain Burkitt et al. 2004 , ANNs have the remarkable ability to learn multiple tasks and solve difficult inverse-design problems LeCun et al. 2015 . The outstanding versatility of the ANNs is achieved when the number of tunable Degrees of Freedom (DOFs, i.e., weights) is very large. The training process typically relies on gradient descent (GD), which updates all the tunable DOFs simultaneously by following the gradient of a global loss function Rumelhart et al. 1986 . This process is performed in a highly multidimensional space and the training process requires many billions of computations, making it highly power consuming Luccioni et al. 2023 ; Mytton and Ashtine 2022 . Even an efficient online GD implementation such as the Adaline algorithm Widrow and Hoff 1988 , which involves single layer, fully connected linear networks with linear activations, is cumbersome and requires access to all DOFs simultaneously. Furthermore, ANNs rely on centralized computing architectures under a global processor, and as their size increases, training-time increases significantly, leading to substantial slowdowns Bahri et al. 2024 . ANNs have surpassed our abilities in numerous tasks, but nevertheless natural systems still hold several advantages. A brain learns very quickly Zucker and Regehr 2002 ; Kanai and Verstraten 2005 ; French 1999 and efficiently Sengupta and Stemmler 2014 , and appears to capitalize on local rules for synaptic plasticity. Moreover, it is versatile for a variety of tasks and is robust against damage McGovern et al. 2019 . Other natural systems show similar abilities: amoebas can solve the traveling-salesman problem Zhu et al. 2013 , artificial physical systems such as thin sheets can be trained to self-fold into desired shapes Arinze et al. 2023 , memristor arrays can solve linear classification and regression Sun et al. 2020 ; Sun et al. 2019 and laser light can find the ground state of an XY spin lattice model Pal et al. 2020 . Harnessing physical systems for learning tasks Stern and Murugan 2023 ; Lopez-Pastor and Marquardt 2023 ; Martínez-Calvo et al. 2024 ; Wright et al. 2022 , i.e., physical learning, has lately received much attention, especially in power minimizing systems which self optimize their power use Vadlamani et al. 2020 . The advantages extend beyond power efficiency and speed, as physical systems can also interact with and affect their physical environment; they could integrate calculation and functionality in a single medium. Implementing GD algorithms on physical learning systems could hence be of great benefit, since those can accommodate learning with minimal external intervention. It was recently shown that physical materials that minimize elastic energy and whose internal parameters change due to known local rules can be trained to perform a desired functionality. This training procedure, termed Directed Aging Pashine et al. 2019 ; Hexner et al. 2020a , where the outputs are forced to maintain a desired state, was demonstrated in materials such as mechanical Stern et al. 2020 , spring and spin networks Gold and England 2019 ; Kedia et al. 2019 . The scheme capitalizes on local evolution rules without direct knowledge of the internal DOFs. It is, however, limited in the scope of tasks that can be performed; there is no loss function being optimized, so specific input-output relations cannot be directly encoded, as in supervised learning. More versatile training schemes that approximate GD and capitalize on local physical rules in systems that minimize power dissipation are the Contrastive Learning schemes. Examples of which include coupled learning Stern et al. 2021 ; Anisetti et al. 2023 ; Xie and Seung 2003 , contrastive Hebbian learning Movellan 1991 and equilibrium propagation Scellier and Bengio 2017 ; Scellier 2021 , which are inspired by neuroscience and learning theory Hinton 2002 ; Ackley et al. 1985 . These can solve tasks more stringent than those demonstrated with Directed Aging Dillavou et al. 2022 ; Altman et al. 2024 ; Falk et al. 2025 . In Contrastive Learning, supervised training is done by presenting the system with specific examples of an abstract desired function, namely: linear regression or classification. The system lowers a loss based on the examples by evolving its internal parameters following local evolution rules Stern et al. 2024a . As the examples are presented and the system evolves, it eventually learns not only the presented examples but also generalizes. This is a decentralized, physics-based learning that can be very efficient in terms of power dissipation Stern et al. 2024b . However, it requires information from two distinct physical states, usually in the form of external memory or twin couples of the same system. Accessing or computing each internal parameter at all times is still a standing difficulty in the field of physical learning networks. Both Directed Aging and Contrastive Learning train systems where the only parameters directly accessible are the inputs and outputs at the system boundaries, so they are termed here Boundary-Enabled Adaptive State Tuning Systems (BEASTS). The pending question is: can GD be implemented on BEASTS whose internal parameters evolve due to intuitive local physical dynamics, rather than abstract mathematical learning rules? In this work, we develop a physical learning scheme for training BEASTS where internal parameters change due to natural and intuitive physical rules, e.g. fluidic resistances that adjust due to local hydrostatic pressure drops. The perspective here is the opposite of that in Contrastive Learning: instead of deriving a local rule that yields a material with learning capabilities if put under the right boundary conditions and then intricately building such a material, we start from materials that have intuitive local rules and implement a general procedure that trains them using solely boundary conditions. This scheme is applicable to systems that minimize power dissipation, so they are modeled here as fluidic resistor networks whose resistances (or learning DOFs Dillavou et al. 2022 ) change due to local learning rules. This is the closest version of the efficient Adaline

Read the complete text