Remembrance of Tasks Past in Tunable Physical Networks

Purba Chatterjee, Marcelo Guzman, Andrea J. Liu · 2025

Read Remembrance of Tasks Past in Tunable Physical Networks by Purba Chatterjee, Marcelo Guzman, Andrea J. Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-03799.txt.

Introduction

Physical networks that learn, such as grids of adjustable resistors, forget old tasks when trained on new ones. Purba Chatterjee, Marcelo Guzman, and Andrea J. Liu study that forgetting in a 2025 preprint on disordered systems and soft matter. The problem mirrors catastrophic forgetting in artificial neural networks, but here the student is a piece of tunable matter.

Their remedy is a hard threshold in the learning rule: only connections receiving a strong training signal are allowed to change. Thresholding keeps each task's adjustments near its inputs and outputs, so the network splits into weakly overlapping regions, one per task. Simulations of tunable resistor networks show several tasks can then be remembered in sequence. The strategy also uses fewer connections and lowers the overall cost of tuning. The authors suggest constrained training as a simple, local route past forgetting.

Catalog record

CREATORPurba Chatterjee, Marcelo Guzman, Andrea J. Liu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-03799

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Remembrance of Tasks Past in Tunable Physical Networks Purba Chatterjee, Marcelo Guzman, Andrea J. Liu Abstract Sequential learning in physical networks is hindered by catastrophic forgetting, where training a new task erases solutions to earlier ones. We show that we can significantly enhance memory of previous tasks by introducing a hard threshold in the learning rule, allowing only edges with sufficiently large training signals to be altered. Thresholding confines tuning to the spatial vicinity of inputs and outputs for each task, effectively partitioning the network into weakly overlapping functional regions. Using simulations of tunable resistor networks, we demonstrate that this strategy enables robust memory of multiple sequential tasks while reducing the number of edges and the overall tuning cost. Our results hint at constrained training as a simple, local, and scalable mechanism to overcome catastrophic forgetting in tunable matter. In physical networks, the interactions between nodes are dictated by the properties of the connecting edges. For example, nodes in a resistor network connected by resistors characterized by their conductances. As a whole, such networks can “compute” voltages at designated output nodes given voltages applied to input nodes by simply obeying their natural dynamics, driven by the physical imperative to satisfy Kirchhoff’s laws. In tunable resistor networks, the conductances become “tunable degrees of freedom,” adjusted individually to obtain a desired output response to applied inputs—they are tuned to satisfy a task Goodrich et al. 2015 ; Rocks et al. 2017 ; Pashine et al. 2019 . “Self-tuning” networks have edges that can adjust their tunable degrees of freedom on their own, according to a local rule Stern and Murugan 2023 . Such networks can perform autonomous supervised Pashine et al. 2019 ; Hexner et al. 2020 ; Hexner 2021 ; Dillavou et al. 2022 ; Dillavou et al. 2024 ; Kaiser et al. 2022 ; Niu et al. 2024 ; Cherry and Qian 2025 and unsupervised Guzman et al. 2025a learning, thereby bypassing the need for central processors and memory storage and potentially leading to scalable self-tuning networks. Multiple tasks can be trained in a single network, either simultaneously, by switching among them until a joint solution is found Dillavou et al. 2025 ; Falk et al. 2023 , or sequentially, where tasks are learned one after the other Kortge 2022 ; French 1991 ; Lewandowsky 2014 ; McNaughton and O’Reilly 1995 ; Kumaran et al. 2016 ; Robins 1995 ; Kirkpatrick et al. 2017 ; Serra et al. 2018 ; Jedlicka et al. 2022 . However, sequential training is often unsuccessful due to forgetting: learning a new task modifies the tunable degrees of freedom and can move the system away from the solution of previous tasks. Forgetting can be abrupt, as in catastrophic forgetting French 1999 ; Laurier . In artificial neural networks, strategies to address this problem rely on reducing representational overlap Kortge 2022 ; French 1991 ; Lewandowsky 2014 , or protecting weights that are important for previous tasks McNaughton and O’Reilly 1995 ; Kumaran et al. 2016 ; Robins 1995 ; Kirkpatrick et al. 2017 ; Serra et al. 2018 ; Jedlicka et al. 2022 . However, these approaches require global information and entail heavy memory storage and computational costs. Here we focus on supervised learning and demonstrate a simple, powerful strategy to enhance memory of previously-trained tasks in tunable resistor networks. We show that reducing the sensitivity of updates of tunable degrees of freedom—ignoring training signals below a threshold—enhances memory of previously learned tasks. This principle exploits the nature of physical networks, where physical responses, and hence learning signals, decay with the distance from applied inputs. Intuitively, a threshold spatially confines training updates. As a consequence, multiple tasks can be learned sequentially by concentrating the tuned edges for each task in different spatial regions. Note that a threshold is a local constraint—each tunable resistor only needs to assess its own training signal—and does not rely on the specifics of the tuning process. Systems studied— We consider ohmic (linear) resistor networks of N voltage nodes and N_{E} resistive edges with tunable conductances \{k_{1},k_{2},...,k_{N_{E}}\} that are modified during training. Nodes have fixed positions in space and edges connect nearby nodes. Throughout the paper, we work with disordered planar networks with periodic boundary conditions. A task is defined as a voltage input-output relation. We start with “edge-coupling,” where the input is defined as an imposed voltage drop V_{S} across two adjacent source nodes, and the output is the voltage drop V_{T} across adjacent target nodes at some distance from the source. The desired input-output relation is V_{T}=\Delta V_{S} , with coupling value \Delta Rocks et al. 2019 ; Rocks et al. 2021 ; Rocks et al. 2017 . For resistor networks, Kirchhoff’s and Ohm’s laws imply a linear response V_{T}=\mathcal{R}V_{S} , where \mathcal{R} is a scalar (or matrix for multiple inputs/outputs) that depends nonlinearly on all conductances Stern et al. 2025 ; Guzman et al. 2025b . The performance of a task is quantified by the error between the physical output response and the desired output. For edge-coupling, we consider the mean-square error, \mathcal{E}=(\Delta V_{S}-\mathcal{R}V_{S})^{2}/2 . Training thus corresponds to updating the conductances such that the error is minimized. In general, this is achieved by updates of the form k_{i}\rightarrow k_{i}+\Delta k_{i} , with \Delta k_{i}=-\gamma\partial C/\partial{k_{i}} being the training signal, C a cost function sharing the same minimum as the error \mathcal{E} (for gradient descent C=\mathcal{E} ), and \gamma the training rate. In this work, we consider tuning rules of the type \Delta k_{i}=\begin{cases}-\gamma\partial\mathcal{C}/\partial k_{i},&\text{if }|\partial\mathcal{C}/\partial k_{i}|>\lambda\\ 0,&\text{otherwise}\end{cases}. (1) Thus, the conductance of an edge is updated only if magnitude of its gradient exceeds a fixed threshold \lambda . This criterion is fundamentally local, making it suitable for local tuning rules Stern et al. 2021 ; Guzman et al. 2025a ; Scellier and Bengio 2017a ; Pashine et al. 2019 , although thresholds can also be introduced into global tuning processes. In all reported simulations we choose C to be the contrastive power Scellier and Bengio 2017b ; Stern et al. 2021 , leading to the Coupled Learning rule Stern et al. 2021 implemented experimentally in Contrastive Local Learning Networks Dillavou et al. 2024 . Details of the training protocol are given in the SI. Thresholding in single and multiple tasks— We begin with a network trained sequentially for two edge-coupling tasks A and B , with coupling value \Delta=1 for both, see Fig. 1 a. We first train the network to minimize the error \mathcal{E}_{A} and then \mathcal{E}_{B} . The overall performance is defined as the joint error, \mathcal{E}=(\mathcal{E}_{A}+\mathcal{E}_{B})/2 . The effects of the threshold are shown in Fig. 1 b,c,d, for several values of \lambda . In the absence of a threshold ( \lambda=0 ) the network has maximal sensitivity, adapts to the smallest gradients, and therefore reaches the lowest error \mathcal{E}_{A} for task A. However, subsequent training on task B drives \mathcal{E}_{A} back to values comparable to the untrained case, while lowering \mathcal{E}_{B} . The network learns both tasks well in isolation but almost completely forgets task A when trained for B, leading to large joint error \mathcal{E} . In contrast, for \lambda>0 there is a tradeoff: the network cannot reach the lowest individual task

Read the complete text