Gradient Diffusion: Enhancing Existing Neural Models with Homeostatic Control and Tuning
Lennart P. L. Landsmeer, Mario Negrello, Said Hamdioui, Christos Strydis · 2024
Read Gradient Diffusion: Enhancing Existing Neural Models with Homeostatic Control and Tuning by Lennart P. L. Landsmeer, Mario Negrello, Said Hamdioui, Christos Strydis (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-07327.txt.
Introduction
Landsmeer and co-authors present, in a 2024 paper, a way to tune brain simulations while they run, using a sensitivity method they call gradient diffusion. Brain models are usually fixed before a run by long offline tuning, which leaves them stiff and odd when conditions change. Real neurons, in contrast, adjust themselves without pause to stay in a healthy range.
The key insight is that the equation tracking how a neuron model reacts to its own settings has the same shape as a neuron model itself. It can therefore run inside existing simulators, side by side with the main model. This co-simulation supports both offline and live tuning of realistic brain models. It also opens a lab for studying how real cells keep their balance, including by learning the tuning rule itself.
Catalog record
| CREATOR | Lennart P. L. Landsmeer, Mario Negrello, Said Hamdioui, Christos Strydis |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-07327
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Gradient Diffusion: Enhancing Existing Neural Models with Homeostatic Control and Tuning Lennart P. L. Landsmeer, Mario Negrello, Said Hamdioui, Christos Strydis Abstract Realistic brain modeling requires precise estimation of numerous unobserved parameters, a task hindered by complex nonlinearities and the inaccessibility of the brain’s full dynamical state. Current multicompartmental-model simulations predominantly rely on gradient-free optimization methods, which suffer from the “curse of dimensionality” and are incompatible with online tuning crucial for emulating biological homeostasis. Gradient-based methods offer superior scalability and facilitate online adaptation but are currently inaccessible within existing brain simulators due to the significant resource investment and incompatibility with established simulators. This work introduces a novel methodology for computing parameter gradients for any existing model-and-simulator combination, enabling both offline and online tuning, including the implementation of homeostatic-control mechanisms. Our approach seamlessly integrates traditional simulations with gradient-based optimization, facilitating scalable, robust and adaptive brain simulation without the need for developing new simulators. Figure 1: A Gradient-diffusion approach: A neuron model is enhanced with a gradient (meta) model, by symbolic or automatic differentiation. This creates a new model, which can be simulated by (existing) brain simulators. Resulting gradients can be used for tuning or homeostatic control, or be useful on their own. The neuron model is a discretized, multicompartmental, cable cell. Voltage diffusion happens along connected arrows, ion-channel/leak-based axial currents flow along dotted arrows. Mechanism state and voltages are maintained at filled circles. Such mechanisms, including both state derivatives and transmembrane currents, are written in NMODL files. B Hodgkin-Huxley (HH), linear axon model, with a pulse current applied on one end to create a propagating action potential (AP). Each compartment has a voltage, which is plotted, showing this propagation. C Gradient model of the HH model, showing the resulting gradients over time. Figure 2: A: Simulated-neuron morphology B: Subthreshold Oscillation (STO) with specific timepoints ( + and \times ) C: \left[\hskip-1.0pt\frac{\partial\mathbf{s}}{\partial\theta}{}\hskip-1.0pt\right] at specific timepoints from B D: Loss during optimization using gradient descent (Adam, red) and traditional evolutionary approach (CMA-ES, blue) E: Simulated (red) vs target (black) somatic membrane potential before (top) and after (bottom) training F: Increase in computational time relative to non-gradient simulation, when co-simulating the gradient model G: Homeostatic control of frequency via online learning. Frequency, in the Hodgkin-Huxley system, is derived from (m,h) -state trajectories (see Methods). Different traces show the effect of learning rate ( \alpha , in \cdot 10^{-6} ) on homeostatic control stability of frequency, with \alpha>3\cdot 10^{-6} being unstable. The simulation is 2000 seconds, or 400 million time-steps in the Hodgkin-Huxley system. H: Homeostatic control with different target frequencies, same as G. I: Network tuning via homeostatic control. A network of 10 Hodgkin-Huxley neurons is simulated, where each neuron is receiving spike input from 3 other random neurons. While spike-gradients are not part of the gradient model, the system still tunes to the desired frequency. Introduction Building realistic models of the brain requires estimating many unobserved parameters because the complete dynamical-system state of the brain is not fully observable. It is due to this limitation that – despite nowadays being able to construct and simulate large brain models – they behave poorly once stretched beyond the specific problems for which they were designed. There are good reasons for this parameter-tuning problem : spatially detailed, biophysically realistic models contain a large number of parameters with nonlinear effects such as protein concentrations, synaptic connections or homeostatic dynamical behavior, all of which need to be constantly and concurrently tuned. Then, careful tuning of parameters is key to building robust, composable and adaptable brain models. Tuning of these parameters can take place offline , externally to the simulator, or online , inside the simulator, emulating biological homeostatic control [ 1 ] . General parameter-tuning methods can be divided into gradient-free or gradient-based ones. Gradients represent how changes in model parameters affect simulation output. Currently, gradient-free methods are the dominant approach for offline tuning of realistic brain models using existing brain simulations: manual parameter variation, evolutionary search or randomized search [ 2 , 3 , 4 , 5 ] . However, these are known to suffer from the curse of dimensionality: higher-dimensional parameter spaces take exponentially longer to tune. Furthermore, they do not allow for tuning parameters during simulation, which at the moment requires carefully hand-crafted homeostatic control programs [ 1 ] . Instead, gradient-based methods do not suffer from this curse of dimensionality and scale to the tuning of billions of parameters, as exemplified by current large artificial intelligence models. What is more, online learning methods can also be developed based on gradients. Unfortunately, existing brain simulators do not provide gradient calculation. The construction of new, gradient-enabled simulators from scratch is not a task to be taken up lightly. Maintaining feature compatibility and simulation consistency across simulators is heavily dependent on the simulator engine(s) selected and on the support of ecosystem software tools. There are currently two ongoing efforts building new simulators in an automatic-gradient environment [ 6 , 7 ] . However, these simulators have still not reached NEURON-level compatibility and existing brain models are not supported in this format. Furthermore, they do not support online tuning, i.e., homeostatic control. In contrast, in this brief communication, we advocate for a methodology that enables the calculation of parameter gradients using any unmodified , existing model-and-neurosimulator combination and, subsequently, the support for homeostatic control. Results Let us assume a morphologically detailed, biophysically realistic model of a single neuron ( fig. 1 A-B). Within the brain-simulation software environment, a modeler essentially defines two sets of functions: The ion-channel current contribution i to the membrane potential V , and the time-derivative of the internal state variables \mathbf{s} . These functions are defined for each position on the spatial neuron and depend on a set of parameters \theta : \displaystyle i\left(V,\mathbf{s},\theta\right) (1) \displaystyle\frac{d}{dt}{\mathbf{s}}\left(V,\mathbf{s},\theta\right) (2) With this description in place, our goal is to find the gradients of the voltage V and state \mathbf{s} with respect to the parameters \theta at any point in (simulation) time and for all compartments. To that end, we define a gradient model to be simulated alongside the neural model defined in eq. 1 and eq. 2 . This gradient model consists of the voltage gradients \left[\hskip-1.0pt\frac{\partial V}{\partial\theta}{}\hskip-1.0pt\right] as diffusive ion-species and the state gradients \left[\hskip-1.0pt\frac{\partial\mathbf{s}}{\partial\theta}{}\hskip-1.0pt\right] as internal state variables ( fig. 1 A-C). In our notation, brackets ( \left[\cdot\right] ) denote new state variables introduced for the simulation of the gradient model. The gradient model calculates the voltage and state gradients via direct integration of the sensitivity equation (see Methods) by supplying the time derivatives of \left[\hskip-1.0pt\frac{\partial V}{\partial\theta}{}\hskip-1.0pt\right] and \left[\hskip-1.0pt\frac{\partial\mathbf{s}}{\partial\theta}{}\hskip-1.0pt\right] as mechanisms to the brain simulator: \displaystyle\frac{d}{dt}{\left[\hskip-1.0pt\frac{\partial V}{\partial\theta}{}\hskip-1.0pt\right]}\left(V,\mathbf{s},\theta,\left[\hskip-1.0pt\frac{\partial V}{\partial\theta}{}\hskip-1.0pt\right],\left[\hskip-1.0pt\frac{\partial\mathbf{s}}{\partial\theta}{}\hskip-1.0pt\right]\right) (3) \displaystyle\frac{d}{dt}{\left[\hskip-1.0pt\frac{\partial\mathbf{s}}{\partial\theta}{}\hskip-1.0pt\right]}\left(V,\mathbf{s},\theta,\left[\hskip-1.0pt\frac{\partial V}{\partial\theta}{}\hskip-1.0pt\right],\left[\hskip-1.0pt\frac{\partial\mathbf{s}}{\partial\theta}{}\hskip-1.0pt\right]\right) (4) These time derivatives can be obtained by either symbolic or automatic differentiation. Specifically, the gradient model can be fully expressed either as existing NMODL interfaces ( fig. 3 ) or via the Arbor-PyCat interface developed in Methods, respectively. Applications We now demonstrate the application of gradients in brain models for tuning in the offline and online setting. Gradient-Based Parameter Tuning Given a Loss function \mathcal{L}\left(V,\mathbf{s}\right) , we can define gradient descent by integration over the total simulation time T as: \displaystyle\theta\leftarrow\theta-\alpha\int_{0}^{T}\left(\frac{\partial\mathcal{L}}{\partial V}\left[\hskip-1.0pt\frac{\partial V}{\partial\theta}{}\hskip-1.0pt\right]+\frac{\partial\mathcal{L}}{\partial\mathbf{s}}\left[\hskip-1.0pt\frac{\partial\mathbf{s}}{\partial\theta}{}\hskip-1.0pt\right]\right)dt (5) Here, the application of gradients in brain simulation is