Dynamic Mean Field Theories for Nonlinear Noise in Recurrent Neuronal Networks

Shoshana Chipman, Brent Doiron · 2026

Read Dynamic Mean Field Theories for Nonlinear Noise in Recurrent Neuronal Networks by Shoshana Chipman, Brent Doiron (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-15462.txt.

Introduction

Shoshana Chipman and Brent Doiron build new theory tools for neural circuits in a 2026 arXiv paper. Recurrent networks in the brain face strong, correlated noise. That noise often passes through nonlinear response functions. This makes mean-field analysis hard to carry out. Effects like transients and bifurcations are hard to track as a result.

The authors offer a two-part fix. First, they swap nonlinear functions of Ornstein-Uhlenbeck noise for a Gaussian process with the same mean and covariance. Second, they add a lognormal moment closure for strong nonlinear cases. Together these steps yield a closed mean-field theory. It is built for recurrent neuronal networks with nonlinear noise. Theorists who model brain circuits are the target readers.

Catalog record

CREATORShoshana Chipman, Brent Doiron
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE74 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-15462

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Dynamic Mean Field Theories for Nonlinear Noise in Recurrent Neuronal Networks Thanks: Funded by the Center for Living Systems Shoshana Chipman, Brent Doiron Abstract Strong, correlated noise in recurrent neural circuits often passes through nonlinear transfer functions, complicating dynamical mean-field analyses of complex phenomena such as transients and bifurcations. We introduce a method that replaces nonlinear functions of Ornstein–Uhlenbeck (OU) noise with a Gaussian-equivalent process matched in mean and covariance, and combine this with a lognormal moment closure for expansive nonlinearities to derive a closed dynamical mean-field theory for recurrent neuronal networks. The resulting theory captures order-one transients, fixed points, and shifts in bifurcation structure induced by noise, and outperforms standard linearization-based approximations in the strong-fluctuation regime. More broadly, the approach applies whenever dynamics depend smoothly on OU processes via nonlinear transformations, offering a tractable route to noise-dependent phase diagrams in computational neuroscience models. † † runningheads: Gaussian Equivalent Method / Shoshana Chipman & Brent Doiron 1 Introduction The brain is a noisy dynamical system that exists far from equilibrium. Significant fluctuations are routine, and integral to functionality. One could even argue that a living brain has no steady state at all, and that its closest equivalent is a series of large-variability transients in response to stimuli. A rich tradition [ 38 , 11 , 30 , 8 , 9 , 37 ] exists of coarse-graining populations of neurons into mean-field models of neural firing rates. Much of this work, where it considers noise, does so as a finite-size effect, and as a small perturbation on the desired steady-state result. [ 37 ] explicitly notes that this approximation is made in order to be able to use linear noise approximation as a “main analytical tool”; others simply do not consider correlated input at the microscale. Noise fluctuations and variability are intrinsic to modeling brains. In this work, we derive a mean field theory capable of treating nonlinear noise dependence non-perturbatively, describing transient behavior in response to stimuli. There are three distinct stages of averaging at play in neural mean field models: first, an average over time, to turn neuronal spike trains into firing rates; second, an average over space, to turn individual neural firing rates into a population average; third, an average over noise realizations, to produce a dynamic mean field theory for the evolution of population firing rates in terms of their statistical moments. During the first two stages of coarse-graining, recurrently coupled input – the weighted sum of averaged firing rates – is passed through some characteristic nonlinearity, called the transfer function. When the model includes inhibitory populations which can stabilize the system [ 31 , 5 ] , the transfer function ought to be a power-law nonlinearity (experimental data, such as [ 27 ] , [ 23 ] , and others indicate an exponent between 2.5 and 5); when there is no recourse to inhibition, some choice of sigmoid is traditionally used [ 1 ] . If the microscale model does not include correlated input, the macroscale model will have additive noise as a result of finite-size effects in the coarse-graining process [ 7 ] . If, however, input to the microscale is correlated, there will be noise inside of the transfer function at the macroscale, functioning as coarse-grained input to the firing rates. Moving the noise outside of the transfer function ( [ 28 ] ) or assuming low noise intensity and solving for perturbations on the deterministic fixed point( [ 24 ] ) constitute separate cases. Doing either reduces the SPDE to one of linear additive noise, instead of both additive and multiplicative noise with potential nonlinear dependence in both cases. The systems in which we are interested routinely exhibit \mathcal{O}(1) fluctuations in the firing rates, and so the simplicity of deriving mean field theories by perturbation comes at the price of discarding much of the intrinsic dynamics. Such methods [ 32 , 40 ] also require weak-noise approximations, or weak coupling and Gaussian firing rates, as in [ 15 ] . Noise, treated inside the transfer function and on equal footing with firing rates, may not be weak. We seek a theory for \mathcal{O}(1) fluctuations, without restrictions of noise, correlations, or couplings – a treatment for nonlinear dependence on possibly-strong noise. We dub this the Gaussian equivalent method (GEM), and, in conjunction with a log-normal firing rate Ansatz, we construct a dynamic mean field theory (DMFT) for firing rates. This DMFT captures not only the fixed points, but also transients, of the underlying stochastic model, and inherits the bifurcation structure as well. We provide a prescription and estimation of accuracy of this method in treatments of generic nonlinear dependencies on Ornstein-Uhlenbeck (OU) noise. Section 2 derives the mesoscale model of population neural firing rates from the microscale model of instantaneous firing rates from the voltages. Section 3 derives the dynamic mean field theory for an E/I network with a thresholded quadratic nonlinearity, introduces the Gaussian equivalent method, and motivates lognormal moment closure for expansive nonlinearities. Section 4 discusses the predictive capacity of the DMFT on the effect of noise on the the bifurcations of the stochastic system. Section 5 considers a single neuronal population with a logistic transfer function. Section 6 presents analytic and numerical bounds for the goodness of the noise approximation for general nonlinearities. 2 Coarse-graining the voltage model We begin our analysis by coarse-graining a population of N_{E} excitatory and N_{I} inhibitory neurons into a macroscopic ensemble model. Consider the microscopic model of the population defined by: \displaystyle r_{\alpha}^{j} \displaystyle=\phi(V_{\alpha}^{j}), (1) \displaystyle\tau_{\alpha}\frac{d}{dt}V_{\alpha}^{j} \displaystyle=-V_{\alpha}^{j}+\sum_{k=1}^{N_{E}}W^{kj}_{\alpha E}r_{E}^{k}+\sum_{k=1}^{N_{I}}W^{kj}_{\alpha I}r_{I}^{k}(t)+\mu_{\alpha}+\gamma_{\alpha}\eta^{j}_{\alpha}(t). Here r^{j}_{\alpha} is the firing rate of neuron j in population \alpha\in\{E,I\} , and V_{\alpha}^{j} is the membrane potential of that neuron. Its dynamics are driven by the activity of other neurons r^{k}_{\beta} in population \beta\in\{E,I\} , weighted by synaptic strength W_{\alpha\beta}^{kj} . The transfer function \phi(V) maps the membrane potential to the firing rate. The stochastic process \eta^{j}_{\alpha}(t) is a source of external fluctuations and \mu_{\alpha} is a static input to neurons in population \alpha . Finally, \gamma_{\alpha} and \tau_{\alpha} set, respectively, the noise intensity and time scale of neurons in population \alpha . From our high-dimensional microscopic model we will derive a low-dimensional, aggregated, macroscopic one. The macroscopic model will consider state variables r_{E}=\frac{1}{N_{E}}\sum_{j}r_{E}^{j} and r_{I}=\frac{1}{N_{I}}\sum_{j}r_{I}^{j} , the ensemble averaged firing rates over the E and I populations, respectively. We assume that neurons are all-to-all coupled, and that certain features (such as time scale and noise intensity) are identical across all neurons in a population. Further, we decompose the stochastic processes as: \eta_{\alpha}^{j}(t)=(1-\nu_{\alpha})\chi^{j}_{\alpha}(t)+\nu_{\alpha}\eta_{\alpha}(t). Here \chi^{j}_{\alpha}(t) is a noise process that is unique to neuron j in population \alpha , while the process \eta_{\alpha}(t) is shared among all neurons in the population; the parameter \nu_{\alpha}\in[0,1] sets the relative strength of these individual and shared processes. We take the shared process \eta_{\alpha}(t) itself to decompose across the E and I populations as: \eta_{\alpha}(t)=(1-\rho)\chi_{\alpha}(t)+\rho\eta(t). The \chi_{\alpha}(t) are the fluctuations shared only within population \alpha . \eta(t) are fluctuations seen by all populations. The motivation for considering shared fluctuations is to model low dimensional sources of external fluctuations that will correlate the joint activity of \{r_{\alpha}^{j}\} in a low dimensional subspace, as is often reported in large-scale population

Read the complete text