Impact of heavy-tailed synaptic strength distributions on self-sustained activity in networks of spiking neurons.

Ralf Tönjes, Chunming Zheng, Wenping Cui, Benjamin Lindner · 2026

Read Impact of heavy-tailed synaptic strength distributions on self-sustained activity in networks of spiking neurons. by Ralf Tönjes, Chunming Zheng, Wenping Cui, Benjamin Lindner (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-21781.txt.

Introduction

Tönjes and co-authors ask how the spread of synaptic strengths shapes steady firing in spiking neuron networks. They use stochastic mean-field theory on quadratic integrate-and-fire units. Two coupling types are compared: Gaussian, with light tails, and Cauchy, with heavy tails. Both allow two stable states, one quiet and one with self-sustained firing. With Cauchy coupling, activity can spread network-wide from a few firing units past a sharp threshold. That spread can be smooth or abrupt, based on the balance of excitation and inhibition.

Catalog record

CREATORRalf Tönjes, Chunming Zheng, Wenping Cui, Benjamin Lindner
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52664
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.21781

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Impact of heavy-tailed synaptic strength distributions on self-sustained activity in networks of spiking neurons. Ralf Tönjes, Chunming Zheng, Wenping Cui, Benjamin Lindner Abstract We analyze states of stationary activity in randomly coupled quadratic integrate-and-fire neurons using stochastic mean-field theory. Specifically, we consider the two cases of Gaussian random coupling and Cauchy random coupling, which are representative of systems with light- or with heavy-tailed synaptic strength distributions. For both, Gaussian and Cauchy coupling, bistability between a low activity and a high activity state of self-sustained firing is possible in excitable neurons. In the system with Cauchy coupling we find analytically a directed percolation threshold, i.e., above a critical value of the synaptic strength, activity percolates through the whole network starting from a few spiking units only. The existence of the directed percolation threshold is in agreement with previous numerical results in the literature for integrate-and-fire neurons with heavy-tailed synaptic strength distribution. However, we have found that the transition can be continuous or discontinuous, depending on the excitatory-inhibitory imbalance in the network. Networks with Gaussian coupling and networks with Cauchy coupling and additional additive noise lack the percolation transition in the thermodynamic limit. keywords spiking neural networks, asynchronous incoherent state, stochastic mean-field theory 1 Introduction Neural activity in living biological tissue is a highly complex, stochastic, non-equilibrium and non-linear process. However, due to the large number of constituents, i.e., the interacting spiking neurons, it is possible to use methods from statistical physics to describe such systems in terms of mean-field observables. In Brunel 2000 Brunel developed a standard model for homogeneous random networks of spiking neurons. The Brunel model became widely used to numerically reproduce and analytically predict different states of activity in biological neural networks, specifically the experimentally omnipresent asynchronous irregular state Renart et al. 2010 . In order to arrive at a feasible mathematical description, Brunel made several simplifying key assumptions, like independence of the different input signals to a neuron and, following from that and the central limit theorem, the Gaussian approximation for the summed inputs arriving at a specific neuron within the network. Convergence of the sum of independent inputs in mean and distribution to a Gaussian requires inputs of bounded variance. However, experimental data show that synaptic strengths in neural networks can be broadly distributed Barbour et al. 2007 ; Song et al. 2005 ; Buzsáki and Mizuseki 2014 with possible implications for neural information processing Teramae et al. 2012 . In this case, a Gaussian description is no longer accurate as the convergence of the input sum is poor in the tails of the distribution and a description in terms of a Gaussian mean-field theory becomes questionable. It has recently been suggested Kuśmierz et al. 2020 , that heavy-tailed synaptic weight distributions can change the neural dynamics and, in particular, support a continuous directed percolation transition with order parameter exponent \beta=1/2 at the critical point 1 1 1 The critical exponent \beta describes the leading order scaling of the order parameter close to the bifurcation point or phase transition. It is \beta=1 for transcritical bifurcations, \beta=1/2 for saddle-node and pitchfork bifurcations and \beta=1/3 at the cusp point of a cusp bifurcation. At a transcritical bifurcation two fixed points cross under finite slope and exchange stability, hence \beta=1 . . In marked contrast, such a continuous transition has not been observed in dense networks with light-tailed (e.g. Gaussian) distributions Kuśmierz et al. 2020 . Here, in order to deeper understand the impact of heavy-tailed synaptic distributions on the neural activity in recurrent networks of spiking neurons, we compare the mean firing rate in systems of randomly coupled quadratic integrate-and-fire (QIF) neurons with either Gaussian or with Cauchy random synaptic weights. Excitable neurons in random networks are known to exhibit self-sustained activity Renart et al. 2007 . A nonzero mean of the presynaptic input, impinging on the individual neurons, can shift the working point of excitable neurons into a regime of regular firing. Moreover, the many inputs arriving through the randomly weighted excitatory and inhibitory synaptic connections constitute a dynamic network noise which can also lead to a self-consistent random spiking of the driven neurons, even when the mean is zero. Stochastic mean-field theory aims at deriving equations for the self-consistent mean values and correlation statistics of the neural spike trains Lerchner et al. 2006 ; Dummer et al. 2014 ; Van Meegen and Lindner 2018 ; Pena et al. 2018 ; Vellmer and Lindner 2019 . Under certain conditions, in random networks a state of self-sustained high activity co-exists with a state of low activity. Either of these states can become unstable upon changes in a system parameter or under external stimulus, and the system may jump discontinuously to the respective other state. First-order, i.e.,discontinuous, phase transitions are of great interest in applications, because of hysteresis. That is, the system persists in the new state and does not directly revert to the original state when the external stimulus or the change of the system parameter is performed in the reverse order. In a second-order phase transition, which in Kuśmierz et al. 2020 was predicted for neural networks with heavy-tailed synaptic weights, the order parameter is continuous but has a discontinuous and possibly infinite derivative. Near such a phase transition low-dimensional mean-field theory is no longer an accurate description of the system, because fluctuations and their temporal correlations can become scale free, i.e., macroscopic. The role of criticality in generating complexity in biological neural networks has been suggested by statistical physicists Stassinopoulos and Bak 1995 ; Herz and Hopfield 1995 and has since also been studied experimentally Beggs and Plenz 2003 ; Petermann et al. 2009 ; Shew et al. 2015 . Bistability and more complicated collective dynamics, such as synchronized oscillations or irregular fluctuations of synchronized activity on slow time-scales have been found and analyzed in random networks of coupled integrate-and-fire neurons with light-tailed positive (excitatory) and negative (inhibitory) coupling Brunel 2000 ; Ostojic 2014 ; Wieland et al. 2015 ; Di Volo et al. 2022 . All-to-all coupling with independent, identically distributed random weights is an idealization of such random networks, which is often used in statistical, solid-state physics, e.g.,for spin models in disordered media Sherrington and Kirkpatrick 1975 ; Janzen et al. 2010 . Here we use this kind of coupling with independent random positive and negative weights as a model for unstructured networks of excitatory and inhibitory spiking neurons focusing on the non-equilibrium steady states of irregular asynchronous spiking. We explore the influence of the coupling statistics, excitatory-inhibitory balance and additional noise on these steady states in networks of excitable QIF neurons. Using the commonly applied white-noise approximation for the self-generated dynamic noise in the network, we can derive and solve self-consistent mean-field equations for the firing rate. For excitable QIF neurons with Cauchy random coupling, we confirm the existence of a direct percolation transition in the absence of external noise. However, a slight imbalance in favor of excitatory synapses provides a positive feedback, rendering the transition discontinuous, and inducing bistability as in the case of Gaussian random coupling. In networks with stronger inhibition bistability persists with Gaussian random synaptic weights whereas the percolation transition in the Cauchy case becomes continuous. Our paper is

Read the complete text