Efficient, simulation-free estimators of firing rates with Markovian surrogates
Zhongyi Wang, Louis Tao, Zhuo-Cheng Xiao · 2025
Read Efficient, simulation-free estimators of firing rates with Markovian surrogates by Zhongyi Wang, Louis Tao, Zhuo-Cheng Xiao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-08254.txt.
Introduction
Zhongyi Wang and two co-authors build in 2025 finite-state stand-ins for spiking neuron populations, so long-run firing rates can be read off without simulating every spike. Networks of such neurons link cell mechanics to collective rhythm, but brute simulation is slow. Their surrogate tracks how a population spreads across a finite set of single-neuron states.
Firing rate becomes the flow of probability through spike transitions. Two closures are compared: one freezes the average synaptic drive, the other lets it evolve. The evolving version tracks rate changes driven by synaptic timing with small errors across several neuron models, from leaky integrate-and-fire to Hodgkin-Huxley variants. Fast, faithful surrogates open large network questions to quick study.
Catalog record
| CREATOR | Zhongyi Wang, Louis Tao, Zhuo-Cheng Xiao |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 27 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-08254
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Efficient, simulation-free estimators of firing rates with Markovian surrogates Preprint: APS/123-QED Zhongyi Wang, Louis Tao, Zhuo-Cheng Xiao Abstract Spiking neural networks (SNNs) are powerful mathematical models that integrate the biological details of neural systems, but their complexity often makes them computationally expensive and analytically untractable. The firing rate of an SNN is a crucial first-order statistic to characterize network activity. However, estimating firing rates analytically from even simplified SNN models is challenging due to 1) the intricate dependence between the nonlinear network dynamics and parameters and 2) the singularity and irreversibility of spikes. In this Letter, we propose a class of computationally efficient, simulation-free estimators of firing rates. This is based on a hierarchy of Markovian approximations that reduces the complexity of SNN dynamics. We show that while considering firing rates alone is insufficient for accurate estimations of themselves, the information of spiking synchrony dramatically improves the estimator’s accuracy. This approach provides a practical tool for brain modelers, directly mapping biological parameters to firing rate. I Introduction Spiking neural networks (SNNs) provide a powerful framework for modeling neural dynamics and are widely used in computational neuroscience Wang 2002 ; Izhikevich and Edelman 2008 ; Eliasmith et al. 2012 ; Potjans and Diesmann 2014 ; Markram et al. 2015 ; Bezaire et al. 2016 ; Chariker et al. 2016 ; Schmidt et al. 2018 ; Billeh et al. 2020 ; Siegle et al. 2021 ; Zenke and Vogels 2021 ; Chariker et al. 2022 . A key challenge in studying SNNs is extracting meaningful dynamical features that reveal how physiological mechanisms give rise to emergent brain functions Woodman and Jirsa 2013 ; Izhikevich 2004 ; Zenke et al. 2015 . However, both analytical approaches and direct simulations face significant obstacles. The discrete, high-dimensional nature of SNNs makes mathematical analysis intractable, while large-scale simulations become computationally prohibitive as network size increases Gast et al. 2021 ; Schmitt et al. 2023 ; Stimberg et al. 2020 ; Kulkani et al. 2021 . In practice, both theoretical and experimental neuroscientists are often primarily interested in long-term statistical properties of SNN dynamics, such as neuronal firing rates, which serve as fundamental indicators of neural activity Mizuseki and Buzsáki 2013 ; Kass et al. 2023 ; Dayan and Abbott 2001 ; Wilson and Cowan 1972 . Thus, there is a pressing need for efficient analytical methods that can approximate these steady-state statistics without resorting to extensive simulations. In this Letter, we introduce a Markovian approximation that systematically maps SNN dynamics onto state transitions while preserving essential statistical properties. By treating neuron states as discrete random variables, our approach allows for the derivation of a hierarchy of analytically tractable approximations, enabling direct computation of long-term dynamic statistics via the invariant measure of the reduced model. We propose two simulation-free estimators of firing rates. The first estimator prioritizes computational efficiency but does not account for temporal synchrony, while the second explicitly captures the temporal correlations of synaptic inputs, leading to greater predictive accuracy in networks with varying degrees of synchronicity. To our knowledge, the second estimator is the first simulation-free computational tool for finite-size SNNs that is not constrained by specific parameter choices or dynamic regimes Rangan and Cai 2006 ; Buice and Chow 2013 . Compared to previous theoretical approaches, such as mean-field theories and Fokker-Planck equations, our method reduces estimation errors by magnitudes. This is done by incorporating higher-order statistical features–specifically, the degree of spiking synchrony reflected in synaptic inputs–demonstrating the importance of synchrony in shaping network dynamics. II Leaky integrate-and-fire networks In this Letter, we demonstrate an efficient firing-rate estimator for leaky integrate-and-fire (LIF) networks. LIF networks are widely used in computational neuroscience to model brain circuits Wang 2002 ; Izhikevich and Edelman 2008 ; Eliasmith et al. 2012 ; Potjans and Diesmann 2014 ; Zenke et al. 2015 ; Markram et al. 2015 ; Bezaire et al. 2016 ; Chariker et al. 2016 ; Ramirez-Villegas et al. 2018 ; Schmidt et al. 2018 ; Billeh et al. 2020 ; Siegle et al. 2021 ; Zenke and Vogels 2021 ; Chariker et al. 2022 . Here, we focus on a network of N -neuron LIF networks consisting of two neuronal populations: N^{E} excitatory (E) and N^{I} inhibitory (I) cells ( N=N^{E}+N^{I} ). This setup is commonly used to study the dynamics of local brain circuits Gerstner et al. 2014 ; Koch 1999 ; McLaughlin et al. 2000 ; Dale 1935 ; Kandel et al. 2000 . Consider a LIF neuron i of type X\in\{E,I\} , the dynamics of its membrane potential V_{i}(t) are governed by \frac{dV_{i}}{dt}=g^{X,\text{leak}}(V^{\text{rest}}-V_{i})+g_{i}^{E}\cdot(V^{E}-V_{i})+g_{i}^{I}\cdot(V^{I}-V_{i})+I_{i}^{\text{ext}}, (1) where g^{X,\text{leak}} represents the leakage conductance, V^{\text{rest}} is the resting potential, V^{E} and V^{I} are the reversal potentials for excitatory and inhibitory currents, respectively. When V_{i} reaches a threshold potential V^{X,\text{th}} , the neuron i instantly releases a type- X spike which is sent to its post-synaptic neurons, then V_{i} enters a refractory state \mathcal{R} for a period of \tau^{\text{ref}} before reset to V^{\text{rest}} . During the refractory period, the neuron remains unresponsive to incoming stimuli. The synaptic conductances (g_{i}^{E},g_{i}^{I}) and the external input current I_{i}^{\text{ext}} are given by \displaystyle g_{i}^{Y}(t) \displaystyle= \displaystyle\sum_{j\in Y,j\neq i}S_{ij}\sum_{\mu_{j}^{Y}}G^{Y}(t-t_{\mu_{j}^{Y}}),\quad Y=E,I, (2) \displaystyle I_{i}^{\text{ext}}(t) \displaystyle= \displaystyle S_{i}^{\text{ext}}\sum_{\mu_{i}^{\text{ext}}}G^{\text{ext}}(t-t_{\mu_{i}^{\text{ext}}}), (3) Here, S_{ij} stands for the synaptic coupling strength from neuron j to i , and S_{i}^{\text{ext}} denotes the input synaptic coupling strength to neuron i ; t_{\mu_{j}^{Y}} are the spiking times of neuron j , and t_{\mu_{i}^{\text{ext}}} are spiking times of the input; G^{X}(t),X\in\{\text{ext},E,I\} is the synaptic kernel for type- X neurons or the input synaptic kernel, given by G^{X}(t)=\frac{1}{\tau^{X}}\exp\left(-\frac{t}{\tau^{X}}\right)\cdot H(t), where \tau^{X} is the timescale of type- X synaptic dynamics, and H(t) is the Heaviside function. We note that, a fundamental source of complexity in spiking neural network (SNN) dynamics is the singular impact of spikes on postsynaptic neurons, combined with the irreversible nature of the spike-generation process in presynaptic neurons. This fire-refractory-reset mechanism is a defining feature of most SNN models and is essential for capturing the physiological details of spiking communication in the brain. III A Markovian approximation Our previous study introduced a Markovian approximation of the LIF network and a subsequent coarse-grained reduction. This section provides a concise review of that framework and outlines two computationally efficient firing-rate estimators derived from it. To treat the membrane potential V_{i}(t) as a Markov chain, we discretize the interval (V^{I},V^{X,\text{th}})\cup{\mathcal{R}} appropriately and determine the discrete analogs of each term in Eq. ( 1 ). The discretized membrane potential of a type- X neuron i takes values in the state space \Gamma:=\{-m^{I},-m^{I}+1,\cdots,-1,0,1,\cdots,m^{X,\text{th}}-1\}\cup\{\mathcal{R}\}, where -m^{I} and m^{X,\text{th}} correspond to V^{I} and V^{X,\text{th}} , respectively. A state m\in\Gamma corresponds to potentials V_{i}\in[ma,(m+1)a) , where the voltage bin size is a=\frac{V^{X,\text{th}}-V^{I}}{m^{X,\text{th}}+m^{I}} . To handle the singular nature of synaptic inputs as presynaptic spikes, whose temporal effects are modeled by the synaptic kernel G^{X}(t) , we introduce discrete variables H^{Y}_{i}\in\mathbb{N} , Y\in{\text{ext},E,I} , replacing the continuous conductances g_{i}^{Y} in Eq. ( 1 ). These variables, termed ”pending kick pools,” accumulate discrete synaptic kicks whenever neuron i receives presynaptic spikes. Each pending kick induces a state transition and is removed after an exponentially distributed waiting time \tau\sim\text{Exp}(\tau^{Y}) , making H_{i}^{Y} a birth-death process. Thus, the network’s dynamic state is initially