Statistical physics of large-scale neural activity with loops
David P. Carcamo, Christopher W. Lynn · 2024
Read Statistical physics of large-scale neural activity with loops by David P. Carcamo, Christopher W. Lynn (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-18115.txt.
Introduction
David Carcamo and Christopher Lynn (2024) solve a statistical physics problem blocking the study of brain-wide activity: how to model neuron populations when the network contains loops. Recordings reach tens of thousands of neurons. Maximum entropy models, which find the simplest distribution matching measured correlations, work cleanly only on loop-free networks. Real brains are nothing but feedback loops. For a class of loopy networks, they derive an exact solution that scales to large systems.
The solution unlocks quantities out of reach at this size: the model's entropy, and how much information correlations carry about activity. The team can search for the correlation network that captures the most information. Applied to forty-five recordings of about ten thousand neurons in the mouse visual system, the framework fits the data better than loop-free methods. Loops were holding information the field could not count.
Catalog record
| CREATOR | David P. Carcamo, Christopher W. Lynn |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 85 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-18115
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Statistical physics of large-scale neural activity with loops David P. Carcamo, Christopher W. Lynn Abstract As experiments advance to record from tens of thousands of neurons, statistical physics provides a framework for understanding how collective activity emerges from networks of fine-scale correlations. While modeling these populations is tractable in loop-free networks, neural circuitry inherently contains feedback loops of connectivity. Here, for a class of networks with loops, we present an exact solution to the maximum entropy problem that scales to very large systems. This solution provides direct access to information-theoretic measures like the entropy of the model and the information contained in correlations, which are usually inaccessible at large scales. In turn, this allows us to search for the optimal network of correlations that contains the maximum information about population activity. Applying these methods to 45 recordings of approximately 10,000 neurons in the mouse visual system, we demonstrate that our framework captures more information—providing a better description of the population—than existing methods without loops. For a given population, our models perform even better during visual stimulation than spontaneous activity; however, the inferred interactions overlap significantly, suggesting an underlying neural circuitry that remains consistent across stimuli. Generally, we construct an optimized framework for studying the statistical physics of large neural populations, with future applications extending to other biological networks. Introduction Statistical physics provides a powerful framework for studying how collective neural activity emerges from the vast webs of correlations between neurons [ 1 , 2 , 3 , 4 , 5 , 6 ] . Inverting these methods, one can infer the statistical interactions that explain the correlations between neurons measured in experiments [ 7 , 8 ] . This approach has provided key insights into the simple local rules underlying patterns of neural activity and information processing [ 9 , 10 , 11 , 12 , 13 , 14 , 15 , 16 ] . Recently, advances in two-photon microscopy and electrophysiological recordings have produced experiments capturing the simultaneous activity of thousands to tens of thousands of neurons [ 17 , 18 , 19 , 20 , 21 , 22 , 23 ] . As experiments grow, the number of correlations explodes exponentially. This presents a fundamental challenge: How can we identify the optimal correlations that provide the best description of a system? Solving this problem is crucial for understanding the statistical structure of neural activity at the large scales accessible in modern experiments. Given a set of correlations, the maximum entropy principle defines the unique model that matches these correlations but contains no other sources of order [ 24 , 25 ] . This allows us to convert experimental measurements into predictive models, but it does not tell us which correlations we should include in our model to start with. Quite generally, the optimal set of correlations (that yields the best description of a system) is the network that produces the maximum entropy model with minimum entropy. This minimax entropy principle , which remains largely unexplored, provides the framework for identifying the most important network of correlations within a system [ 26 ] . By focusing on networks without loops, many statistical physics problems—including minimax entropy—become exactly solvable, opening the door for investigations of large populations [ 27 , 13 , 12 ] . However, this severely restricts the structure of correlations that we can study, and it is widely recognized that loops of connectivity between neurons play a crucial role in functional units within the brain [ 1 , 29 , 30 , 2 , 32 , 33 ] . Here, for a class of networks with loops, we develop a framework for identifying the most important correlations in large-scale experiments. First, by pushing exact methods to their mathematical limit, we solve the maximum entropy problem for a class of networks with loops. Second, using tools from network science, we introduce a greedy algorithm for uncovering the most important network of correlations, thus providing a locally optimal solution to the more general minimax entropy problem. We apply our framework to populations of approximately 10,000 neurons across 45 recordings of the visual system in different mice [ 19 ] . In every population, we identify networks of strong correlations that capture large amounts of information about system activity. These networks produce more accurate models than loop-free networks and are consistent across different visual stimuli. Together, these results indicate that small sets of strong correlations play a critical role in guiding neural activity, and that these strong correlations are underpinned by direct neural interactions. Generally, our framework provides the tools needed to investigate the statistical structure of large populations in rapidly growing experiments. Minimax Entropy Principle For a system of N neurons i=1,\ldots,N , experiments give us access to samples of collective activity \bm{x}=\{x_{i}\} (Fig. 1 A), where the state of each neuron naturally binarizes into active ( x_{i}=1 ) or silent ( x_{i}=0 ). The distribution over these states P(\bm{x}) contains all of the information about patterns of collective activity. But because the number of states grows exponentially with N , we cannot estimate P(\bm{x}) directly from data; instead, we can compute statistics like the average activities of the neurons \langle x_{i}\rangle_{\text{exp}} or the correlations between pairs of neurons \langle x_{i}x_{j}\rangle_{\text{exp}} (Fig. 1 A; see Materials and Methods). If we focus on a subset of the pairwise correlations, we define a network G with a node i for each neuron and and an edge (ij) for each correlation (Fig. 1 B). Given this network of statistics, the most unbiased description of the system is the maximum entropy model P_{G}(\bm{x})=\frac{1}{Z}\exp\Big(\sum_{i}h_{i}x_{i}+\sum_{(ij)\in G}J_{ij}x_{i}x_{j}\Big), (1) where Z is the normalizing partition function, and the parameters h_{i} and J_{ij} must be computed so the model matches the experimental averages \langle x_{i}\rangle_{\text{exp}} and correlations \langle x_{i}x_{j}\rangle_{\text{exp}} for (ij)\in G [ 24 , 25 ] . This model is mathematically equivalent to an Ising model from statistical mechanics with external fields h_{i} and interactions J_{ij} with network structure G (Fig. 1 B); this equivalence will become crucial as we extend Eq. [ 1 ] to large systems. Figure 1: Identifying optimal networks of correlations. (A) Illustration of activity time series data with N neurons and T samples. Each point represents an active neuron within one sample. From experimental data, we can compute statistics like average activities \langle x_{i}\rangle or pairwise correlations \langle x_{i}x_{j}\rangle (see Materials and Methods). (B) A set of pairwise correlations \langle x_{i}x_{j}\rangle defines a network G . The most unbiased model that matches these correlations and the averages \langle x_{i}\rangle is the maximum entropy model P_{G} , which is equivalent to an Ising model with external fields h_{i} and interactions J_{ij} . (C) Each set of correlations—that is, each network G —induces a maximum entropy S_{G} that lies between the entropy of independent neurons S_{\text{ind}} and the true entropy of the system S_{\text{sys}} (to which we do not have access). Among possible networks G , the optimal one induces the minimum entropy S_{G} . This optimal maximum entropy model P_{G} is the minimax entropy model. The maximum entropy principle provides the unique model that matches a set of experimental statistics and nothing else, but how should we select the most important statistics to