Mapping Connectomic Structure to Function(s) in Cerebellar-like Networks using Kernel Regression
William Dorrell, Peter Latham · 2026
Read Mapping Connectomic Structure to Function(s) in Cerebellar-like Networks using Kernel Regression by William Dorrell, Peter Latham (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-09320.txt.
Introduction
William Dorrell and Peter Latham ask how the wiring of brain like nets sets what they can learn. Such nets show in more than one brain zone, and in the smell path of bugs and the sense path of a fish. In all, a thin input fans out to a vast mid layer. A last layer then reads the fanned code to sort inputs.
They use a kernel slope tool to map wire form to learn skill. Kernel here means a fixed math view of how inputs match. If wire form sets that view, we can call what a net can learn from its wires. A reader in brain work gets a test case where that call may be made in full.
Catalog record
| CREATOR | William Dorrell, Peter Latham |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-09320
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Mapping Connectomic Structure to Function(s) in Cerebellar-like Networks using Kernel Regression William Dorrell, Peter Latham Abstract Cerebellar-like networks, in which input activity patterns are separated by projection to a much higher-dimensional space before classification, are a recurring neurobiological motif, present in the cerebellum, dentate gyrus, insect olfactory system, and electrosensory system of the electric fish. Their relatively well-understood design presents a promising test-case for probing principles of biological learning. The circuits’ expansive projections have long been modelled as random, enabling effective general purpose pattern separation. However, electron-microscopy studies have discovered interesting hints of structure in both the fly mushroom body and mouse cerebellum. Recent numerical work suggested that this non-random connectivity enables the circuit to prioritise learning of some, presumably natural, tasks over others. Here, rather than numerical results, we present a robust mathematical link between the observed connectivity patterns and the cerebellar circuit’s learning ability. In particular, we extend a simplified kernel regression model of the system and use recent machine learning theory results to relate connectivity to learning. We find that the reported structure in the projection weights shapes the network’s inductive bias in intuitive ways: functions are easier to learn if they depend on inputs that are oversampled, or on collections of neurons that tend to connect to the same hidden layer neurons. Our approach is analytically tractable and pleasingly simple, and we hope it continues to serve as a model for understanding the functional implications of other processing motifs in cerebellar-like networks. 1 Introduction The crystalline nature of cerebellar cortex has attracted theoretical work for over 50 years, since it was first posited to perform pattern separation ( 33 ; 2 ; 26 ; 27 ) . The basic processing involves a feed-forward passage of information from a small number of input mossy fibres, through an expansion to a vastly larger population of granule cells which activate sparsely, and themselves converge onto a small number of output purkinjie cells ( 20 ; 40 ) , fig. 1 B. Versions of this expand-sparsify-contract circuit motif have since been recognised in the dentate gyrus ( 12 ) , the mushroom body of the fly ( 35 ) , and the electrosensory organ of the electric fish ( 9 ) . The classic Marr-Albus-Ito model has understood these circuits via pattern separation: through the expansive and sparse mapping to the granule cell layer, potentially overlapping inputs patterns are separated, allowing supervised learning on the granule-to-purkinjie cell weights to produce the correct output for each input. To first order, this pattern separation machine is a good model; indeed, genetic perturbations that enrich or degrade the separability of inputs in the fly mushroom body directly improve or impair flies’ odour discrimination ( 1 ) . However, recent data have driven updates to this theory. For example, the finding that sometimes granule cell representations are not so sparse ( 5 ; 29 ) conflicts with existing pattern separation models, leading to theories that relate the sparsity level to the smoothness of the learnt input-output mapping ( 47 ) . A similar ongoing update comes from advances in the availability of connectomic data, information about which neurons are connected in both the fly mushroom body ( 49 ) and a section of mouse cerebellum ( 37 ) . Previous work assumed random connectivity between input and expansion layer ( 33 ; 32 ) , a choice that produces high-dimensional representations, perfect for pattern separation. The connectomic data, however, contains signs of weak structuring. Rather than connecting randomly to input neurons, expansion layer neurons connect preferentially to some inputs fig. 1 D, and the inputs appear to be grouped such that if an expansion neuron is connected to one input it is very likely to be connected to other inputs in the same group, fig. 1 E. In the mushroom body this connectivity structure arises independently of neural activity ( 24 ) , suggesting it is genetically hard-wired. We are then prompted to ask, why is the nervous system investing effort to establish this connectivity? What functional role does it play in the pattern separating circuit? Two recent modelling works have tackled exactly this question. 48 built models of the fly mushroom body with and without the observed structured connectivity motifs. Then they trained and tested each network on a battery of tasks, and found that the networks with the observed connectivity performed better at some tasks, and worse at others. In particular, over-connecting to some inputs allowed easy identification of single odours that activated that input, while input groupings made the network better at classifying odours that activated all input neurons within a group, tasks the fly presumably has to perform regularly. In previous work we instead meta-learned the input-output maps that the circuit found easy to learn with or without the observed connectomic patterns ( 17 ) . From this we derived similar conclusions without the need to pre-specify a battery of tasks for testing the network, instead allowing a search from the full space of tasks for those the network performs best at. In this work we present an alternative analytic route to understand the functional effect of structured connectivity that avoids the need for extensive simulations. We make use of an established correspondence between cerebellar-like circuits and an algorithm called kernel regression ( 22 ; 47 ) . Recent advances in machine learning theory have characterised the generalisation properties of kernel regression; i.e. how well the algorithm is able to capture input-output mappings from limited training examples ( 43 ; 11 ; 41 ) . We will apply these theoretical advances to a cerebellum-like model to understand the effect of different connectivity patterns on the generalisation properties of the network. In particular, using this link we assign a normative role to the structured connectivity through how it allows the circuit to learn some, presumably important, classifications quicker than if the connectivity had been random. Figure 1: A) Schematic of fly mushroom body circuit. Odorants trigger activity in olfactory receptor neurons (ORNs). ORNs contain a unique receptor protein, signalled by their colour; neurons with the same receptor protein send projections to a shared glormulus. There they synapse onto projection neurons, which carry the activity to the mushroom body. In the mushroom body the dimensionality of the representation is expanded by a factor of 50 in the kenyon cells (KCs), before being assigned a valence by mushroom body output neurons (MBONs). Dopaminergic neurons encode an error signal that modulates the KC-to-MBON connectivity to ensure correct classification. B) Simplified Network We use a model focusing only on the expansive projection and subsequent labelling which (C) has uncanny similarities with the kernel regression algorithm. We consider two structural motifs - (D) biased connectivity, in which some input neurons connect more than others; and (E) grouped connectivity, in which the inputs are grouped: if a hidden layer neuron is connected to one member of the group it is likely to be connected to others. We begin in section 2 by describing the structure of cerebellar-like circuits and how they relate to kernel regression. In section 3 we didactically outline theoretical results on kernel regression, and in section 4 we use these to analytically understand the