Representation learning in cerebellum-like structures
Lucas Rudelt, Fabian Mikulasch, Viola Priesemann, André Ferreira Castro 1 Max-Planck-Institute for Dynamics and Self-Organization, Göttingen, Germany 2 Friedrich Miescher Institute for Biomedical Research, Basel, Switzerland 3 Campus Institute for Dynamics of Biological Networks, Georg-August Univer · 2025
Read Representation learning in cerebellum-like structures by Lucas Rudelt, Fabian Mikulasch, Viola Priesemann, André Ferreira Castro 1 Max-Planck-Institute for Dynamics and Self-Organization, Göttingen, Germany 2 Friedrich Miescher Institute for Biomedical Research, Basel, Switzerland 3 Campus Institute for Dynamics of Biological Networks, Georg-August Univer (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-10261.txt.
Introduction
Lucas Rudelt, Fabian Mikulasch, Viola Priesemann, and André Ferreira Castro review representation learning inside cerebellum-like brain circuits, the vertebrate cerebellum and the insect mushroom body. Both structures expand sensory inputs into a much larger layer, improving pattern separation so animals can learn distinct associations quickly. Classical models treated that expansion layer as fixed wiring, with learning only at the output synapses.
New evidence instead shows plasticity inside that layer itself matters. Comparing granule layer and mushroom body calyx data, the authors find strikingly similar interneuron circuits, dendritic shapes, and change mechanisms, hinting at general principles. The overlap with recent theory is strong, though how stimulus-driven and reward-driven change interact there remains not well understood.
Catalog record
| CREATOR | Lucas Rudelt, Fabian Mikulasch, Viola Priesemann, André Ferreira Castro 1 Max-Planck-Institute for Dynamics and Self-Organization, Göttingen, Germany 2 Friedrich Miescher Institute for Biomedical Research, Basel, Switzerland 3 Campus Institute for Dynamics of Biological Networks, Georg-August Univer |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 65 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-10261
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Representation learning in cerebellum-like structures Lucas Rudelt, Fabian Mikulasch, Viola Priesemann, André Ferreira Castro 1 Max-Planck-Institute for Dynamics and Self-Organization, Göttingen, Germany 2 Friedrich Miescher Institute for Biomedical Research, Basel, Switzerland 3 Campus Institute for Dynamics of Biological Networks, Georg-August University, Göttingen, Germany 4 Bernstein Center for Computational Neuroscience (BCCN), Göttingen, Germany 5 School of Life Sciences, Technical University of Munich, Freising, Germany Abstract Animals use past experiences to adapt future behavior. To enable this rapid learning, vertebrates and invertebrates have evolved analogous neural structures like the vertebrate cerebellum or insect mushroom body. A defining feature of these circuits is a large expansion layer, which re-codes sensory inputs to improve pattern separation, a prerequisite to learn non-overlapping associations between relevant sensorimotor inputs and adaptive changes in behavior. However, classical models of associative learning treat expansion layers as static, assuming that associations are learned through plasticity at the output synapses. Here, we review emerging evidence that also highlights the importance of plasticity within the expansion layer for associative learning. Because the underlying plasticity mechanisms and principles of this representation learning are only emerging, we systematically compare experimental data from two well-studied circuits for expansion coding—the cerebellum granule layer and the mushroom body calyx. The data indicate remarkably similar interneuron circuits, dendritic morphology and plasticity mechanisms between both systems that hint at more general principles for representation learning. Moreover, the data show strong overlap with recent theoretical advances that consider interneuron circuits and dendritic computations for representation learning. However, they also hint at an interesting interaction of stimulus-induced, non-associative and reinforced, associative mechanisms of plasticity that is not well understood in current theories of representation learning. Therefore, studying expansion layer plasticity will be important to elucidate the mechanisms and full potential of representation learning for behavioral adaptation. A circuit for rapid learning of adaptive behavior A central role of the brain is to adapt behavior based on relevant sensorimotor information. Some predictive cues, such as circadian rhythms, sexual pheromones, or ecological signals, are stable enough across evolution to be genetically hardwired [ 5 , 14 , 12 ] . However, for exploratory species and complex behaviors, the relevance of sensory information is dynamic and context-dependent, requiring flexible, experience-dependent learning mechanisms [ 61 , 73 , 13 , 136 ] . Across diverse taxa, animals need to associate sensory stimuli with biologically meaningful outcomes—such as an electric shock or a motor error signal—often after a single trial [ 59 , 58 , 2 ] . Understanding how neural circuits support this rapid associative learning remains a central question in neuroscience. Despite large differences in brain architecture, many distantly related taxa have converged on a common circuit motif for rapid associative learning. These so called cerebellum-like structures —including the cerebellum itself and the insect mushroom body ( MB ), among others—transform sensory inputs through feedforward expansion layers, where relatively few input fibers are recoded into large populations of principal neurons [ 42 , 25 , 138 , 10 , 43 , 34 , 102 ] (Figure 1 ). Classical theories, from Marr and Albus [ 120 , 94 , 4 ] to adaptive filtering frameworks [ 67 , 50 , 29 , 130 ] , emphasized that such expansion enhances pattern separation [ 42 , 25 , 138 , 10 , 82 , 24 , 25 ] and supports associative learning by enabling downstream synapses to link stimuli with behavioral relevance signals [ 42 , 105 , 16 , 8 ] . In this view, expansion layers were treated as static recoding devices, while plasticity was confined to output synapses where climbing fibers or dopaminergic neurons guide learning [ 66 , 65 , 71 , 115 , 27 ] . More recent work has gone further by demonstrating that the expansion layers themselves undergo experience-dependent plasticity, with expansion layer responses adapting across multiple timescales [ 60 , 37 , 72 , 53 , 38 , 106 , 11 ] . These findings point to a new perspective in which expansion layers are not fixed encoders but dynamically adapt to their inputs. What remains unclear, however, are the functional principles by which such plasticity shapes input representations to support associative learning and adaptive behavior. To address these questions, this review focuses on the cerebellum and the insect MB—two systems that provide uniquely tractable models for dissecting the mechanisms of representations learning in expansion layers. Both systems separate input representations from output stages, enabling precise analysis of how representations are formed and used downstream to adapt behavior [ 43 , 102 ] . Furthermore, their structural simplicity, well-characterized computational function, and accessibility to both genetic and physiological interrogation make them ideal substrates for uncovering principles of learning across brains. We highlight how cellular features such as dendritic integration and inhibitory feedback provide the substrate for efficient learning, synthesize evidence for plasticity within these layers, and relate it to theories of representation learning and predictive coding. Moreover, by relating plasticity to behavioral experiments and modeling studies, we identify common functional principles of representation learning in expansion layers. Finally, we conclude with open questions and experimental predictions that connect cellular mechanisms to learning theory. Fig 1: Analogous circuit motifs and dendritic morphology in cerebellum-like structures. (A) Cerebellum circuit as shown in [ 25 ] . In the cerebellum, mossy fibers convey inputs to granule cells in the granular layer. These cells generate a high-dimensional input representation, shaped by feedforward and feedback inhibition by Golgi cells. Outputs from the granular layer converge onto Purkinje cells that modulate behavior and adapt motor control. (B) In the mushroom body, these functions are implemented by projection neurons (input layer), Kenyon cells in the calyx (expansion layer), the APL in Drosophila (inhibitory interneuron), and mushroom body output neurons in the lobes. Circuit shown as in [ 25 ] . (C) Both systems thus implement an analogous circuit motif where inputs are re-coded in a divergent expansion layer of a much higher number of principal neurons, whose outputs again converge onto a much smaller number of output neurons. Here, climbing fibers in the cerebellum and neuromodulatory inputs in the mushroom body convey reinforcement signals to drive associative learning. In addition, climbing fibers and neuromodulatory inputs can directly or indirectly affect responses and plasticity of principal or inhibitory neurons in the expansion layer, thus potentially enabling representation learning [ 77 , 15 , 114 , 21 ] . (D) Input synapses and principal dendrites in both systems form microglumeruli, where dendritic elaborations from many principal cells enwrap a single synaptic bouton. Microglumeruli are additionally innervated by inhibitory axons as well as neuromodulatory inputs, thus providing a structural unit for efficient synaptic transmission, localized computation and plasticity (main text). Analogous architecture and synapto-dendritic organization To support adaptive learning and flexible behavior, both the cerebellum and the mushroom body (MB) implement an analogous circuit motif: an expansion coding architecture that transforms lower-dimensional input into sparse, high-dimensional representations [ 4 , 94 , 64 , 82 ] . In both systems, this is achieved by a massive increase in the number of principal neurons at the input stage—granule cells ( GrCs ) in the cerebellum and Kenyon cells ( KCs ) in the MB—each receiving input from a