Space as Time Through Neuron Position Learning
Balázs Mészáros, James C. Knight, Danyal Akarca, Thomas Nowotny · 2025
Read Space as Time Through Neuron Position Learning by Balázs Mészáros, James C. Knight, Danyal Akarca, Thomas Nowotny (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-01632.txt.
Introduction
Balázs Mészáros, James Knight, Danyal Akarca, and Thomas Nowotny give artificial neurons something real brains have: a position in space. In biology, the distance between neurons sets how long signals take to arrive, coupling space and time. Most artificial networks ignore this; the authors build a spiking network where each synapse's delay is simply the distance between its neurons.
They derive how to adjust neuron positions by gradient descent during learning. Trained on temporal classification tasks, the networks spontaneously organized into local, clustered layouts, and when wiring cost depended on distance, a modular, efficiently wired structure emerged. Functional specialization lined up with the spatial clusters without being imposed, suggesting the space-time coupling itself is a useful inductive bias and a route to more interpretable, efficient hardware.
Catalog record
| CREATOR | Balázs Mészáros, James C. Knight, Danyal Akarca, Thomas Nowotny |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-01632
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Space as Time Through Neuron Position Learning Balázs Mészáros, James C. Knight, Danyal Akarca, Thomas Nowotny Abstract Biological neural networks exist in physical space where distance determines communication delays: a fundamental space-time coupling absent in most artificial neural networks. While recent work has separately explored spatial embeddings and learnable synaptic delays in spiking neural networks, we unify these approaches through a novel neuron position learning algorithm where delays relate to the Euclidean distances between neurons. We derive gradients with respect to neuron positions and demonstrate that this biologically-motivated constraint acts as an inductive bias: networks trained on temporal classification tasks spontaneously self-organize into local, small-world topologies with modular structure emerging under distance-dependent connection costs. Remarkably, we observe unprompted functional specialization aligned with spatial clustering without explictly enforcing it. These findings lay the groundwork for networks in which space and time are intrinsically coupled, offering new avenues for mechanistic interpretability, biologically inspired modelling, and efficient implementations. 1 Introduction Brain networks face fundamental trade-offs between metabolic costs and information processing capabilities. Networks must minimise the costs of building and maintaining connections in physical space while optimising for computational capability. This constraint shapes brain organisation across species and may explain why brains converge on similar structural solutions ( Achterberg et al. 2023 ) , including sparse, small-world ( Van den Heuvel et al. 2016 ) architectures and modular ( Kaiser & Hilgetag 2004 ) organisation. To analyse the role of space, recent studies have started focusing on the spatial embedding of biological neural networks ( Achterberg et al. 2023 ; Erb et al. 2025 ; Sheeran et al. 2024 ; Vasilache et al. 2025 ) – a critical dimension largely overlooked in computational models. However, these studies do not investigate the relationship between this spatial embedding and time – despite the spatial locations of neurons and their relative timing of information processing being naturally intertwined in the brain. Biological neural networks exist in physical space, where distance translates directly into time through conduction delays—a ‘space as time’ relationship ( Voges & Perrinet 2010 ; Izhikevich & Hoppensteadt 2009 ) that is fundamental to brain organisation. The cost of connections is proportional to their length in three-dimensional space, and conduction delays vary dramatically across the nervous system due to differences in path length, diameter, and can even be optimised through myelin plasticity ( Bonetto et al. 2021 ) , i.e the brain could implement something akin to delay learning. One of the first algorithms that employed a form of delay learning used multapses with various delays between neuron pairs and a corresponding trainable weight ( Bohte et al. 2002 ) . Since the delays could not be explicitly optimised, this algorithm could be understood more as a form of structure learning where delays are fixed and the optimal values are found through optimising the connectivity weights. The relationship between network structure and delays is still of interest, as Hammouamri et al. highlighted the benefits of delay learning in sparse networks, and Mészáros et al. 2024 observed that structural plasticity in networks with delays leads to better performance than explicit delay learning. Regardless, recent methods focus on gradient-based approaches ( Hammouamri et al. ; Göltz et al. 2024 ; Sun et al. 2023 ) , with Mészáros et al. 2024 introducing delay learning for recurrent connections. The intertwinement of space and time creates natural constraints on both the structure and the dynamics of neural networks. Spatial clustering minimises costly long-range connections while creating fast communication within local regions and slower communication between distant areas. Thus, spatial organisation inherently generates temporal separation, where different brain regions operate on different timescales determined by their connectivity patterns, yielding hierarchically organised areas with increased temporal receptive windows ( Chang et al. 2022 ) . Evolution has exploited this relationship, as exemplified by the barn owl’s sound localisation system, which relies on precisely tuned delays arising from spatial circuit organisation ( Carr & Konishi 1988 ; Ghosh et al. 2025 ) . These observations have not yet been modelled as, in most cases, neural networks discard spatial and temporal information. Even Spiking Neural Networks (SNNs) typically only adapt weights and biases – failing to exploit the spatial embedding and delay structure that biological systems have optimized over evolution. Achterberg et al. 2023 proposed an approach for studying spatial structure in ANNs – giving us a way to connect them to temporal processing. However, their models only saw the cost of the connections, rather than the benefit of their structure. Erb et al. 2025 and Vasilache et al. 2025 explored position learning through distance-based synaptic weights, but disregarded the temporal aspects of space. Now the foundations for both spatial aspects (through spatially embedding neurons) and the temporal aspects (through delay learning) have been laid, a natural next step is combining these into a single framework. Here, we do just that and derive a gradient-based learning algorithm for SNNs, where synaptic delays are determined by the Euclidean distance between two connected neurons. Furthermore, we derive the gradients of loss functions with respect to the positions of neurons, introducing a neural network shape learning algorithm. We study the various effects of the algorithm through training recurrent SNNs on the Spiking Heidelberg Digits (SHD) ( Cramer et al. 2020 ) classification task. We find that position learning networks rely more on local computations and form circuits associated with particular ‘tasks’ after training. Not only do our findings have implications for our understanding of the brain but also, suggest new ways of studying neural networks and potential directions for future neuromorphic implementations. 2 Results 2.1 Position learning links structure to task We first introduce a novel neuron position learning algorithm, in which neurons move in space so as to minimise the objective function. This makes use of the fact that delays between neurons can augment performance. Intuitively, a neuron with a great spatial separation should therefore correspond to a longer delay. Recently, various delay learning algorithms have been derived, and shown to be an effective way of improving the performance of SNNs ( Hammouamri et al. ; Sun et al. 2023 ; Göltz et al. 2024 ; Mészáros et al. 2025 ) . Mészáros et al. 2025 was the first to introduce delay learning for recurrent connections. Spatial embeddings become particularly interesting with bidirectional connectivities, thus we derived our equations in a recurrent framework. In a 2-dimensional space, we define the delay between neuron j and i as: d_{ji}=\sqrt{(x_{i}-x_{j})^{2}+(y_{i}-y_{j})^{2}}, (1) where (x_{i},y_{i}) and (x_{j},y_{j}) denote the positions of neurons i and j in a 2-dimensional space. Thus, the spike arrival time at neuron m becomes: t_{lm}\equiv t_{l}+d_{mn(l)}=\\ t_{l}+\sqrt{(x_{m}-x_{n(l)})^{2}+(y_{m}-y_{n(l)})^{2}}, (2) where n(l) is the neuron, that fired the l -th spike, at time t_{l} . Similarly to the original algorithm ( Wunderlich & Pehle 2021 ) and its extensions ( Mészáros et al. 2025 ) , we also work with Leaky Integrate-and-Fire (LIF) neurons, where each neuron has an input current I , and a membrane voltage V . The gradient of the loss \cal L with respect to the coordinate x of neuron i can be derived from the gradient with respect to the delay, using the chain rule: \displaystyle\frac{d\mathcal{L}}{dx_{i}}=\sum_{j}\left(\frac{d\mathcal{L}}{dd_{ji}}\frac{dd_{ji}}{dx_{i}}+\frac{d\mathcal{L}}{dd_{ij}}\frac{dd_{ij}}{dx_{i}}\right) (3) From ( Mészáros et