Geodesic Flow Matching for Denoising High-Dimensional Structured Representations

Karim Habashy, Chris Eliasmith · 2026

Read Geodesic Flow Matching for Denoising High-Dimensional Structured Representations by Karim Habashy, Chris Eliasmith (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-00248.txt.

Introduction

Habashy and Eliasmith clean high-width coded states by paths that hug their curved home. Such codes pack signs into vast spread traits for brain-like thought. For smooth traits, the code maps values onto a ring-shaped shell. Flat clean-up paths cut through the shell's core.

Those cuts wreck the phase and weight traits that decoding needs. Their fix, Geodesic Flow Matching, keeps the clean flow on the shell. It bends the drift math to the shell's own shape. Tests run in a spiking brain-like map tool. Path drift falls by near three parts in four. Brain cells are used with far more thrift as well. The code is free for others to test and build on.

Catalog record

CREATORKarim Habashy, Chris Eliasmith
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.00248

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Geodesic Flow Matching for Denoising High-Dimensional Structured Representations Karim Habashy, Chris Eliasmith Abstract Vector Symbolic Algebras (VSAs) enable robust neurosymbolic reasoning by encoding symbolic information into high-dimensional distributed representations. For continuous domains, Spatial Semantic Pointers (SSPs) extend this framework by mapping variables onto continuous toroidal manifolds. However, standard approaches like Flow Matching assume a flat Euclidean geometry, which fails to account for the geometric constraints imposed on valid SSP states. We demonstrate that this assumption fails for SSPs: Euclidean linear interpolants “cut through” the manifold’s interior, destroying the phase and magnitude structure required for accurate decoding. To resolve this, we employ Geodesic Flow Matching, adapting Riemannian transport dynamics to strictly restrict the denoising flow to the SSP toroidal manifold. We validate this approach in a Spiking Neural SLAM system, showing that manifold-aware cleanup stabilizes path integration against drift. The method achieves a 72% reduction in tracking error and enables a 40% increase in neural efficiency compared to competitive baselines. Code is available at https://github.com/kremHabashy/CleanupSSP . 1 Introduction Neurosymbolic AI aims to combine the robustness of neural networks with the structured compositionality of symbolic reasoning. Central to this approach are Vector Symbolic Algebras (VSAs), which encode symbolic information into high-dimensional distributed vectors. A critical requirement for robust operation of VSA-based systems is “cleanup”: the ability to map noisy, composed, or partial inputs back to valid, clean states. While this is well-explored for discrete symbols (e.g., via Hopfield networks ( 9 ; 21 ; 19 ) ), it remains an open challenge for continuous representations, where the “valid” states form a continuous manifold rather than a discrete set of attractors. Recent theoretical work suggests that generative denoising serves as a modern, continuous form of pattern completion. 8 highlight the intersection between diffusion models and associative memories, where denoising score matching parallels energy minimization in attractor networks. Unlike classical models that suffer from limited capacity, generative transport models demonstrate emergent generalization, reconstructing valid states even in unexplored regions of the manifold ( 17 ) . However, translating these generative capabilities to real-time neurosymbolic systems presents distinct challenges. While diffusion models are powerful, they rely on iterative stochastic sampling, requiring many function evaluations that are prohibitively slow for low-latency tasks in robotics (e.g. Simultaneous Localization and Mapping (SLAM)). Conditional Flow Matching (CFM) ( 13 ) solves this by regressing a deterministic velocity field (achieving comparable performance to diffusion with significantly fewer steps), but assumes a flat Euclidean geometry. Finally, recent work has successfully generalized this framework to Riemannian manifolds, enabling flow matching on general geometries ( 3 ) . However, these explorations have primarily focused on low-dimensional data and simple (gaussian) target distributions. Recently, Spatial Semantic Pointers (SSPs) have been proposed as a continuous extension of VSAs that encodes spatial variables into high-dimensional vectors ( d>1000 ). Prior methods do not work to clean up SSPs because these representations reside on a highly structured Clifford Hypertorus embedded within the unit hypersphere \mathbb{S}^{d-1} . We demonstrate that standard Euclidean Flow Matching fails in this regime because its linear interpolants “cut through” the interior of the hypersphere. This leads to a collapse of vector magnitude and the destruction of the precise phase relationships required to restore the SSP encoding a particular location. To resolve this, we employ Geodesic Flow Matching (GFM), adapting the framework to high-dimensional, toroidal neurosymbolic representations. By constraining transport to the Riemannian manifold using logarithmic and exponential maps, we ensure the cleanup process remains geometrically consistent. To demonstrate the methods in a challenging application, we have chosen a spiking neural network. Spiking networks provide useful efficiency gains when running on neuromorphic hardware, but introduce significant additional noise into neural representations that make robust behaviour challenging ( 16 ) . Spiking networks are thus a difficult test for robust cleanup of neural representation. We achieve a 72% reduction in path error and a 40% increase in neural efficiency compared to competitive baselines. The application, Semantic SLAM ( 6 ) , serves as a continuous neurosymbolic benchmark: the full pipeline relies on VSA binding and unbinding operations whose correctness depends directly on the geometric fidelity of the cleaned representations. Our work adapts flow matching to high-dimensional geodesics, providing a robust framework for hyperspherical embeddings (a geometry increasingly central to modern AI). This applies directly to architectures like Hyperspherical Prototype Networks ( 15 ) for unified classification and Hyperspherical Variational Autoencoders ( 4 ) for stable latent modeling. By ensuring transport remains geometrically consistent with the manifold, our approach enables high-capacity associative memory ( 20 ) in any system where semantics are encoded in vector direction rather than magnitude. 2 Related Works Continuous Cognitive Representations Vector Symbolic Architectures (VSAs) have recently evolved from a focus on discrete symbolic systems to robust frameworks for modeling continuous cognitive processes. Spatial Semantic Pointers (SSPs), in particular, have emerged as a leading method for encoding continuous variables into high-dimensional distributed representations ( 11 ) . It was later shown that leveraging hexagonal grid bases to mimic the firing rates of grid cells optimize the accuracy of these representations ( 5 ) . SSPs have also been used to model complex dynamical systems, allowing trajectory prediction of chaotic attractors ( 22 ) . This representational power has been applied to biological navigation ( 10 ) and SLAM ( 6 ) , as well as modeling compositional relations in hippocampal-entorhinal circuits ( 12 ) . In all of these cases, clean up (denoising), plays a crucial role in allowing robust performance of the networks. While this past work demonstrates the utility of SSPs, they predominantly rely on classical cleanup mechanisms (e.g., discrete grid lookup or convex optimization) to handle noise. These methods often struggle with scalability and fail at higher noise regimes. Generative denoising as Associative Memory To address the limitations of classical cleanup, we look to the intersection of associative memory and generative modeling. 8 and 17 have demonstrated that iterative generative denoising is theoretically equivalent to energy minimization in continuous attractor networks. This suggests that modern generative models can serve as the “dynamic cleanup” mechanism that VSAs have historically lacked. Indeed, recent workshops have explicitly called for bridging the gap between cognitive architectures and generative models ( 7 ) , identifying that VSAs provide the necessary compositional structure that black-box generative models lack. Geometric Constraints and Manifold Learning Applying off-the-shelf generative models to SSPs is ineffective due to geometric mismatch. As argued in the Geometric Deep Learning blueprint ( 2 ) , imposing Euclidean priors on non-Euclidean data (grids, groups, geodesics) leads to poor sample efficiency and broken symmetries. This issue is well-documented in robotics, where standard diffusion models fail to generate valid orientation trajectories because they violate the topology of the rotation group SO(3) ( 1 ) . To resolve this, we draw upon Riemannian Flow Matching, introduced by 3 . By defining probability paths via geodesics rather than linear interpolants, this framework allows for exact likelihood training on complex manifolds. While this approach has been successfully applied in domains such as robot motion planning ( 1 ) and protein folding ( 23 ) , it has not yet been exploited for high dimensional structured representations like those used in VSAs. Our work is the first to extend this

Read the complete text