HyperSpace: A Generalized Framework for Spatial Encoding in Hyperdimensional Representations

Shay Snyder, Andrew Capodieci, David Gorsich, Maryam Parsa · 2026

Read HyperSpace: A Generalized Framework for Spatial Encoding in Hyperdimensional Representations by Shay Snyder, Andrew Capodieci, David Gorsich, Maryam Parsa (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-15113.txt.

Introduction

Snyder and colleagues present HyperSpace, a modular framework for spatial coding in hyperdimensional vector systems. It splits vector symbolic architectures into plug-in operators. Encoding, binding, and bundling join similarity, cleanup, and regression as separate modules. Tests on two backends show similarity and cleanup dominate run time in spatial tasks, leaving the two systems roughly even end to end. Memory use differs, though, with HRR needing about half the memory of FHRR vectors.

Catalog record

CREATORShay Snyder, Andrew Capodieci, David Gorsich, Maryam Parsa
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37154
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.15113

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

HyperSpace: A Generalized Framework for Spatial Encoding in Hyperdimensional Representations Shay Snyder, Andrew Capodieci, David Gorsich, Maryam Parsa Abstract . Vector Symbolic Architectures (VSAs) provide a well-defined algebraic framework for compositional representations in hyperdimensional spaces. However, evaluating their behavior on continuous spatial domains remains challenging due to the diversity of backends and the absence of a unified software framework for systematic evaluation. We introduce HyperSpace , an open-source framework that decomposes VSA systems into modular operators for encoding, binding, bundling, similarity, cleanup, and regression. Using HyperSpace, we analyze and benchmark two representative VSA backends: Holographic Reduced Representations (HRR) and Fourier Holographic Reduced Representations (FHRR). Although FHRR provides lower theoretical complexity for individual operations, HyperSpace’s modularity reveals that similarity and cleanup dominate runtime in spatial domains. As a result, HRR and FHRR exhibit comparable end-to-end performance. Differences in memory footprint introduce additional deployment trade-offs where HRR requires approximately half the memory of FHRR vectors. By enabling modular, system-level evaluation, HyperSpace reveals practical trade-offs in VSA pipelines that are not apparent from theoretical or operator-level comparisons alone. 1. Introduction Vector Symbolic Architectures (VSAs), also commonly known as hyperdimensional computing, provide an algebraic framework for representing and manipulating structured information with high-dimensional distributed vectors ( 9 ; 10 ) . Rather than relying on learned latent spaces, VSAs construct compositional representations through operations such as binding, bundling, inversion, and similarity ( 10 ; 17 ) . These operations support associative recall and symbolic composition within a unified mathematical framework ( 8 ; 16 ) . † † DISTRIBUTION STATEMENT A. Approved for public release; distribution is unlimited. OPSEC #10534. Recent work has shown that VSAs support a broad range of capabilities, including generative modeling, probabilistic inference, graph learning, and associative memory ( 5 ; 14 ; 3 ) . VSAs have also shown growing promise for spatial reasoning problems, where continuous coordinates, maps, and value functions must be represented with compositional memory operations ( 11 ; 2 ; 4 ) . This capability is relevant for robotics and autonomous systems, where spatial representations support mapping, navigation, path planning, and continuous decision-making over structured environments ( 21 ; 22 ; 19 ; 20 ) . However, evaluating VSA systems on continuous spatial domains remains difficult. Existing spatial VSA implementations are often developed in task-specific settings, making it hard to separate the effects of the underlying backend from the effects of encoding strategy, cleanup dynamics, decoder design, or evaluation protocol ( 6 ; 1 ; 20 ; 21 ) . This limitation becomes especially important in dense pipelines, where end-to-end performance depends not only on the theoretical cost of individual operators, but also on how those operators interact across encoding, storage, inversion, cleanup, and regression. As a result, isolated operator-level comparisons can fail to predict runtime, memory usage, and reconstruction behavior in full spatial workflows. To address this gap, we introduce HyperSpace 1 1 1 Publically available at https://github.com/Parsa-Research-Laboratory/HyperSpace , an open-source framework for constructing and evaluating VSA pipelines with continuous spatial representations. Rather than committing to a single backend, HyperSpace decomposes spatial processing into a shared set of abstract modules for positional encoding, value encoding, memory storage, positional inversion, cleanup, and regression. This abstraction enables heterogeneous VSA backends to be instantiated within the same end-to-end pipeline and compared under controlled conditions. As a result, HyperSpace serves both as an implementation framework and as a methodological tool for identifying computational, memory, and representational trade-offs that are not apparent when evaluating isolated operators. Using HyperSpace, we analyze two representative VSA backends: Holographic Reduced Representations (HRR) and Fourier Holographic Reduced Representations (FHRR) ( 17 ; 16 ) . Although FHRR offers lower theoretical complexity for individual operations, our system-level analysis shows that these savings do not necessarily translate into lower end-to-end cost in spatial domains. Instead, similarity-based cleanup and regression dominate runtime across many configurations, yielding comparable overall latency between HRR and FHRR. At the same time, differences in vector representations create deployment-dependent memory trade-offs, with floating point HRR requiring approximately half the storage of complex FHRR vectors. These results demonstrate why backend selection in spatial VSA systems should be treated as a pipeline-level design decision rather than a comparison of isolated operators. The contributions of this work are summarized as follows: • We introduce HyperSpace, an open-source framework for constructing and evaluating continuous spatial VSA pipelines through shared abstract operators. • We formalize spatial VSA processing as a sequence of modules, enabling controlled comparisons across heterogeneous backends, cleanup mechanisms, and regression methods. • We instantiate HyperSpace with representative HRR- and FHRR-based backends and analyze their computational and memory complexity across the full pipeline. • We identify deployment-dependent trade-offs between HRR and FHRR, showing that backend selection depends jointly on runtime, memory footprint, and decoder configuration. 2. Background & Previous Works VSAs represent information using high-dimensional vectors and distributed algebraic operations ( 9 ) . Fundamental VSA operations include binding, bundling, similarity, and inversion ( 10 ) . Binding combines vectors into compositional representations, bundling superposes multiple items into a shared memory, similarity supports associative retrieval, and inversion enables partial recovery of bound vectors. Together, these operations provide an algebraic framework for representing information within distributed vectors. Multiple VSA backends have been proposed, including Holographic Reduced Representations (HRR) ( 17 ) , Fourier Holographic Reduced Representations (FHRR) ( 16 ) . These backends differ in their algebraic formulations, numerical representations, and implementation costs, but they expose closely related operations for encoding, storage, and retrieval ( 10 ) . As a result, many VSA systems can be described at the level of shared abstract operations, even when their concrete implementations differ substantially. VSA-based Spatial Representations: VSAs have increasingly been used to represent spatial structure in robotics, navigation, and cognitive modeling ( 2 ; 21 ; 20 ; 11 ) . In particular, spatial representations such as Spatial Semantic Pointers ( 11 ; 2 ) and fractional power codes ( 4 ; 20 ) encode continuous coordinates into high-dimensional vectors that preserve geometric relationships while remaining compatible with existing VSA operators. This makes VSAs attractive for tasks such as spatial memory, path planning, and continuous value representations ( 4 ; 20 ; 11 ; 2 ; 21 ) . However, spatial VSA systems are typically evaluated within task-specific implementations, making it difficult to separate backend properties from choices in encoding strategy, cleanup dynamics, decoder design, or evaluation protocol. This challenge is particularly important in continuous spatial domains, where end-to-end performance depends not only on the cost of individual VSA operators, but also on how those operators interact across encoding, storage, cleanup, and decoding. VSA Evaluation Frameworks: Existing software libraries such as TorchHD ( 6 ) and Nengo-SPA ( 1 ) provide the infrastructure for constructing and experimenting with VSA backends. However, these libraries primarily emphasize representation building and model development rather than controlled, system-level comparisons of heterogeneous VSA backends operating on a common workflow. Consequently, prior works compare individual operators on isolated downstream tasks, making it difficult to determine which trade-offs arise from the backend or the surrounding pipeline ( 3 ; 11 ; 2 ) . To address this gap, we introduce HyperSpace , a modular framework for analyzing spatial VSA systems through a shared set of abstract

Read the complete text