Vector Symbolic Algebras for the Abstraction and Reasoning Corpus

Isaac Joffe, Chris Eliasmith · 2025

Read Vector Symbolic Algebras for the Abstraction and Reasoning Corpus by Isaac Joffe, Chris Eliasmith (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-08747.txt.

Introduction

Isaac Joffe and Chris Eliasmith build a solver for the Abstraction and Reasoning Corpus, a set of visual puzzles that humans find easy and AI systems find brutally hard. Their design is deliberately modeled on human cognition, pairing fast intuition with slow deliberate reasoning in one neurosymbolic system.

Vector Symbolic Algebras supply the machinery: abstract objects become high-dimensional vectors, search is guided by those representations, and program synthesis works object by object. Early results are modest on the main benchmark, around eleven percent on training tasks. On simpler suites the solver shines, reaching about ninety-five percent on Sort-of-ARC and beating GPT-4 on 1D-ARC at a tiny fraction of the computing cost. The authors believe this is the first vector-symbolic attack on the benchmark.

Catalog record

CREATORIsaac Joffe, Chris Eliasmith
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE91 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-08747

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Vector Symbolic Algebras for the Abstraction and Reasoning Corpus Isaac Joffe, Chris Eliasmith Abstract The Abstraction and Reasoning Corpus for Artificial General Intelligence (ARC-AGI) is a generative, few-shot fluid intelligence benchmark. Although humans effortlessly solve ARC-AGI, it remains extremely difficult for even the most advanced artificial intelligence systems. Inspired by methods for modelling human intelligence spanning neuroscience to psychology, we propose a cognitively plausible ARC-AGI solver. Our solver integrates System 1 intuitions with System 2 reasoning in an efficient and interpretable process using neurosymbolic methods based on Vector Symbolic Algebras (VSAs). Our solver works by object-centric program synthesis, leveraging VSAs to represent abstract objects, guide solution search, and enable sample-efficient neural learning. Preliminary results indicate success, with our solver scoring 10.8 % 10.8\% on ARC-AGI-1-Train and 3.0 % 3.0\% on ARC-AGI-1-Eval. Additionally, our solver performs well on simpler benchmarks, scoring 94.5 % 94.5\% on Sort-of-ARC and 83.1 % 83.1\% on 1D-ARC—the latter outperforming GPT-4 at a tiny fraction of the computational cost. Importantly, our approach is unique; we believe we are the first to apply VSAs to ARC-AGI and have developed the most cognitively plausible ARC-AGI solver yet. Our code is available at: https://github.com/ijoffe/ARC-VSA-2025 . 1 Introduction The Abstraction and Reasoning Corpus for Artificial General Intelligence ( Chollet, 2019 ; Chollet et al., 2025b , ARC-AGI;) challenges the tremendous progress deep learning has made in artificial intelligence (AI). ARC-AGI is a fluid intelligence benchmark comprising a collection of grid prediction tasks (see Figs. 2 and 2 ). The goal of the test-taker, human or AI, is simple: given a few pairs of input and output grids containing abstract symbols, determine the rules underlying the symbol transformations and use this understanding to predict the output grids corresponding to lone test input grids. ARC-AGI is easy for humans. Human performance is estimated to be 85.0\% and all tasks were solved by at least one of two experts ( Chollet et al., 2025a ) , indicating human intelligence can completely solve the benchmark. Conversely, ARC-AGI is hard for AI. Despite ample focus and investment over multiple \$1{,}000{,}000 competitions ( Chollet et al., 2024 ; Chollet et al., 2025c ) , the benchmark remains unbeaten. ARC-AGI has proved resistant to old and new deep learning techniques, including the large language model (LLM)—OpenAI’s original GPT-3 ( Brown et al., 2020 ) scored 0.0\% ( Chollet et al., 2025a ) notwithstanding claims of emergent reasoning ( Wei et al., 2022 ) . The chasm between human and AI performance on ARC-AGI suggests fundamental problems with leading approaches to AI. Two such problems often identified in the literature are sample-efficient learning and explicit reasoning ( Bengio et al., 2021 ; Greff et al., 2020 ; LeCun et al., 2015 ) . Deep learning’s success requires vast amounts of often-labelled high-quality training data, making it ineffective in the sample-few regime. Additionally, deep learning systems struggle with representing explicit rules, sometimes manifesting in poor out-of-distribution generalization. Vector Symbolic Algebras (VSAs), a neurosymbolic AI method introducing syntactic structure into high-dimensional distributed representations, hold promise to overcome these two limitations that ARC-AGI targets. VSAs specify high-dimensional vectors to represent structured low-dimensional data, discrete or continuous. Thus, instead of learning useful embeddings from huge datasets, a VSA can be used to encode data with desired inductive biases. VSAs also define operators for the composition and systematic processing of data. Thus, instead of learning shortcut transformations that may generalize poorly to unseen inputs, a VSA, despite relying on distributed representations, can be used to express certain operations analytically. Additionally, VSAs support discrete search and neural learning, both of which are helpful for ARC-AGI. These strengths of VSAs, along with their ability to effectively model cognitive processes in a biologically plausible manner ( Eliasmith and Anderson, 2003 ; Eliasmith, 2013 ) , make them an excellent candidate for helping solve ARC-AGI. We propose a novel, neurosymbolic, cognitively plausible ARC-AGI solver. Our solver uses VSAs, a general cognitive modelling framework, to bridge intuition and reason and capture the efficiency and interpretability of human intelligence. We believe we are the first to apply VSAs to ARC-AGI and, in doing so, have developed the most cognitively plausible ARC-AGI solver yet. The rest of this paper is organized as follows: • Section 2 provides the background knowledge necessary to understand our work. We introduce the VSA used, discuss motivating history, and describe ARC-AGI further. • Section 3 explains our approach. We detail and justify each part of our solver’s design. • Section 4 presents our results. We examine our solver’s performance on ARC-AGI and related datasets. • Section 5 analyzes our approach. We outline our solver’s strengths and report its weaknesses. • Section 6 summarizes our work. 2 Preliminaries 2.1 Vector Symbolic Algebras Before explaining how our solver—which uses VSAs extensively—works, we describe VSAs further. VSAs, also known as hyperdimensional computing, are a family of algebras defining operations over a high-dimensional vector space. In this work, we use Holographic Reduced Representations ( Plate, 1991 ; Plate, 1995 ; Plate, 2003 , HRRs;) , one particular VSA. 2.1.1 Holographic Reduced Representations HRRs define four operations: similarity , binding , bundling , and inversion . Following Furlong and Eliasmith, 2022 , we describe each. Similarity, denoted by the \cdot:\mathbb{R}^{N}\times\mathbb{R}^{N}\rightarrow\mathbb{R} operator, operates on two vectors, \boldsymbol{a} and \boldsymbol{b} , to produce a scalar, s=\boldsymbol{a}\cdot\boldsymbol{b} . The resultant value represents the semantic similarity between the vectors. Similarity is implemented as the vector dot product: s=\boldsymbol{a}\cdot\boldsymbol{b}=\langle\boldsymbol{a},\boldsymbol{b}\rangle=\left\lVert\boldsymbol{a}\right\rVert\left\lVert\boldsymbol{b}\right\rVert\cos{\theta_{\boldsymbol{ab}}} . Because we usually work with unit-length vectors (i.e., \left\lVert\boldsymbol{a}\right\rVert=\left\lVert\boldsymbol{b}\right\rVert=1 ), the dot product is equivalent to cosine similarity and, thus, s falls between -1 and 1 . Similarity is commutative. In high-dimensional vector spaces, the similarity between any two randomly-generated vectors is likely to be extremely small. Similarity can be used to clean-up noisy vectors by replacing the noisy vector with the one from a library of known vectors to which the noisy vector is most similar. Bundling, denoted by the +:\mathbb{R}^{N}\times\mathbb{R}^{N}\rightarrow\mathbb{R}^{N} operator, combines two vectors, \boldsymbol{a} and \boldsymbol{b} , into one, \boldsymbol{c}=\boldsymbol{a}+\boldsymbol{b} . The resultant vector is similar to both input vectors (i.e., \boldsymbol{c}\cdot\boldsymbol{a}\gg 0 and \boldsymbol{c}\cdot\boldsymbol{b}\gg 0 ); bundling gathers multiple vectors into a single representation, producing a superposition of those vectors. Bundling is implemented as element-wise vector addition. Bundling is commutative and associative. Binding, denoted by the \circledast:\mathbb{R}^{N}\times\mathbb{R}^{N}\rightarrow\mathbb{R}^{N} operator, combines two vectors, \boldsymbol{a} and \boldsymbol{b} , into one, \boldsymbol{c}=\boldsymbol{a}\circledast\boldsymbol{b} . The resultant vector is dissimilar to both input vectors (i.e., \boldsymbol{c}\cdot\boldsymbol{a}\simeq 0 and \boldsymbol{c}\cdot\boldsymbol{b}\simeq 0 ); binding associates two vectors, producing a new vector unlike any existing vectors. Binding is implemented as circular convolution: \boldsymbol{c}=\boldsymbol{a}\circledast\boldsymbol{b}=\mathcal{F}^{-1}\left\{\mathcal{F}\left\{\boldsymbol{a}\right\}\odot\mathcal{F}\left\{\boldsymbol{b}\right\}\right\} , where \mathcal{F} is the discrete Fourier transform (DFT) and \odot denotes Hadamard, or element-wise, multiplication. Binding is commutative and associative. Inversion, denoted by the {}^{-1}:\mathbb{R}^{N}\rightarrow\mathbb{R}^{N} operator, converts one vector, \boldsymbol{a} , into another, \boldsymbol{a}^{-1} . The resultant vector bound with the input vector approximately produces the binding identity vector (i.e., \boldsymbol{a}\circledast\boldsymbol{a}^{-1}\simeq\mathbf{I} where \boldsymbol{a}\circledast\mathbf{I}=\boldsymbol{a} ). Inversion can be used to unbind bound vectors: given a bound vector, \boldsymbol{c}=\boldsymbol{a}\circledast\boldsymbol{b} , and one of its constituent vectors, \boldsymbol{a} , the other can be extracted by binding with the inverse of the known constituent (i.e., \boldsymbol{c}\circledast\boldsymbol{a}^{-1}=(\boldsymbol{a}\circledast\boldsymbol{b})\circledast\boldsymbol{a}^{-1}\simeq\boldsymbol{b} ). Figure 1: ARC-AGI task 0962bcdd . Here, the implicit pattern is to transform each

Read the complete text