SYNAPSE: Neuro-Symbolic Visual Thought-to-Text Decoding via Topological Semantic Denoising
Akshaj Murhekar, Abhijit Mishra · 2026
Read SYNAPSE: Neuro-Symbolic Visual Thought-to-Text Decoding via Topological Semantic Denoising by Akshaj Murhekar, Abhijit Mishra (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-27790.txt.
Introduction
Akshaj Murhekar and Abhijit Mishra introduce SYNAPSE, a neuro-symbolic system steadying EEG-to-text decoding with symbolic rules at run time. Cleaning EEG-derived meaning picks with commonsense graph links and latent models makes decoding hold up without end-to-end language model fine-tuning. The method beats free prompting baselines, survives object-label ablation, and matches heavy fine-tuned systems while keeping raw EEG work local.
Catalog record
| CREATOR | Akshaj Murhekar, Abhijit Mishra |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50378 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.27790
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SYNAPSE: Neuro-Symbolic Visual Thought-to-Text Decoding via Topological Semantic Denoising Akshaj Murhekar, Abhijit Mishra Abstract Recent advances in large language models have accelerated open-vocabulary EEG-to-imagined-text decoding, where non-invasive neural activity recorded during visual perception is translated into coherent natural language descriptions of viewed stimuli. However, existing systems remain highly vulnerable to biological noise, where corrupted neural projections induce hallucinated or semantically unstable generation in frozen language models. We introduce SYNAPSE ( Sy mbolic N eural A lignment for P recise S emantic E xtraction), a lightweight neuro-symbolic framework that stabilizes neural text generation through inference-time symbolic regularization. By purifying EEG-derived semantic candidates using commonsense graph structure and latent exemplars, SYNAPSE improves semantic stability without end-to-end LLM fine-tuning. Experiments across popular EEG decoding benchmarks and multiple frozen LLM backends demonstrate consistent gains over unconstrained prompting baselines, robustness under object-label ablation, and performance commensurate with substantially more resource-intensive fine-tuned systems, while preserving biometric privacy by localizing raw EEG processing entirely within the encoder stack. 1 Introduction Translating continuous neural recordings into natural language text has long remained a central objective at the intersection of computational neurotechnology and artificial intelligence. Recent advances in multi-modal generative deep learning have accelerated non-invasive brain-to-text decoding frameworks, particularly those leveraging electroencephalography (EEG) due to its temporal resolution, portability, and clinical feasibility 6 ; 3 ; 4 . In parallel, the rapid evolution of large language models (LLMs) has introduced highly flexible reasoning systems capable of contextual alignment across text, vision, and speech modalities 21 ; 1 , driving growing interest in continuous latent translation pipelines that bridge cortical activity and coherent linguistic generation for applications in assistive communication, immersive interfaces, and neurological healthcare. In particular, recent work has focused on visual thought-to-text translation , where EEG activity elicited during visual perception is decoded into natural language descriptions of viewed stimuli 13 ; 14 . Early open-vocabulary approaches relied on end-to-end fine-tuning of autoregressive or encoder-decoder architectures directly on multi-channel neural recordings 22 ; 7 ; 13 ; however, such tightly coupled training paradigms require substantial computational infrastructure, introduce privacy risks through exposure of sensitive biometric signals, and often suffer from poor generalization as downstream language models evolve. To address these limitations, recent decoupled frameworks such as SENSE replace continuous parameter optimization with discrete latent alignment strategies that project neural signals into a fixed vocabulary space, enabling frozen off-the-shelf LLMs to synthesize fluent text from candidate keywords in a zero-shot setting 14 . However, recent EEG-to-text systems remain constrained within a purely connectionist framework. Because scalp EEG recordings are highly susceptible to physiological artifacts, noisy latent projections often activate semantically unrelated candidate tokens alongside the true intent, a phenomenon we term topical incongruence. When injected directly into frozen LLM prompts, these corrupted semantic cues induce attentional dispersion and hallucinated generation. This raises a fundamental question: can symbolic structure stabilize noisy neural semantic representations without retraining large language models? To address this, we introduce SYNAPSE , a lightweight neuro-symbolic regularization framework that routes EEG-derived semantic candidates through a commonsense multigraph prior to decoding. A deterministic graph purification stage removes disconnected semantic noise where normalized degree centrality satisfies ( C_{D}(\mathbf{v})=0 ), while preserving high-priority neural targets through a conditional union constraint. The framework further enriches decoding with grounded relational facts ( \mathbf{\mathcal{F}} ) and latent syntactic exemplars ( \mathbf{\mathcal{E}}_{\text{exemplars}} ) retrieved directly from neural embeddings ( \mathbf{S}=\mathbf{x}\cdot\mathbf{E}^{\top} ), producing a purified semantic context that stabilizes downstream language generation. We evaluate SYNAPSE on two public EEG-to-language benchmarks: CVPR2017 17 and THINGS EEG2 5 ; 24 , augmenting both datasets with image-grounded captions to support open-vocabulary neural text generation. Across a heterogeneous decoder suite spanning Meta-Llama-3-8B-Instruct , Qwen2.5-7B-Instruct , GPT-4o-mini , and Gemini-2.5-flash-lite , we conduct extensive evaluation using ROUGE, BLEU, METEOR, BERTScore, GPT-5 LLM-as-a-judge assessment, and systematic ablation analysis. Results on CVPR2017 show clear and consistent gains over unconstrained prompting and prior decoupled decoding baselines, particularly under aggressive object-label ablation where symbolic regularization substantially improves semantic stability and retrieval robustness. On the more challenging THINGS EEG2 benchmark, SYNAPSE achieves performance largely commensurate with or exceeding competitive neuro-symbolic and fine-tuned approaches across multiple metrics, while maintaining stronger cross-model consistency under noisy latent conditions. Unlike compute-intensive continuous training pipelines such as Thought2Text 13 , our framework operates as a lightweight inference-time layer aligned with modern retrieval-augmented generative paradigms, enabling frozen LLM deployment while preserving biometric privacy since raw EEG signals remain localized to the encoder stack and never require external model adaptation. To summarize, our key contributions are as follows: • We introduce SYNAPSE , a lightweight neuro-symbolic framework for inference-time EEG semantic regularization without end-to-end LLM fine-tuning. • We propose a graph purification mechanism that removes disconnected semantic noise while preserving high-confidence neural intent. • We develop a latent exemplar retrieval strategy that injects syntactic templates to stabilize downstream generation under noisy biological conditions. • We demonstrate robust and competitive decoding performance across multiple EEG corpora, frozen LLMs, and ablation settings. The complete reproducibility package has been open-sourced at anonymous.4open.science/r/neuro-symbolic-eeg-to-text-26F2 . 2 Related Work Brain-computer interfaces (BCIs) for natural language decoding have rapidly evolved from discrete command classification to continuous brain-to-text generation. Early systems primarily relied on invasive neuroprostheses to decode handwriting and speech articulation from cortical recordings 23 ; 12 , while subsequent work extended these paradigms to non-invasive settings, demonstrating reconstruction of perceived speech 4 , visual stimuli 3 , semantic narratives 19 , and typing-based communication 8 . However, decoding natural language directly from EEG remains fundamentally challenging due to the low spatial resolution and high noise sensitivity of scalp recordings. Recent EEG-to-text architectures address these limitations through cross-modal alignment and self-supervised representation learning. Prior work has explored contrastive masked autoencoders 22 , large-scale neural pre-training 7 , interpretable semantic alignment 10 , and semantic matching frameworks for open-vocabulary generation 20 ; 11 . State-of-the-art systems such as Thought2Text 13 rely on resource-intensive end-to-end fine-tuning of autoregressive language models, while decoupled retrieval-based approaches such as SENSE 14 replace model adaptation with discrete vocabulary retrieval over frozen LLMs. However, both paradigms remain fully connectionist and therefore vulnerable to physiological noise, latent representation drift, and downstream hallucinated generation. In contrast, SYNAPSE introduces an inference-time neuro-symbolic regularization framework that performs topological graph purification and relational grounding over EEG-derived semantic projections, stabilizing frozen language decoders without updating model parameters. 3 Methodology Figure 1: Overview of the SYNAPSE neuro-symbolic framework. Raw candidate keywords extracted from the baseline frontend via \mathbf{z}\cdot\mathbf{V}^{\top} undergo topological graph purification to drop spurious singletons and harvest grounded relational facts. Concurrently, the unrefined neural latent vector \mathbf{x} queries a historical training matrix \mathbf{E} via parallel cosine similarity \mathbf{S}=\mathbf{x}\cdot\mathbf{E}^{\top} to fetch nearest-neighbor syntactic blueprints. The purified vocabulary anchors, relational context, and structural templates are fused into a consolidated prompt to guide generation across a suite of frozen large language model (LLM) decoders. SYNAPSE decodes continuous EEG recordings into natural language without requiring autoregressive LLM fine-tuning. While existing retrieval-based paradigms 14 propagate unconstrained latent noise that triggers semantic drift and hallucinations, our framework introduces a neuro-symbolic intervention layer (Figure 1 ) that systematically purifies neural latents. This is achieved via three core operations: graph-based knowledge grounding, relational fact assertion, and non-parametric exemplar retrieval, which together constrain the LLM generation footprint within a validated semantic