Overmind NSA: A Unified Neuro-Symbolic Computing Architecture with Approximate Nonlinear Activations and Preemptive Memory Bypass Conference: 63rd ACM/IEEE Design Automation Conference; July 26–29, 2026; Long Beach, CA, USA 63rd ACM/IEEE Design Automation Conference (DAC ’26), July 26–29, 2026, Long Beach, CA, USA DOI: 10.1145/3770743.3804279 ISBN: 979-8-4007-2254-7/2026/07

Weilun Wang, Zirui Wang, Wantong Li · 2026

Read Overmind NSA: A Unified Neuro-Symbolic Computing Architecture with Approximate Nonlinear Activations and Preemptive Memory Bypass Conference: 63rd ACM/IEEE Design Automation Conference; July 26–29, 2026; Long Beach, CA, USA 63rd ACM/IEEE Design Automation Conference (DAC ’26), July 26–29, 2026, Long Beach, CA, USA DOI: 10.1145/3770743.3804279 ISBN: 979-8-4007-2254-7/2026/07 by Weilun Wang, Zirui Wang, Wantong Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-15623.txt.

Introduction

Wang, Wang, and Li present Overmind, a unified neuro-symbolic computing architecture that cuts memory and pipeline costs for perception-plus-reasoning workloads. Padé approximations handle nonlinear functions, preemptive memory bypass removes costly on-chip caches, and a full software stack tunes deployment, with Padé order reconfiguring accuracy-performance trade-offs. It reaches 8.1 TOPS per watt and 410 GOPS throughput with minimal accuracy loss on mixed workloads.

Catalog record

CREATORWeilun Wang, Zirui Wang, Wantong Li
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28850
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.15623

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Overmind NSA: A Unified Neuro-Symbolic Computing Architecture with Approximate Nonlinear Activations and Preemptive Memory Bypass Conference: 63rd ACM/IEEE Design Automation Conference; July 26–29, 2026; Long Beach, CA, USA 63rd ACM/IEEE Design Automation Conference (DAC ’26), July 26–29, 2026, Long Beach, CA, USA DOI: 10.1145/3770743.3804279 ISBN: 979-8-4007-2254-7/2026/07 Weilun Wang, Zirui Wang, Wantong Li Abstract . Neuro-symbolic AI is gaining traction in domains such as large language models, scientific discovery, and autonomous systems due to its ability to combine perception with structured reasoning. However, its deployment is often constrained by high memory demands, diverse computation patterns, and complex hardware requirements. Existing hardware platforms struggle with large on-chip memory overheads, frequent pipeline stalls, limited I/O bandwidth, and inefficient handling of nonlinear operations. To address these key computational bottlenecks, we propose Overmind, a unified neuro-symbolic architecture with cross-layer optimizations. Overmind tackles these core bottlenecks through Padé approximations for universal nonlinear functions, preemptive memory bypass that eliminates costly on-chip caches, and a complete software stack that optimizes model deployment. By reconfiguring the Padé orders for approximating nonlinear functions, we also demonstrate adaptive accuracy-performance scaling. Overmind achieves an energy efficiency of 8.1 TOPS/W and a throughput of 410 GOPS for mixed neuro-symbolic workloads with minimal model accuracy loss. Compared to existing solutions, Overmind improves performance and efficiency with significantly fewer hardware resources. † † cc-license: by 1. Introduction Artificial intelligence (AI) applications increasingly demand models that combine high accuracy with transparency and explainability. To achieve true explainability, researchers aim to embed a reasoning process that is both transparent and traceable, such that any conclusion can be reliably traced back to its foundational data and logical steps. This pursuit has led to the emergence of neuro-symbolic AI (NSA), which unifies two complementary paradigms: connectionism and symbolism ( 12 ; 15 ) . Connectionist approaches are exemplified by neural networks and excel at pattern recognition and perception, but often require large training datasets and offer limited interpretability. Symbolic approaches encode knowledge through formal symbols and rules for precise and transparent inference, but lack the ability to directly learn from data. By merging these approaches, NSA provides both powerful learning and interpretable decision-making, as illustrated in Fig. 1 . NSA has gained traction across diverse domains, ranging from large language models (LLMs) to complex scientific reasoning ( 29 ; 24 ; 31 ; 22 ) . In safety-critical applications such as robotics and healthcare, this combination is valuable as NSA enables not only accurate predictions but also transparent reasoning that can be inspected and trusted ( 21 ) . However, these advances introduce additional computational requirements, including memory-bound symbolic operations, intensive matrix similarity searches for codebook lookups, and circular convolution for high-dimensional symbolic binding ( 5 ) . Conventional GPU and NPU architectures are optimized primarily for linear tensor operations, but will achieve low utilization rate for these memory-intensive workloads. While recent NSA accelerators have addressed specific operations, they lack unified support for nonlinear functions, suffer from memory hierarchy inefficiencies, and require specialized hardware for circular convolution that scales poorly with vector dimension ( 30 ; 33 ) . In this work, we propose Overmind NSA, a unified neuro-symbolic computing architecture that addresses these limitations through integrated hardware-software co-design. Figure 1. Integration of neural and symbolic components, enabling both data-driven learning and rule-based inference. Our main contributions are as follows: • We design an integrated nonlinear compute engine using Padé approximation that decomposes activation functions into rational polynomials computable directly within PE arrays. • We propose preemptive memory bypass with dual-window address filtering that eliminates L2 cache overhead and inherently supports circular convolution via address offset computation. • We develop a software stack with co-optimization workflow that automatically maps NSA models to Overmind, selects Padé orders based on accuracy/efficiency targets, and enables deployment of new NSA models without hardware redesign. 2. Background 2.1. NSA Algorithms and Operations Table 1. Fine-Grained Analysis of NSA Atomic Instructions Model Compute Type & Atomic Instruction Composition NVSA ( 14 ) Vector (98.7%): elem-wise add, mul, similarity search. NN (1.3%): MAC, ReLU (cmp+mul). LTN ( 4 ) Logic (15%): fuzzy AND, OR, NOT, Element-wise. NN (85%): MAC, smooth activations (sigmoid, tanh). LNN ( 25 ) Logic (10%): differentiable AND, OR, IMPLIES, nonlinear (power, sqrt, exp). NN (90%): MAC, sigmoid/ReLU. NLM ( 9 ) NN (55%): MAC, nonlinear ReLU/tanh/sigmoid. Logic (45%): rule composition, fuzzy AND/OR, MatMul. A typical NSA model consists of two main components: the neural part and the symbolic part. They all share a common architectural pattern, where a neural component first extracts features from tensor data using operations such as convolutions, activations, and fully connected layers. The symbolic component then performs reasoning through operations such as circular convolution, rule detection, and rule execution. We further categorize them into vector-symbolic models and logic machines. Vector-symbolic models encode concepts as high-dimensional vectors and perform reasoning through algebraic operations. For instance, NVSA tackles abstract visual reasoning to infer missing patterns from visual context ( 14 ) . On the other hand, logic machines represent knowledge through differentiable logical constraints and address knowledge-intensive tasks. LTN is a popular logic machine that integrates logical constraints into semantic image interpretation ( 4 ) . NSA models use diverse operations for their neural and symbolic parts, so it is essential to first characterize their computational requirements. We conduct operator-level profiling using PyTorch profiler on multiple NSA models. For each model, we collect cycle-accurate operation counts and data access patterns. Table 1 summarizes the fundamental operations for four representative models, which cover common NSA operations and represent both vector-symbolic and logic-based paradigms. The diversity of neuro-symbolic operations indicates that existing general-purpose architectures cannot efficiently support the broad spectrum of NSA workloads. Our analysis in Fig. 2 a reveals that nonlinear operations dominate the computations in multiple NSA models. The symbolic components also require comparable or even more resources than the neural components, as shown in Fig. 2 b. These trends confirm that traditional accelerator strategies, such as scaling MAC units and optimizing for neural operators, are insufficient for NSA workloads. As shown in Fig. 2 c, symbolic operations exhibit more memory-bound access patterns and lead to higher memory transfer latencies compared to neural operations. Figure 2. NSA workload profiling on (a) linear vs. nonlinear computations, (b) neural vs. symbolic operations, and (c) latency breakdown. 2.2. Existing NSA Computation Challenges While existing hardware accelerators have been effective for parallelized linear operations in neural networks, they cannot fully address the unique properties of NSA workloads. Existing designs based on processing engine (PE) arrays ( 18 ; 7 ; 10 ; 1 ; 8 ) and memory-centric architectures ( 2 ; 20 ; 23 ; 13 ) are optimized for neural operations, but achieve low utilization for symbolic computation patterns such as circular convolution and rule-based reasoning. Fig. 3 summarizes the key computational bottlenecks when executing NSA models on general-purpose hardware. Figure 3. Summary of key computational bottlenecks in neural and symbolic components of NSA models. Architectural mismatch for nonlinear computations. NSA workloads devote a large fraction of execution cycles to nonlinear functions, yet existing accelerators provide limited hardware support for these primitives. Existing approximation methods introduce architectural bottlenecks. Taylor series approximations suffer from limited convergence radius and require piecewise implementations with multiple

Read the complete text