The Road to Generalizable Neuro-Symbolic Learning Should be Paved with Foundation Models
Adam Stein, Aaditya Naik, Neelay Velingker, Mayur Naik, Eric Wong · 2025
Read The Road to Generalizable Neuro-Symbolic Learning Should be Paved with Foundation Models by Adam Stein, Aaditya Naik, Neelay Velingker, Mayur Naik, Eric Wong (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-24874.txt.
Introduction
Adam Stein and co-authors argue that hybrid AI should build on large foundation models in a 2025 position paper. Neuro-symbolic learning pairs neural nets with logic programs for hard reasoning. Classic versions train small models from scratch and stall on simple tasks. Big foundation models reason well by prompting yet often err and hide their steps.
Adding logic programs to prompted models offers a middle path, the authors say. They name three traps in the classic route tied to compute, data, and programs. Each trap breeds failures when tasks grow or shift. Prompt based hybrids dodge much of that cost. The paper maps a road toward hybrids that generalize without fresh training.
Catalog record
| CREATOR | Adam Stein, Aaditya Naik, Neelay Velingker, Mayur Naik, Eric Wong |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-24874
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The Road to Generalizable Neuro-Symbolic Learning Should be Paved with Foundation Models Adam Stein, Aaditya Naik, Neelay Velingker, Mayur Naik, Eric Wong Abstract Neuro-symbolic learning was proposed to address challenges with training neural networks for complex reasoning tasks with the added benefits of interpretability, reliability, and efficiency. Neuro-symbolic learning methods traditionally train neural models in conjunction with symbolic programs, but they face significant challenges that limit them to simplistic problems. On the other hand, purely-neural foundation models now reach state-of-the-art performance through prompting rather than training, but they are often unreliable and lack interpretability. Supplementing foundation models with symbolic programs, which we call neuro-symbolic prompting, provides a way to use these models for complex reasoning tasks. Doing so raises the question: What role does specialized model training as part of neuro-symbolic learning have in the age of foundation models? To explore this question, we highlight three pitfalls of traditional neuro-symbolic learning with respect to the compute, data, and programs leading to generalization problems. This position paper argues that foundation models enable generalizable neuro-symbolic solutions, offering a path towards achieving the original goals of neuro-symbolic learning without the downsides of training from scratch. 1 1 1 Code for experiments available at: https://github.com/adaminsky/nesy_prompting 1 Introduction Foundation models pre-trained on general internet-scale data are now ubiquitous, bringing the benefits of deep learning to downstream applications across several domains [ Bom+21 ] . This is achieved primarily via prompting techniques as well as finetuning for more niche use cases. Their success is driven by scaling up both the training data and model parameters, leading to predictable performance improvements [ Kap+20 ] . Even so, limitations on problems requiring complex reasoning and reliability remain [ Dzi+23 , VSK24 ] . Further, these systems are fundamentally black-box, and lack features like interpretability, which is vital for safety-critical domains such as medicine [ Kha+25 , Wu+24 ] , autonomous driving [ Sun+21 ] , and aviation [ SJ21 ] , and their unpredictable nature raises safety concerns for their real-world deployment [ Amo+16 ] . Neuro-symbolic learning is a paradigm that moves towards a solution to these limitations by training deep neural models in conjunction with symbolic reasoning [ Cha+21 ] . Figure 1 on the left shows a setup common for neuro-symbolic systems such as Scallop [ Hua+21 ] , ISED [ Sol+24 ] , and NeurASP [ YIL20 ] . Here, the task is split into two common subtasks, perception and reasoning. Perception tasks convert raw inputs (text, images, video, etc.) into symbols using deep neural models, and the reasoning task uses a symbolic program (e.g. a Python function) to process the symbols from perception [ Mao+19 ] . Training the system end-to-end provides several benefits over traditional neural networks, including data efficiency (using smaller datasets and less supervision), generalizability, and interpretability (the intermediate symbols can be examined and the program offers a faithful explanation of the output). Despite these benefits, neuro-symbolic training is often impractical due to scalability challenges, which are significantly rooted in the typical absence of direct supervision for the intermediate symbols produced by the neural model before they are processed by the symbolic reasoner [ Fel+24 ] . Figure 1: Neuro-symbolic training consists of neural models whose results are fed into a program to produce the desired output (shown on the left). Training the neural models in neuro-symbolic training is a significant challenge due to not having supervision for the intermediate symbols, denoted as s . Shown in the middle is the modern foundation model prompting paradigm where a user provides a prompt and their input to a foundation model which then produces the output. On the right, we show the foundation model approach to neuro-symbolic which like prompting does not require training, but uses a symbolic component like neuro-symbolic training . While a major challenge in traditional neuro-symbolic training is learning the neural component, foundation models can now perform many tasks requiring strong input understanding without any additional training [ Bom+21 , Yue+24 , Fer+24 ] . The common prompting setup is shown in the middle of Figure 1 where there is now just a prompt rather than the training and program. As foundation models are trained on such large amounts of data, prompting can even offer better performance and robustness than a training-based method using less data [ Bom+21 ] . This raises the following question: What role does specialized model training as part of neuro-symbolic have in the age of foundation models? In this paper, we argue that building neuro-symbolic atop frontier foundation models allows for achieving the benefits of neuro-symbolic learning—program reliability and symbol interpretability—without the disadvantages that come with training. We term the replacement of neural components in the traditional neuro-symbolic training setup with foundation models as Neuro-Symbolic Prompting , and show its setup in Figure 1 on the right. Neuro-symbolic prompting uses prompted foundation models to perform the perception task of extracting symbols, while a symbolic program (e.g. a Python program) is used to reason over the detected symbols. Several prior works fall into the category of neuro-symbolic prompting including Vieira [ Li+24a ] which combines foundation models with Scallop, SatLM [ Ye+23 ] which uses LLMs to convert input problems into constraint solver input, and LLMFP [ HZF25 ] which solves planning problems by formalizing them as constrained optimization problems which are solved by a discrete optimizer. Our experiments uncover several pitfalls of traditional neuro-symbolic training including unnecessarily training models when prompting is now available, overfitting to labeled datasets, and reliance on a single program to provide learning signal for the correct behaviors. On the other hand, we show that neuro-symbolic prompting provides opportunities for enabling reliability and interpretability of foundation models without the pitfalls associated with training in neuro-symbolic training. In light of these findings, we look towards future research on neuro-symbolic prompting, where we highlight the problem of autonomously inferring the symbols and program as the significant remaining frontier. 2 Pitfalls Table 1: Results for the pitfalls across five datasets (D1-D5). D1: Sum5, D2: HWF5, D3: CLUTRR, D4: Leaf, D5: CLEVR. For symbol hallucination, we measure the fraction of times that the neuro-symbolic training method produces the true intermediate symbols, specifically among cases when the neuro-symbolic training method’s final answer is correct but the neuro-symbolic prompting method’s final answer is wrong. A value of 1 means the performance gap between neuro-symbolic training and neuro-symbolic prompting is due to inferring the true symbols while a low value means the correct answer is reached via hallucinated symbols. The ‘*’ indicates a human evaluation. Pitfall Cat. Aspect / Condition Metric D1 D2 D3 D4 D5 Compute Pitfall Neuro-Symbolic Training vs. Prompting Perf. Acc. Diff. ( \text{NS}_{\text{train}}-\text{NS}_{\text{prompt}} ) +0.11 +0.25 -0.39 +0.31 -0.15 Data Pitfall Robustness at 3% Noise Acc. Drop ( \text{NS}_{\text{train}} ) -0.02 -0.21 – -0.11 -0.19 Acc. Drop ( \text{NS}_{\text{prompt}} ) -0.03 -0.06 – -0.06 -0.07 Program Pitfall Symbol Hallucination Symbol GT Match – – 0.00 0.16* 0.14 The neuro-symbolic training paradigm enables the use of explicit programs in an end-to-end differentiable manner, which allows for training models for reasoning tasks using less supervision, data, and compute compared to traditional deep learning techniques. However, in the age of foundation models, a well-crafted prompt