ATA: A Neuro-Symbolic Approach to Implement Autonomous and Trustworthy Agents
David Peer [email protected], Sebastian Stabinger [email protected] · 2025
Read ATA: A Neuro-Symbolic Approach to Implement Autonomous and Trustworthy Agents by David Peer [email protected], Sebastian Stabinger [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-16381.txt.
Introduction
David Peer and Sebastian Stabinger propose ATA, a design for AI agents that can be trusted with high-stakes work. Language models alone hallucinate, wobble between runs, and hide their reasoning, which bars them from sensitive jobs. ATA splits the job: first, knowledge is written down in a formal symbolic base, which human experts can check and fix.
When a task arrives, it is translated into the same formal language. A symbolic decision engine then reasons over the checked base to reach the answer, step by auditable step. In full-auto mode the system matches top end-to-end models on a hard reasoning task. With a human-verified base it beats even larger models, while staying perfectly deterministic and immune to prompt injection. The design offers a practical route to agents whose decisions can be inspected and defended.
Catalog record
| CREATOR | David Peer [email protected], Sebastian Stabinger [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 48 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-16381
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ATA: A Neuro-Symbolic Approach to Implement Autonomous and Trustworthy Agents David Peer [email protected], Sebastian Stabinger [email protected] Abstract Large Language Models (LLMs) have demonstrated impressive capabilities, yet their deployment in high-stakes domains is hindered by inherent limitations in trustworthiness, including hallucinations, instability, and a lack of transparency. To address these challenges, we introduce a generic neuro-symbolic approach, which we call Autonomous Trustworthy Agents (ATA) . The core of our approach lies in decoupling tasks into two distinct phases: Offline knowledge ingestion and online task processing . During knowledge ingestion, an LLM translates an informal problem specification into a formal, symbolic knowledge base. This formal representation is crucial as it can be verified and refined by human experts, ensuring its correctness and alignment with domain requirements. In the subsequent task processing phase, each incoming input is encoded into the same formal language. A symbolic decision engine then utilizes this encoded input in conjunction with the formal knowledge base to derive a reliable result. Through an extensive evaluation on a complex reasoning task, we demonstrate that a concrete implementation of ATA is competitive with state-of-the-art end-to-end reasoning models in a fully automated setup while maintaining trustworthiness. Crucially, with a human-verified and corrected knowledge base, our approach significantly outperforms even larger models, while exhibiting perfect determinism, enhanced stability against input perturbations, and inherent immunity to prompt injection attacks. By generating decisions grounded in symbolic reasoning, ATA offers a practical and controllable architecture for building the next generation of transparent, auditable, and reliable autonomous agents. 1 Introduction 0 0 footnotetext: Note: This text was corrected and improved with Gemini 2.5 Pro Large language models (LLMs) have demonstrated impressive capabilities across a wide spectrum of natural language processing tasks, ranging from question answering, text summarization, and machine translation to complex applications utilizing multi-agent implementations ( Comanici et al. 2025 ; Jiang et al. 2024 ) . They not only achieve high performance, but also allow for control via natural language prompts, making them accessible to non-experts. This ease of interaction opens up a wide range of applications and use-cases in various industries, particularly as it empowers non-computer scientists to effectively use and control these systems. Nevertheless, especially in high-stakes industries such as insurance, healthcare, finance, and law, it is crucial that the decisions made by autonomous agents are not only accurate but also trustworthy. Kowald et al. 2024 defines six important requirements for trustworthy AI: (R1) accuracy and stability, (R2) human agency and oversight, (R3) transparency and explainability, (R4) privacy and security, (R5) accountability, and (R6) fairness and non-discrimination. While LLMs have demonstrated impressive performance, enabling a wide range of new applications, we argue that current systems do not yet fully satisfy these trustworthy AI requirements: Figure 1 : An overview of the proposed approach called Autonomous Trustworthy Agents (ATA). While initial prompting of LLMs appears simple, achieving the very high accuracy required in high-stakes applications demands advanced prompt-engineering expertise and skills, as noted by Vu & Oppenlaender 2025 (R2). This difficulty is compounded by the fact that LLMs are known to hallucinate and exhibit instability, even in purportedly deterministic setups ( Guan et al. 2025 ; Kalai et al. 2025 ) (R1). Moreover, changes to the prompt can negatively affect performance on other parts of the sample distribution, complicating proper control and necessitating a robust benchmarking and testing framework (R1, R2). It is known that reasoning LLMs contain invalid reasoning steps or hallucinated conclusions which negatively impacts the transparency and explainability of those models (R3) ( Bilal et al. 2025 ; Lu et al. 2025 ) . Furthermore, LLMs are known to be vulnerable to prompt injection attacks ( Liu et al. 2024b ) and since LLM providers typically do not offer on-premise execution, ensuring on-premise data privacy for users is often impossible (R4). Finally, LLMs exhibit biases (R6), an issue that remains an open research topic ( Resnik 2025 ) . Several frameworks and approaches have been presented in the past to adress certain limitations of LLMs. For example Yao et al. 2022 presented ReAct to combine reasoning and acting in an interleaved manner in order to improve reasoning of LLMs and to make them even more generic. Instead, we introduce an approach to address the aforementioned limitations of trustworthiness, named Autonomous Trustworthy Agents (ATA) , that combines the strengths of LLMs with the advantages of symbolic methods. Instead of querying a LLM with a single, large prompt, the task is split into two distinct building blocks: Knowledge ingestion and task processing ( Figure 1 ). The first block, knowledge ingestion, is responsible for translating an informal problem specification into a formal, symbolic knowledge base. The second block, task processing, evaluates an incoming natural language input in order to derive a reliable result w.r.t this formal knowledge base. Knowledge ingestion makes use of the impressive coding capabilities of LLMs ( Jiang et al. 2024 ) to convert an informal problem specification into a formal language. This formal representation can be an imperative programming language, such as Python or C++, but also a declarative one, such as Prolog or first-order logic. A key benefit is that the resulting formal representation can be verified and corrected by human experts ensuring that the natural language representation matches the formal representation. This oversight allows for the removal of hallucinations and the correction of misunderstandings that can easily arise from specifications given in natural language. The task processing step processes an unstructured, natural language input at runtime, in order to produce a desired result that complies with the knowledge base. To achieve this, the informal input is first encoded into a formal representation that complies with the knowledge base. This step is typically a fairly well understood NLP task such as text classification, named entity recognition, or relation extraction. Subsequently, a deterministic decision engine evaluates the formal representation of the input with respect to the formalized knowledge base. The usage of a symbolic (rather than neural) decision engine not only guarantees stability through deterministic executions, but also avoids prompt injection attacks. Additionally, a human-in-the-loop process can be triggered to review certain queries or results based on specific conditions. While ATA is a generic approach that can improve the trustworthiness significantly as shown later in this paper, it is not applicable for every task and not always straightforward to implement. To demonstrate the applicability and advantages of this general approach, we also present a concrete ATA implementation for autonomous claims processing. In this use case, a policyholder files a claim under a contract governed by a certain terms and conditions (T&Cs) policy. The T&C document represents the informal specification while the claim is the input that needs to be processed. An autonomous agent then determines, on behalf of the policy provider, whether the claim is covered by the contract. An illustration for claims processing is given in Figure 2 . This task is really challenging, as it requires a deep understanding of the T&Cs and the claim itself, as well as the ability to reason about the relationship between these two documents: Policies are formulated in natural language, defining rules that must be fulfilled for a claim to be covered and rules that exclude certain claims from coverage. Those rules