Symbolic Guardrails for Domain-Specific Agents: Stronger Safety and Security Guarantees Without Sacrificing Utility CCS: Security and privacy Software and application security CCS: Computing methodologies Artificial intelligence CCS: Security and privacy Formal methods and theory of security
Yining Hong, Yining She, Eunsuk Kang, Christopher S. Timperley, Christian Kästner · 2026
Read Symbolic Guardrails for Domain-Specific Agents: Stronger Safety and Security Guarantees Without Sacrificing Utility CCS: Security and privacy Software and application security CCS: Computing methodologies Artificial intelligence CCS: Security and privacy Formal methods and theory of security by Yining Hong, Yining She, Eunsuk Kang, Christopher S. Timperley, Christian Kästner (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-15579.txt.
Introduction
Hong and four colleagues argue that domain-specific AI agents need symbolic guardrails, not just training-based or neural ones that lower but cannot rule out unsafe tool calls. Reviewing 80 agent safety benchmarks, they find 85 percent state no verifiable requirements. On three benchmarks, 74 percent of requirements prove symbolically enforceable, mostly by simple low-cost checks, and symbolic guardrails raise safety without costing utility.
Catalog record
| CREATOR | Yining Hong, Yining She, Eunsuk Kang, Christopher S. Timperley, Christian Kästner |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 67070 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.15579
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Symbolic Guardrails for Domain-Specific Agents: Stronger Safety and Security Guarantees Without Sacrificing Utility CCS: Security and privacy Software and application security CCS: Computing methodologies Artificial intelligence CCS: Security and privacy Formal methods and theory of security Yining Hong, Yining She, Eunsuk Kang, Christopher S. Timperley, Christian Kästner Abstract . AI agents that interact with their environments through tools enable powerful applications, but in high-stakes business settings, unintended actions can cause unacceptable harm, such as privacy breaches and financial loss. Existing mitigations, such as training-based methods and neural guardrails, improve agent reliability but cannot provide guarantees. We study symbolic guardrails as a practical path toward strong safety and security guarantees for AI agents. Our three-part study includes a systematic review of 80 state-of-the-art agent safety and security benchmarks to identify the policies they evaluate, an analysis of which policy requirements can be guaranteed by symbolic guardrails, and an evaluation of how symbolic guardrails affect safety, security, and agent success on τ 2 \tau^{2} -Bench, CAR-bench, and MedAgentBench. We find that 85% of benchmarks lack concrete policies, relying instead on underspecified high-level goals or common sense. Among the specified policies, 74% of policy requirements can be enforced by symbolic guardrails, often using simple, low-cost mechanisms. These guardrails improve safety and security without sacrificing agent utility. Overall, our results suggest that symbolic guardrails are a practical and effective way to guarantee some safety and security requirements, especially for domain-specific AI agents. We release all codes and artifacts at https://github.com/hyn0027/agent-symbolic-guardrails . A block diagram showing a User sending input through an optional Interface to an LLM, which can iteratively process information, make reasoning, and interact with external Tools before returning results back to the user through the optional interface. Figure 1 . Overview of the AI agent workflow. The LLM interacts with the user, performs reasoning, and invokes tools. A block diagram showing a User sending input through an optional Interface to an LLM, which can iteratively process information, make reasoning, and interact with external Tools before returning results back to the user through the optional interface. 1. Introduction Recent advancements in LLM-based AI agents have generated both excitement and concerns. These agents are powerful, able to use tools and interact with their environment ( 71 ; 58 ; 39 ) . Their capabilities have led to adoption across many domains, including Sierra for customer experience ( 59 ) , Cursor for software development ( 6 ) , and Hippocratic AI for healthcare applications ( 25 ) , as well as general-purpose assistants such as Claude Desktop ( 5 ) and OpenClaw ( 47 ) . However, serious safety and security concerns have also emerged from AI agents using tools in unintended ways ( 42 ; 17 ) . For example, in the GitHub MCP incident ( 44 ) , an attacker manipulated an agent into using tools to access private repository data and reveal it in a public repository. Even without an attacker, agents may perform unsafe actions, for example, an OpenClaw agent disregarded user instructions and invoked tools to bulk-delete emails ( 50 ) . Because unintended or incorrect tool use can cause real harm, such as data loss ( 36 ) , financial loss ( 63 ) , manipulation ( 23 ) , misinformation ( 75 ) , and even physical harm ( 72 ) , there is often hesitation to deploy agents in business settings, where harms can have serious consequences. While individuals may choose to accept the personal risks of general-purpose agents such as OpenClaw ( 47 ) , companies often face higher stakes. The potential for leaking customer data, suffering data loss, or enabling malicious transactions with real financial or physical consequences is usually too great, even when an agent performs reliably in evaluations. For example, a healthcare record management agent may be able to prescribe medications through tool use, and even rare failures, such as prescribing contraindicated drugs, can pose serious risks to patients, the organization, and its stakeholders. Hence, for many tasks, especially domain-specific tasks in business settings, it is desirable to design agents with predictable safety and security guarantees. To improve the safety and security of AI agents, researchers have explored different mechanisms. These include training-based approaches that aim to bake safety and security directly into the model ( 48 ; 7 ; 51 ) , as well as guardrails built around the model ( 12 ; 53 ; 13 ) . However, most guardrails are neural guardrails ( 41 ; 12 ; 53 ) , meaning that their execution relies on probabilistic methods, typically LLMs. For example, in the LLM-as-a-judge paradigm, a separate LLM observes an agent’s interactions and determines if they are safe and secure ( 41 ; 12 ) . These neural guardrails can reduce the likelihood of policy violations, but, given their probabilistic nature, they cannot provide guarantees that policy violations are provably impossible. For agents in business settings, such guarantees, even if limited to a narrow set of properties, are highly desirable because even small probabilities of mistakes or successful attacks may pose unacceptable risks when the potential harms are severe. In traditional software engineering and software security, developers often use symbolic enforcement mechanisms to guarantee that systems satisfy specific safety or security constraints. These include access control ( 54 ) , input validation ( 24 ) , and information-flow control ( 18 ) . By design, such mechanisms deterministically prevent undesirable behavior through explicit checks against predefined policies. For example, information-flow analysis can guarantee that code is free from SQL injection vulnerabilities ( 24 ) , while static analysis and related techniques can guarantee the absence of exploitable buffer overflows ( 64 ) . A few recent works explored applying these symbolic enforcement mechanisms as symbolic guardrails for AI agents, including methods based on temporal logic ( 65 ; 31 ) , information flow control ( 13 ; 49 ) , and privilege control ( 57 ; 32 ) . These symbolic guardrails support explicit reasoning about whether a policy is satisfied. However, they typically cover a limited set of guardrail paradigms and a narrow class of safety or security policies, such as constraining tool-call order with temporal logic. As a result, their practical applicability and whether they are sufficient to cover common safety and security properties in AI agents remain unclear. We expect that articulating and guaranteeing properties are especially difficult for general-purpose agents, whereas narrower domain-specific agents in business settings, such as customer service support, may offer more opportunities. Motivated by the goal of providing formal guarantees for safety and security policies in AI agents, rather than merely reducing the likelihood of violations, we explore symbolic guardrails as a promising approach. Symbolic guardrails vary in both expressiveness and cost, ranging from inexpensive but less expressive techniques such as input validation ( 27 ) to more sophisticated approaches such as information-flow tracking and input masking ( 13 ) . For a practical assessment, however, it remains unclear what practitioners actually think about AI agent safety and security, and to what extent each of those symbolic guardrails is useful in this context. Specifically, we ask the following concrete research questions: RQ1: As a proxy for the safety and security