Introducing the Generative Application Firewall (GAF)
Joan Vendrell Farreny NeuralTrust Martí Jordà Roca NeuralTrust Miquel Cornudella Gaya NeuralTrust Rodrigo Fernández Baón NeuralTrust Victor García Martínez NeuralTrust Eduard Camacho Sucarrats NeuralTrust Alessandro Pignati NeuralTrust Expert endorsers: Christos Kalyvas-Kasopatidis ∗ University of t · 2026
Read Introducing the Generative Application Firewall (GAF) by Joan Vendrell Farreny NeuralTrust Martí Jordà Roca NeuralTrust Miquel Cornudella Gaya NeuralTrust Rodrigo Fernández Baón NeuralTrust Victor García Martínez NeuralTrust Eduard Camacho Sucarrats NeuralTrust Alessandro Pignati NeuralTrust Expert endorsers: Christos Kalyvas-Kasopatidis ∗ University of t (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-15824.txt.
Introduction
Joan Vendrell Farreny and colleagues at NeuralTrust propose a new security layer in a 2026 arXiv paper. They call it the Generative Application Firewall, or GAF. It is an architectural layer for securing language model applications. Existing defenses are fragmented, they argue. Prompt filters, guardrails, and data masking each guard one spot. GAF unifies them into a single enforcement point.
The model is the web application firewall. A WAF coordinates defenses for web traffic in one place. GAF aims to do the same for generative apps. It also covers autonomous agents and their tool interactions. Agent actions are a new attack surface that old tools miss. For security teams, one chokepoint is easier to audit than scattered patches.
Catalog record
| CREATOR | Joan Vendrell Farreny NeuralTrust Martí Jordà Roca NeuralTrust Miquel Cornudella Gaya NeuralTrust Rodrigo Fernández Baón NeuralTrust Victor García Martínez NeuralTrust Eduard Camacho Sucarrats NeuralTrust Alessandro Pignati NeuralTrust Expert endorsers: Christos Kalyvas-Kasopatidis ∗ University of t |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 28 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-15824
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Introducing the Generative Application Firewall (GAF) Joan Vendrell Farreny NeuralTrust Martí Jordà Roca NeuralTrust Miquel Cornudella Gaya NeuralTrust Rodrigo Fernández Baón NeuralTrust Victor García Martínez NeuralTrust Eduard Camacho Sucarrats NeuralTrust Alessandro Pignati NeuralTrust Expert endorsers: Christos Kalyvas-Kasopatidis ∗ University of the Aegean Emre Isik ∗ University of Cambridge Idan Habler ∗ OWASP GenAI Security Project Jinwei Hu ∗ University of Liverpool Strahinja Janjusevic ∗ MIT Computer Science and Artificial Intelligence Laboratory Osvaldo Ramirez ∗ Center for AI and Digital Policy Tu Nguyen ∗ Huawei Xuanlin Liu ∗ Cloud Security Alliance Abstract This paper introduces the Generative Application Firewall (GAF), a new architectural layer for securing LLM applications. Existing defenses—prompt filters, guardrails, and data-masking—remain fragmented; GAF unifies them into a single enforcement point, much like a WAF coordinates defenses for web traffic, while also covering autonomous agents and their tool interactions. * * footnotetext: The paper represents the views of the individual endorsers and not necessarily of their affiliated institutions. 1 Introduction As generative AI systems become increasingly adopted in real-world applications, questions around how to secure them have taken on new urgency. The rapid pace of deployment has outpaced the development of shared terminology, frameworks, and architectural patterns for safety and control. This challenge parallels the evolution of web application security. Web applications introduced new attack vectors that traditional network firewalls could not address. Attacks such as HTTP flooding, OWASP Top 10 10 , and other application-layer threats used seemingly valid HTTP requests that bypassed network-level protections. This gap prompted the development of Web Application Firewalls (WAFs) 3 as a dedicated security layer for web traffic. Similarly, generative LLM applications introduce novel threats—such as prompt injection, jailbreaking, and context manipulation 11 —that existing WAFs cannot effectively detect or mitigate. This paper introduces the concept of a Generative Application Firewall (GAF), a dedicated security layer for generative applications, and provides an abstraction to structure ongoing efforts in this space. 2 Why is it necessary? Generative AI attacks exploit limitations in traditional layered security models, requiring a dedicated security layer to protect applications. Just as web applications bypassed network-level protections, generative AI applications circumvent both network (Layer 3-4) and traditional application-layer (Layer 4-7) defenses. Bypassing Network-Layer Security (Layer 3-4): Traditional network firewalls and intrusion detection systems examine packet headers, IP addresses, and basic protocol information at the network and transport layers. However, jailbreak and prompt injection attacks embed within semantically valid HTTP requests that appear legitimate at the network level. These attacks use standard ports, proper HTTP formatting, and legitimate IP addresses, showing no suspicious patterns. A malicious prompt for illegal activities travels indistinguishably from a benign inquiry. Evading Web Application Firewalls (Layer 4-7): Traditional WAFs inspect HTTP headers, request structures, and known attack signatures to detect threats like SQL injection or cross-site scripting. However, generative AI attacks exploit natural language semantics rather than syntactic vulnerabilities. For instance, a jailbreak attack might request an AI to "roleplay as an unrestricted AI" or use social engineering to extract sensitive information. These contain no malicious code patterns or anomalies that WAFs detect. The attack lies in conversational manipulation of the AI model. The Semantic Gap: Prompt injection and jailbreak attacks operate at the semantic layer, exploiting natural language meaning and context rather than technical vulnerabilities. Traditional tools lack contextual awareness to recognize that a "creative writing" request might bypass safety guardrails. Multi turn attacks like Echo Chamber 1 build malicious intent across interactions, remaining invisible to measures analyzing requests in isolation. Established security platforms, such as WAFs, do not address generative AI systems. These tools inspect structured traffic for misuse patterns but lack semantic awareness for natural language interfaces. This mismatch creates gaps that a dedicated Generative Application Firewall addresses. The Reality of Application Security: If every generative AI application featured perfect security, a GAF would be unnecessary. However, real-world deployments rarely achieve this ideal. Developers often prioritize functionality over security 4 , rush to market, or lack expertise for comprehensive measures. Even well-intentioned teams introduce vulnerabilities through errors or unanticipated attacks. Multi-Application Environments and Policy Enforcement: Environments with multiple generative AI applications amplify complexity. Enterprises deploy chatbots, code tools, content assistants, and analysis agents across departments, each with different models and security. Without centralized security, organizations struggle to ensure consistent policies, prevent compromises, monitor interactions, and respond to threats. Existing security solutions for LLM-based applications remain too fragmented. Prompt filters stop some injection attempts, data-masking layers redact sensitive inputs and outputs, and guardrails confine an application’s functional scope. Each technique is valuable and necessary, yet together they fall short of providing the level of protection that is standard in traditional web applications. What is still missing is a unifying architectural layer that, much as a Web Application Firewall (WAF) coordinates multiple defenses for conventional web traffic, can orchestrate these disparate controls, fill the remaining gaps, and offer engineers a single point of policy enforcement. We refer to this missing layer as the Generative Application Firewall. 3 Generative Application Firewall A Generative Application Firewall (GAF) is a security and control layer designed for applications that expose a natural language interface powered by large language models. It sits between the user and the underlying LLM application, serving as a centralized enforcement point for security policies across all layers of the generative application stack: from network-level controls like rate limiting and access restrictions to semantic-level filtering and context-aware policy enforcement. Unlike prompt-level guardrails, the GAF maintains a holistic view of the application, spanning users, sessions, and interactions over time. Its goal is to unify fragmented protections into a coherent, enforceable perimeter for generative systems. Beyond user-to-LLM prompts, GAF mediates autonomous agents by intercepting agent-initiated tool calls, enforcing per-tool policies, and filtering tool outputs to prevent indirect injection and data poisoning. Motivating example. A user attempts an indirect jailbreak by asking the assistant to "roleplay as a compliance auditor" and then requests detailed steps for constructing an improvised explosive. The Semantic layer flags intent and either blocks or selectively redacts; if the user escalates across turns with euphemisms, the Context layer detects the pattern and terminates streaming mid-generation while logging the event for audit. 3.1 Threat Model GAF protects conversational systems by enforcing policies across inputs, outputs, tools, and longitudinal context. We consider the following elements: Assets. Application tools and actions; retrieval and knowledge bases; user data and PII within context windows; credentials (API keys, OAuth tokens); security policies and allow/deny lists; logs and telemetry; user identities, roles, and rate limits; agent plans/state, tool call graphs, and tool outputs (treated as untrusted inputs). Adversaries. (1) External, unauthenticated actors attempting prompt injection, jailbreaks, scraping, model extraction, and DoS via volumetric or semantic means; (2) Authenticated but malicious or compromised users (insider threats) escalating privileges or abusing sensitive tools; (3) Automated probing and coordinated bots exploring multi - turn bypass strategies; (4) Content supply - chain adversaries poisoning retrieved context or prompts through indirect injection; autonomous agents executing unsafe or unbounded tool sequences; poisoned tool outputs used for indirect injection. Trust boundaries. GAF operates at multiple trust boundaries where security policy must be enforced: End user \leftrightarrow GAF; GAF \leftrightarrow application backend; GAF \leftrightarrow LLM/provider; GAF \leftrightarrow data stores/RAG; GAF \leftrightarrow tool/executor sandboxes; streaming channels (WebSocket/SSE/gRPC) where mid -