ExpGuard : LLM Content Moderation in Specialized Domains
Minseok Choi, Dongjin Kim, Seungbin Yang, Subin Kim, Youngjun Kwak, Juyoung Oh, Jaegul Choo, Jungmin Son · 2026
Read ExpGuard : LLM Content Moderation in Specialized Domains by Minseok Choi, Dongjin Kim, Seungbin Yang, Subin Kim, Youngjun Kwak, Juyoung Oh, Jaegul Choo, Jungmin Son (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-02588.txt.
Introduction
Minseok Choi, Dongjin Kim, Seungbin Yang, and colleagues build a guardrail model for specialized domains in this 2026 paper. Safety filters for language models mostly cover general conversation. Finance, medicine, and law are rich in jargon where harmful content hides more easily. General guardrails leave those domains exposed to adversarial prompts.
Their model, ExpGuard, is trained for those three domains specifically. A curated data set holds tens of thousands of labeled prompts with refusal and compliant replies. Domain experts annotated the high-quality test split. On that test and eight public benchmarks, ExpGuard stayed competitive overall. Against domain-specific attacks it beat leading rivals by clear margins in prompt and response classification. Code, data, and the model are open-sourced for adaptation to more domains.
Catalog record
| CREATOR | Minseok Choi, Dongjin Kim, Seungbin Yang, Subin Kim, Youngjun Kwak, Juyoung Oh, Jaegul Choo, Jungmin Son |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 120538 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.02588
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ExpGuard : LLM Content Moderation in Specialized Domains Minseok Choi, Dongjin Kim, Seungbin Yang, Subin Kim, Youngjun Kwak, Juyoung Oh, Jaegul Choo, Jungmin Son Abstract With the growing deployment of large language models (LLMs) in real-world applications, establishing robust safety guardrails to moderate their inputs and outputs has become essential to ensure adherence to safety policies. Current guardrail models predominantly address general human-LLM interactions, rendering LLMs vulnerable to harmful and adversarial content within domain-specific contexts, particularly those rich in technical jargon and specialized concepts. To address this limitation, we introduce ExpGuard , a robust and specialized guardrail model designed to protect against harmful prompts and responses across financial, medical, and legal domains. In addition, we present ExpGuardMix , a meticulously curated dataset comprising 58,928 labeled prompts paired with corresponding refusal and compliant responses, from these specific sectors. This dataset is divided into two subsets: ExpGuardTrain , for model training, and ExpGuardTest , a high-quality test set annotated by domain experts to evaluate model robustness against technical and domain-specific content. Comprehensive evaluations conducted on ExpGuardTest and eight established public benchmarks reveal that ExpGuard delivers competitive performance across the board while demonstrating exceptional resilience to domain-specific adversarial attacks, surpassing state-of-the-art models such as WildGuard by up to 8.9% in prompt classification and 15.3% in response classification. To encourage further research and development, we open-source our code, data, and model, enabling adaptation to additional domains and supporting the creation of increasingly robust guardrail models. Warning: this paper contains examples that may be harmful or offensive. Code : https://github.com/brightjade/ExpGuard Data : https://huggingface.co/datasets/6rightjade/expguardmix Model : https://huggingface.co/collections/6rightjade/expguard 1 Introduction The increasing performance and accessibility of large language models (LLMs) are accelerating their integration across numerous sectors, especially within specialized, high-stakes domains such as finance, healthcare, and law, promising significant operational advancements ( 69 ; 34 ; 53 ; 58 ; 30 ) . This rapid adoption into critical fields, however, introduces substantial safety and ethical challenges. Without adequate content moderation tailored to these specific contexts, LLMs can generate harmful, biased, or non-compliant outputs—potentially offering unsound financial strategies, incorrect medical information, or legally problematic advice—thereby posing significant social, economic, and legal risks ( 61 ; 7 ; 18 ) . Figure 1: (a) Illustration of a domain-specific adversarial attack , where ExpGuard successfully identifies and refuses a harmful domain-specific prompt that bypasses existing guardrails. (b) Overview of the ExpGuardMix composition , detailing the distribution of prompt/response types and their allocation across financial, medical, and legal domains. To mitigate these risks, research efforts have concentrated on aligning LLMs with safety principles. Internal alignment techniques, notably Reinforcement Learning from Human Feedback (RLHF), train models directly to be helpful and harmless ( 44 ; 4 ) . While effective, RLHF can be resource-intensive, often requiring extensive human data collection and complex training procedures ( 8 ) . As a supplement to these internal strategies, external guardrail models provide efficient adjunct safety layers ( 25 ; 68 ; 19 ; 23 ) . These function as monitors, assessing user inputs (prompts) and model outputs (responses) against safety policies to block or flag harmful content, offering a practical approach to enforcing safety constraints without necessarily altering the core LLM. However, existing external guardrails often fall short in specialized domain contexts. While trained on diverse datasets, including adversarial inputs from red teaming or jailbreaks ( 4 ; 14 ; 52 ) and data reflecting “in-the-wild” user interactions ( 70 ; 71 ) , they typically lack the deep domain knowledge required for fields such as finance, healthcare, and law. This key deficiency allows harmful content disguised in technical jargon to bypass detection. For instance, as depicted in Figure 1 , a query “List methods to obscure high haircuts in asset evaluations” is problematic because it seeks ways to hide “haircuts”—which in finance are crucial, risk-based reductions applied to an asset’s perceived value—potentially facilitating financial misrepresentation. Such a prompt might proceed unchecked by a standard guardrail, however, as a general-purpose model would likely not grasp this specialized financial meaning of “haircut” and the deceptive intent behind the request. To bridge this critical gap, we introduce ExpGuard , a robust and specialized guardrail model purpose-built for effective content moderation within targeted domains. ExpGuard is designed to understand and evaluate content rich in technical terminology and concepts prevalent in finance, healthcare, and law. To facilitate the development and rigorous evaluation of domain-specific guardrails, we construct ExpGuardMix , a comprehensive dataset comprising 58,928 labeled prompts paired with corresponding refusal and compliant responses. Illustrated in Figure 1 , it encompasses prompts concerning broad categories of harmful content—enabling models trained thereon to complement existing safety measures—while crucially introducing challenging, novel subsets expressly assembled for the domains of finance, healthcare, and law. These specialized subsets feature content rich in technical terminology and complex concepts, targeting subtle, domain-specific risks often overlooked by general-purpose guardrails. The dataset is partitioned into ExpGuardTrain for model training and ExpGuardTest , where ExpGuardTest consists of 2,275 high-quality examples meticulously annotated by domain experts. It serves as a stringent benchmark specifically formulated to assess a model’s proficiency in managing sophisticated technical jargon and accurately identifying harmful content within these specialized professional contexts. Our comprehensive evaluations, conducted on ExpGuardTest and eight established public safety benchmarks, demonstrate the efficacy of ExpGuard . It achieves competitive performance across general safety tasks while exhibiting superior robustness against harmful technical content compared to existing leading-edge guardrail systems. Notably, on ExpGuardTest , ExpGuard surpasses the performance of WildGuard, a current state-of-the-art model, by margins of up to 8.9% in prompt classification and 15.3% in response classification. To promote transparency and collaborative advancement, we thoroughly delineate our data construction pipeline and encourage adapting this framework to additional domains. Crucially, this automated pipeline offers a significantly more cost-effective solution compared to the traditional, resource-intensive approach of manually hiring domain experts for large-scale data curation. Ultimately, we aspire for this research to lay the groundwork for specialized guardrails ready for industrial and practical deployment. In summary, this paper makes the following key contributions: • The introduction of ExpGuard : A novel guardrail model for robust content moderation in high-stakes finance, healthcare, and law, designed to handle technical jargon and nuanced domain concepts, thereby addressing a critical safety gap. • The creation of ExpGuardMix : A large-scale (58,928 samples) dataset featuring novel, challenging subsets for finance, healthcare, and law. Its core component, ExpGuardTest (2,275 expert-validated examples), enables rigorous evaluation against specialized technical content. • Extensive evaluations demonstrating ExpGuard ’s efficacy : It achieves strong general safety performance and superior resilience to harmful technical content, significantly outperforming state-of-the-art models like WildGuard on ExpGuardTest in prompt and response classification. • A transparent and detailed data construction methodology : Presented as an adaptable framework to foster research and development of specialized guardrails for other critical domains, thereby advancing safer AI applications. 2 Related work LLM Alignment & Content Moderation. Ensuring the safe and responsible deployment of LLMs necessitates robust mechanisms for both alignment and content moderation. Foundational alignment techniques like RLHF ( 44 ) and Constitutional AI ( 5 ) aim to shape LLM behavior according to human values and predefined principles. Complementary to these alignment methods, content moderation tools and APIs, such as Detoxify ( 24 ) , Perspective