Granite Guardian
2024
Read Granite Guardian (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-07724.txt.
Description
Inkit Padhi and co-authors introduce a 2024 family of guard models that screen what goes into and out of large language models. Safety filters often miss newer risks, such as jailbreak attempts and the grounding failures that plague retrieval-based systems. The guard models were built to cover those gaps.
They check prompts and replies across many risk types: bias, profanity, violence, sexual content, unethical acts, and jailbreaks. For retrieval systems, they also judge whether a reply stays grounded in its sources and answers the question. Training mixed human labels from varied sources with synthetic examples. Reported scores show strong detection on harmful content and on retrieval-specific tests. The guards can pair with any base model.
Catalog record
| YEAR | 2024 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 86 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-07724