Constitutional Classifiers: Defending against Universal Jailbreaks across Thousands of Hours of Red Teaming

Mrinank Sharma Meg Tong Jesse Mu Jerry Wei Jorrit Kruthoff Scott Goodfriend Euan Ong Alwin Peng Raj Agarwal Cem Anil Amanda Askell Nathan Bailey Joe Benton Emma Bluemke Samuel R. Bowman Eric Christiansen Hoagy Cunningham Andy Dau Anjali Gopal Rob Gilson Logan Graham Logan Howard Nimit Kalra Taesung · 2025

Read Constitutional Classifiers: Defending against Universal Jailbreaks across Thousands of Hours of Red Teaming by Mrinank Sharma Meg Tong Jesse Mu Jerry Wei Jorrit Kruthoff Scott Goodfriend Euan Ong Alwin Peng Raj Agarwal Cem Anil Amanda Askell Nathan Bailey Joe Benton Emma Bluemke Samuel R. Bowman Eric Christiansen Hoagy Cunningham Andy Dau Anjali Gopal Rob Gilson Logan Graham Logan Howard Nimit Kalra Taesung (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-18837.txt.

Introduction

Mrinank Sharma and co-authors introduce classifier guards that defend language models against universal jailbreaks. Their 2025 paper deals with prompts crafted to bypass safety rules across many queries. Such jailbreaks can enable harmful multi step processes. The guards are trained on synthetic data made by asking models to follow a written constitution. The constitution states what content is allowed and what is restricted.

Red teamers spent an estimated three thousand hours attacking an early guarded model. None found a universal jailbreak that extracted detail matching an unguarded model on most targets. On automated tests, stronger classifiers held up against held out attack types. The cost in normal use was small: refusals on real traffic rose by 0.38 percentage points. Inference cost rose by about twenty four percent. The authors argue such guards can be deployed viably.

Catalog record

CREATORMrinank Sharma Meg Tong Jesse Mu Jerry Wei Jorrit Kruthoff Scott Goodfriend Euan Ong Alwin Peng Raj Agarwal Cem Anil Amanda Askell Nathan Bailey Joe Benton Emma Bluemke Samuel R. Bowman Eric Christiansen Hoagy Cunningham Andy Dau Anjali Gopal Rob Gilson Logan Graham Logan Howard Nimit Kalra Taesung
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE184 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-18837

Browse the full library · About the Tower of Babel