AutoRedTeamer : Autonomous Red Teaming with Lifelong Attack Integration

Andy Zhou, Kevin Wu, Francesco Pinto, Zhaorun Chen, Yi Zeng, Yu Yang, Shuang Yang, Sanmi Koyejo, James Zou, Bo Li · 2025

Read AutoRedTeamer : Autonomous Red Teaming with Lifelong Attack Integration by Andy Zhou, Kevin Wu, Francesco Pinto, Zhaorun Chen, Yi Zeng, Yu Yang, Shuang Yang, Sanmi Koyejo, James Zou, Bo Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-15754.txt.

Description

Andy Zhou and nine co-authors automate the adversarial testing of language models in a 2025 paper. Red teaming hunts prompts that make models misbehave, but human-led hunts are slow and yesterday's attacks fade as models change. Their framework runs the hunt end to end with software agents.

One agent builds and fires test cases from broad risk categories alone. A second reads fresh research and codes up newly reported attacks, feeding them into a shared memory that guides which attack to try next. On a standard harm benchmark the system beat rival automated testers by twenty percent in success rate while nearly halving computing cost. Lifelong learning of attacks is the pitch: the tester grows as the threat does.

Catalog record

CREATORAndy Zhou, Kevin Wu, Francesco Pinto, Zhaorun Chen, Yi Zeng, Yu Yang, Shuang Yang, Sanmi Koyejo, James Zou, Bo Li
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE88 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-15754

Browse the full library · About the Tower of Babel