AutoRedTeamer : Autonomous Red Teaming with Lifelong Attack Integration
Andy Zhou, Kevin Wu, Francesco Pinto, Zhaorun Chen, Yi Zeng, Yu Yang, Shuang Yang, Sanmi Koyejo, James Zou, Bo Li · 2025
Read AutoRedTeamer : Autonomous Red Teaming with Lifelong Attack Integration by Andy Zhou, Kevin Wu, Francesco Pinto, Zhaorun Chen, Yi Zeng, Yu Yang, Shuang Yang, Sanmi Koyejo, James Zou, Bo Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-15754.txt.
Description
Andy Zhou and nine co-authors automate the adversarial testing of language models in a 2025 paper. Red teaming hunts prompts that make models misbehave, but human-led hunts are slow and yesterday's attacks fade as models change. Their framework runs the hunt end to end with software agents.
One agent builds and fires test cases from broad risk categories alone. A second reads fresh research and codes up newly reported attacks, feeding them into a shared memory that guides which attack to try next. On a standard harm benchmark the system beat rival automated testers by twenty percent in success rate while nearly halving computing cost. Lifelong learning of attacks is the pitch: the tester grows as the threat does.
Catalog record
| CREATOR | Andy Zhou, Kevin Wu, Francesco Pinto, Zhaorun Chen, Yi Zeng, Yu Yang, Shuang Yang, Sanmi Koyejo, James Zou, Bo Li |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 88 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-15754