Position: Adversarial ML for LLMs Is Not Making Any Progress
Javier Rando, Jie Zhang, Nicholas Carlini, Florian Tramèr · 2025
Read Position: Adversarial ML for LLMs Is Not Making Any Progress by Javier Rando, Jie Zhang, Nicholas Carlini, Florian Tramèr (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-02260.txt.
Description
Javier Rando, Jie Zhang, Nicholas Carlini, and Florian Tramèr argue that attack-proofing language models is stuck. Their position paper, from twenty twenty-five, surveys a decade of work on adversarial machine learning. Even for toy problems, gains have been slow and tests sloppy. The shift to big general language models made things worse, they say.
The problems are now less clearly defined than before. They are also harder to solve and harder still to grade. A claimed defense may fail under a slightly new attack. The authors warn that another decade of the same style may yield little real safety. They call for sharper problem statements and stricter tests.
Catalog record
| CREATOR | Javier Rando, Jie Zhang, Nicholas Carlini, Florian Tramèr |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-02260