Position: Adversarial ML for LLMs Is Not Making Any Progress

Javier Rando, Jie Zhang, Nicholas Carlini, Florian Tramèr · 2025

Read Position: Adversarial ML for LLMs Is Not Making Any Progress by Javier Rando, Jie Zhang, Nicholas Carlini, Florian Tramèr (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-02260.txt.

Description

Javier Rando, Jie Zhang, Nicholas Carlini, and Florian Tramèr argue that attack-proofing language models is stuck. Their position paper, from twenty twenty-five, surveys a decade of work on adversarial machine learning. Even for toy problems, gains have been slow and tests sloppy. The shift to big general language models made things worse, they say.

The problems are now less clearly defined than before. They are also harder to solve and harder still to grade. A claimed defense may fail under a slightly new attack. The authors warn that another decade of the same style may yield little real safety. They call for sharper problem statements and stricter tests.

Catalog record

CREATORJavier Rando, Jie Zhang, Nicholas Carlini, Florian Tramèr
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-02260

Browse the full library · About the Tower of Babel