Provably effective detection of effective data poisoning attacks

Yasaman Esfandiari, Jonathan Gallagher, Callen MacPhee, Michael A. Warren · 2025

Read Provably effective detection of effective data poisoning attacks by Yasaman Esfandiari, Jonathan Gallagher, Callen MacPhee, Michael A. Warren (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-11795.txt.

Description

In 2025, the authors prove a strong claim about data poisoning. An attack of this kind can be found if it truly works. To poison data is to change training data in secret so a model learns the wrong behavior. The team gives a precise math definition of such an attack. They build a statistical test to find these attacks. The test is called the Conformal Separability Test.

Their proof shows the point is built into the structure of the attack. A poison attack that works must leave a trace that can be found. Tests in the real world back the proof, as the method caught real attempts well enough. This changes how defense can work. An attacker cannot hide the harm without making the attack weaker. Tools to find attacks can rest on firm proof, not just rules of thumb.

Catalog record

CREATORYasaman Esfandiari, Jonathan Gallagher, Callen MacPhee, Michael A. Warren
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE88 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-11795

Browse the full library · About the Tower of Babel