Benchmarking Unlearning for Vision Transformers

Kairan Zhao, Iurie Luca, Peter Triantafillou · 2026

Read Benchmarking Unlearning for Vision Transformers by Kairan Zhao, Iurie Luca, Peter Triantafillou (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-20114.txt.

Description

Models can be made to forget. Machine unlearning removes what training examples contribute when they are incorrect, biased, or leaking private information. It is now seen as critical for safe and fair AI. A 2026 arXiv paper by Kairan Zhao and two co-authors turns to vision transformers, the architecture unlearning research has neglected.

Vision transformers now rival CNNs, yet vision forgetting benchmarks cover language models, diffusion models, and CNNs, not these models. This work builds the first benchmark for them. It tests unlearning methods across model families including ViT, Swin-T, and DINOv2, and across different sizes. Datasets vary in scale and difficulty. Methods represent basically different approaches. Both single-shot and ongoing unlearning setups are used. The paper also focuses on algorithms that use extra structure.

Catalog record

CREATORKairan Zhao, Iurie Luca, Peter Triantafillou
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE61 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-20114

Browse the full library · About the Tower of Babel