Benchmarking Unlearning for Vision Transformers
Kairan Zhao, Iurie Luca, Peter Triantafillou · 2026
Read Benchmarking Unlearning for Vision Transformers by Kairan Zhao, Iurie Luca, Peter Triantafillou (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-20114.txt.
Description
Models can be made to forget. Machine unlearning removes what training examples contribute when they are incorrect, biased, or leaking private information. It is now seen as critical for safe and fair AI. A 2026 arXiv paper by Kairan Zhao and two co-authors turns to vision transformers, the architecture unlearning research has neglected.
Vision transformers now rival CNNs, yet vision forgetting benchmarks cover language models, diffusion models, and CNNs, not these models. This work builds the first benchmark for them. It tests unlearning methods across model families including ViT, Swin-T, and DINOv2, and across different sizes. Datasets vary in scale and difficulty. Methods represent basically different approaches. Both single-shot and ongoing unlearning setups are used. The paper also focuses on algorithms that use extra structure.
Catalog record
| CREATOR | Kairan Zhao, Iurie Luca, Peter Triantafillou |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 61 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-20114