Model Immunization from a Condition Number Perspective
Amber Yijia Zheng, Cedar Site Bai, Brian Bullins, Raymond A. Yeh · 2025
Read Model Immunization from a Condition Number Perspective by Amber Yijia Zheng, Cedar Site Bai, Brian Bullins, Raymond A. Yeh (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-23760.txt.
Description
Amber Yijia Zheng and co-authors reframed model immunization in a 2025 paper. Immunization means pre-training a model so that it resists later tuning toward harmful tasks, while staying useful for fair ones. It had been shown to work for image models, but when it can work, and what counts as immunized, lacked sharp terms.
Their frame reads the problem through the condition number of a curvature matrix, which gauges how touchy a model is to tuning. An algorithm then sets those numbers during pre-training by added penalty terms. Tests on plain linear models and deep nets back the frame. It gives builders a dial for safe-by-design models.
Catalog record
| CREATOR | Amber Yijia Zheng, Cedar Site Bai, Brian Bullins, Raymond A. Yeh |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 114 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-23760