Parameter-Efficient Token Embedding Editing for Clinical Class-Level Unlearning
Iyad Ait Hou 1, Shrenik Borad 1, Harsh Sharma 1, Pooja Srinivasan 1, Rebecca Hwa 1, Aya Zirikly 1 , 2 {}^{1},^{2} · 2026
Read Parameter-Efficient Token Embedding Editing for Clinical Class-Level Unlearning by Iyad Ait Hou 1, Shrenik Borad 1, Harsh Sharma 1, Pooja Srinivasan 1, Rebecca Hwa 1, Aya Zirikly 1 , 2 {}^{1},^{2} (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-19302.txt.
Description
Hou and co-authors erase one class of behavior from a clinical language model by editing very few weights. Their STEU method picks key tokens by a mutual information score. Only those token embeddings and a small classifier head are updated. All deeper encoder layers stay frozen. On MIMIC and eICU data, the target class is nearly wiped out. In the main test, forget F1 falls to 0.0004 while kept-task scores stay sound. Just 0.19 percent of weights are changed.
Catalog record
| CREATOR | Iyad Ait Hou 1, Shrenik Borad 1, Harsh Sharma 1, Pooja Srinivasan 1, Rebecca Hwa 1, Aya Zirikly 1 , 2 {}^{1},^{2} |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29454 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.19302