Parameter-Efficient Token Embedding Editing for Clinical Class-Level Unlearning

Iyad Ait Hou 1, Shrenik Borad 1, Harsh Sharma 1, Pooja Srinivasan 1, Rebecca Hwa 1, Aya Zirikly 1 , 2 {}^{1},^{2} · 2026

Read Parameter-Efficient Token Embedding Editing for Clinical Class-Level Unlearning by Iyad Ait Hou 1, Shrenik Borad 1, Harsh Sharma 1, Pooja Srinivasan 1, Rebecca Hwa 1, Aya Zirikly 1 , 2 {}^{1},^{2} (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-19302.txt.

Description

Hou and co-authors erase one class of behavior from a clinical language model by editing very few weights. Their STEU method picks key tokens by a mutual information score. Only those token embeddings and a small classifier head are updated. All deeper encoder layers stay frozen. On MIMIC and eICU data, the target class is nearly wiped out. In the main test, forget F1 falls to 0.0004 while kept-task scores stay sound. Just 0.19 percent of weights are changed.

Catalog record

CREATORIyad Ait Hou 1, Shrenik Borad 1, Harsh Sharma 1, Pooja Srinivasan 1, Rebecca Hwa 1, Aya Zirikly 1 , 2 {}^{1},^{2}
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29454
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.19302

Browse the full library · About the Tower of Babel