Activation Space Interventions Can Be Transferred Between Large Language Models
Narmeen Fatimah Oozeer, Dhruv Nathawani, Nirmalendu Prakash, Michael Lan, Abir Harrasse, Amir Abdullah · 2025
Read Activation Space Interventions Can Be Transferred Between Large Language Models by Narmeen Fatimah Oozeer, Dhruv Nathawani, Nirmalendu Prakash, Michael Lan, Abir Harrasse, Amir Abdullah (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-04429.txt.
Description
Narmeen Oozeer and co-authors show that a safety tweak learned inside one language model can be transplanted into another. Models increasingly share representational geometry, and the team exploits it: learn a mapping between two models' activation spaces, then carry steering vectors across.
Two established safety tasks prove the point, backdoor removal and refusal of harmful prompts, with steering transferring predictably between models. A third, invented task, corrupted capabilities, hides knowledge behind a backdoor so the model must keep the skill while shedding the trigger. Across the Llama, Qwen, and Gemma families, small models could align larger ones this way. Autoencoder mappings between base and tuned models even act as lightweight switches, toggling behavior on demand.
Catalog record
| CREATOR | Narmeen Fatimah Oozeer, Dhruv Nathawani, Nirmalendu Prakash, Michael Lan, Abir Harrasse, Amir Abdullah |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 187 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-04429