Activation Space Interventions Can Be Transferred Between Large Language Models

Narmeen Fatimah Oozeer, Dhruv Nathawani, Nirmalendu Prakash, Michael Lan, Abir Harrasse, Amir Abdullah · 2025

Read Activation Space Interventions Can Be Transferred Between Large Language Models by Narmeen Fatimah Oozeer, Dhruv Nathawani, Nirmalendu Prakash, Michael Lan, Abir Harrasse, Amir Abdullah (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-04429.txt.

Description

Narmeen Oozeer and co-authors show that a safety tweak learned inside one language model can be transplanted into another. Models increasingly share representational geometry, and the team exploits it: learn a mapping between two models' activation spaces, then carry steering vectors across.

Two established safety tasks prove the point, backdoor removal and refusal of harmful prompts, with steering transferring predictably between models. A third, invented task, corrupted capabilities, hides knowledge behind a backdoor so the model must keep the skill while shedding the trigger. Across the Llama, Qwen, and Gemma families, small models could align larger ones this way. Autoencoder mappings between base and tuned models even act as lightweight switches, toggling behavior on demand.

Catalog record

CREATORNarmeen Fatimah Oozeer, Dhruv Nathawani, Nirmalendu Prakash, Michael Lan, Abir Harrasse, Amir Abdullah
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE187 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-04429

Browse the full library · About the Tower of Babel