Inference-Time Decomposition of Activations (ITDA): A Scalable Approach to Interpreting Large Language Models
Patrick Leask, Neel Nanda, Noura Al Moubayed · 2025
Read Inference-Time Decomposition of Activations (ITDA): A Scalable Approach to Interpreting Large Language Models by Patrick Leask, Neel Nanda, Noura Al Moubayed (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-17769.txt.
Description
Patrick Leask, Neel Nanda, and Noura Al Moubayed present in 2025 a fast way to split the inner signals of large language models into clear parts. The star tool for that task costs much to train and exists for few models. Its parts also fail to move from one model to the next.
Their method builds a word list of signals from prompt data, keeping the worst fit signals at each step. It trains in a hundredth of the time on a hundredth of the data. That let them run it on the largest open models on one home grade chip. Cross model match scores beat past tools.
Catalog record
| CREATOR | Patrick Leask, Neel Nanda, Noura Al Moubayed |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 66 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-17769