Inference-Time Decomposition of Activations (ITDA): A Scalable Approach to Interpreting Large Language Models

Patrick Leask, Neel Nanda, Noura Al Moubayed · 2025

Read Inference-Time Decomposition of Activations (ITDA): A Scalable Approach to Interpreting Large Language Models by Patrick Leask, Neel Nanda, Noura Al Moubayed (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-17769.txt.

Description

Patrick Leask, Neel Nanda, and Noura Al Moubayed present in 2025 a fast way to split the inner signals of large language models into clear parts. The star tool for that task costs much to train and exists for few models. Its parts also fail to move from one model to the next.

Their method builds a word list of signals from prompt data, keeping the worst fit signals at each step. It trains in a hundredth of the time on a hundredth of the data. That let them run it on the largest open models on one home grade chip. Cross model match scores beat past tools.

Catalog record

CREATORPatrick Leask, Neel Nanda, Noura Al Moubayed
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE66 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-17769

Browse the full library · About the Tower of Babel