LMs as Task-Specific Knowledge Bases: An Interpretability Analysis

Amit Elhelo, Amir Globerson, Mor Geva · 2026

Read LMs as Task-Specific Knowledge Bases: An Interpretability Analysis by Amit Elhelo, Amir Globerson, Mor Geva (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-27237.txt.

Description

Elhelo, Globerson, and Geva test whether language models store facts like a proper knowledge base. A real knowledge base answers every query format from one source of truth, consistently. Models are often described that way, yet the analogy may mislead. Behavioural tracking follows individual facts across training checkpoints of a model. In the 2026 interpretability analysis, facts learned through one task often fail to appear on other tasks at the same training stage.

Parameter localisation experiments point to a mechanism behind that inconsistency. Distinct subsets of parameters underlie different tasks asking about the same fact. Knowledge thus lives in task-specific pockets rather than one shared record. Chain-of-thought reasoning partly works by engaging those extra pockets beyond the target task. Inside its weights, what a model knows is tangled up with how it gets asked. Reliability and controlled editing of model knowledge both look harder under that picture.

Catalog record

CREATORAmit Elhelo, Amir Globerson, Mor Geva
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE73 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.27237

Browse the full library · About the Tower of Babel