How Many Features Can a Language Model Store Under the Linear Representation Hypothesis?

Nikhil Garg, Jon Kleinberg, Kenny Peng · 2026

Read How Many Features Can a Language Model Store Under the Linear Representation Hypothesis? by Nikhil Garg, Jon Kleinberg, Kenny Peng (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-11246.txt.

Description

How many traits can a layer store if decoding must stay straight? Nikhil Garg and two co-authors build a math frame for the straight form idea, splitting it into straight code and straight decoding. Classic compressed sensing answers the question when decoding may be curved.

Requiring straight decoding changes the problem fundamentally. The authors prove nearly matching upper and lower bounds for straight compressed sensing, showing a measured gap from the classic case. The upper bound confirms that neurons can store an exponential number of traits under the idea, supporting overlap. The lower bound uses rank arguments for near-identity matrices and a graph theorem, and extensions cover decoders with signal and bias.

Catalog record

CREATORNikhil Garg, Jon Kleinberg, Kenny Peng
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-11246

Browse the full library · About the Tower of Babel