Stories in Space: In-Context Learning Trajectories in Conceptual Belief Space

Eric Bigelow Raphaël Sarfati Daniel Wurgaft Owen Lewis Thomas McGrath Jack Merullo Atticus Geiger † Ekdeep Singh Lubana † † Equal senior contribution https://conceptual-beliefs.streamlit.app · 2026

Read Stories in Space: In-Context Learning Trajectories in Conceptual Belief Space by Eric Bigelow Raphaël Sarfati Daniel Wurgaft Owen Lewis Thomas McGrath Jack Merullo Atticus Geiger † Ekdeep Singh Lubana † † Equal senior contribution https://conceptual-beliefs.streamlit.app (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-12412.txt.

Description

Bigelow and seven colleagues picture in-context learning as travel through a belief space. They propose that a language model holds beliefs over a low-dimensional space of concepts. Each new story detail moves its position along a path in that space. Combining behaviour tests with checks of internal representations on story understanding, they find those paths lie on structured, low-dimensional shapes. Simple linear probes can read the position and predict behaviour. Targeted interventions steer the path in ways the shape predicts.

Catalog record

CREATOREric Bigelow Raphaël Sarfati Daniel Wurgaft Owen Lewis Thomas McGrath Jack Merullo Atticus Geiger † Ekdeep Singh Lubana † † Equal senior contribution https://conceptual-beliefs.streamlit.app
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41720
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.12412

Browse the full library · About the Tower of Babel