Attention Flows: Tracing LLM Conceptual Engagement via Story Summaries
Rebecca M. M. Hicke, Sil Hamilton, David Mimno, Ross Deans Kristensen-McLachlan · 2026
Read Attention Flows: Tracing LLM Conceptual Engagement via Story Summaries by Rebecca M. M. Hicke, Sil Hamilton, David Mimno, Ross Deans Kristensen-McLachlan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-06416.txt.
Description
Hicke, Hamilton, Mimno, and Kristensen-McLachlan test whether language models track human conceptual engagement through novel summaries. Human writers compress stories to reveal narrative priorities, so summary gaps show where models miss human focus. The team aligns sentences from 150 human novel summaries with their chapters, a hard task showing summarization's complexity. They then align nine leading models' summaries for each text, finding stylistic gaps and models weighting text endings. Comparing human engagement with model attention points to reasons for weaker grasp and targets, and the team releases its dataset.
Catalog record
| CREATOR | Rebecca M. M. Hicke, Sil Hamilton, David Mimno, Ross Deans Kristensen-McLachlan |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 158881 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.06416