Agenda-based Narrative Extraction: Steering Pathfinding Algorithms with Large Language Models
Brian Felipe Keith-Norambuena, Carolina Inés Rojas-Córdova, Claudio Juvenal Meneses-Villegas, Elizabeth Johanna Lam-Esquenazi, Angélica María Flores-Bustos, Ignacio Alejandro Molina-Villablanca, Joshua Emanuel Leyton-Vallejos · 2026
Read Agenda-based Narrative Extraction: Steering Pathfinding Algorithms with Large Language Models by Brian Felipe Keith-Norambuena, Carolina Inés Rojas-Córdova, Claudio Juvenal Meneses-Villegas, Elizabeth Johanna Lam-Esquenazi, Angélica María Flores-Bustos, Ignacio Alejandro Molina-Villablanca, Joshua Emanuel Leyton-Vallejos (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-29661.txt.
Introduction
Keith-Norambuena and co-authors add agenda steering to narrative extraction from document sets. Older methods trade off coherence, interaction, and multi-story support. Their method guides a pathfinding tool with a language model. At each step, the model ranks candidate documents by fit to a user's agenda. The storyline bends toward that agenda while coherence is guarded. Other agendas yield other storylines through the same corpus. Judges rated agenda fit higher than with keyword matching. The coherence cost stayed small in their tests.
Catalog record
| CREATOR | Brian Felipe Keith-Norambuena, Carolina Inés Rojas-Córdova, Claudio Juvenal Meneses-Villegas, Elizabeth Johanna Lam-Esquenazi, Angélica María Flores-Bustos, Ignacio Alejandro Molina-Villablanca, Joshua Emanuel Leyton-Vallejos |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40275 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.29661
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Agenda-based Narrative Extraction: Steering Pathfinding Algorithms with Large Language Models Brian Felipe Keith-Norambuena, Carolina Inés Rojas-Córdova, Claudio Juvenal Meneses-Villegas, Elizabeth Johanna Lam-Esquenazi, Angélica María Flores-Bustos, Ignacio Alejandro Molina-Villablanca, Joshua Emanuel Leyton-Vallejos Abstract Existing narrative extraction methods face a trade-off between coherence, interactivity, and multi-storyline support. Narrative Maps supports rich interaction and generates multiple storylines as a byproduct of its coverage constraints, though this comes at the cost of individual path coherence. Narrative Trails achieves high coherence through maximum capacity path optimization but provides no mechanism for user guidance or multiple perspectives. We introduce agenda-based narrative extraction, a method that bridges this gap by integrating large language models into the Narrative Trails pathfinding process to steer storyline construction toward user-specified perspectives. Our approach uses an LLM at each step to rank candidate documents based on their alignment with a given agenda while maintaining narrative coherence. Running the algorithm with different agendas yields different storylines through the same corpus. We evaluated our approach on a news article corpus using LLM judges with Claude Opus 4.5 and GPT 5.1, measuring both coherence and agenda alignment across 64 endpoint pairs and 6 agendas. LLM-driven steering achieves 9.9% higher alignment than keyword matching on semantic agendas ( p = 0.017 p=0.017 ), with 13.3% improvement on Regime Crackdown specifically ( p = 0.037 p=0.037 ), while keyword matching remains competitive on agendas with literal keyword overlap. The coherence cost is minimal: LLM steering reduces coherence by only 2.2% compared to the agenda-agnostic baseline. Counter-agendas that contradict the source material score uniformly low (2.2-2.5) across all methods, confirming that steering cannot fabricate unsupported narratives. [orcid=0000-0001-5734-8962, [email protected], ] *1 [orcid=0000-0002-9751-3587, ] [orcid=0000-0003-1112-4925, ] [orcid=0000-0002-0388-4660, ] [orcid=0009-0007-8989-6809, ] [orcid=0009-0003-0535-5521, ] [orcid=0009-0006-4535-623X, ] keywords Narrative Extraction ,Large Language Models ,Pathfinding Algorithms ,Coherence Graph ,Information Retrieval † † copyrightyear: 2026 † † copyright: Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0). † † venue: R. Campos, A. Jorge, A. Jatowt, S. Bhatia, M. Litvak (eds.): Proceedings of the Text2Story’26 Workshop, Delft (The Netherlands), 29-March-2026 † † address: Department of Computing and Systems Engineering, Universidad Católica del Norte, Antofagasta, Chile † † address: Department of Industrial Engineering, Universidad Católica del Norte, Antofagasta, Chile † † address: Department of Chemical and Environmental Engineering, Universidad Católica del Norte, Antofagasta, Chile † † corresp: Corresponding author. 1 Introduction Narrative extraction from document collections has become an area of interest for applications ranging from news summarization 29 ; 36 to intelligence analysis 22 . By organizing documents into coherent storylines, these methods help users understand relationships and progressions within large datasets 10 ; 9 . Our work falls within the event-based narrative extraction paradigm 10 , where we operationalize events at the document level: each document represents a single event, and a narrative is a temporally ordered, thematically coherent sequence of such document-events. Prior work has proposed several approaches for extracting document-level storylines. Connect the Dots 27 finds chains between fixed endpoints that maximize word-based coherence. Narrative Maps 12 extends this to directed acyclic graphs with multiple interconnected storylines, using linear programming to balance coherence with corpus coverage; its visualization interface supports rich user interaction through semantic operations like grouping events and adjusting connections. Other methods include Metro Maps 26 , which constructs multi-storyline visualizations, and newsLens 13 , which builds parallel timelines across datasets. More recently, Narrative Trails 6 operates on a coherence graph—where documents are nodes and edge weights quantify how well one document follows another—and finds the maximum capacity path, the route where the weakest connection is as strong as possible. This bottleneck formulation ensures no narrative transition falls below a quality threshold, producing highly coherent individual storylines but offering no mechanism for user guidance or alternative perspectives. These approaches occupy different points in a design space defined by coherence, interactivity, and multi-storyline support. Narrative Maps enables interaction and naturally produces multiple storylines through coverage constraints, but its optimization can yield less coherent individual paths. Narrative Trails achieves high coherence through direct path optimization, but produces a single deterministic output with no way to incorporate user perspective or generate alternative framings of the same events. In this paper, we introduce agenda-based narrative extraction , a method that bridges this gap. Our approach preserves the coherence properties of Narrative Trails while introducing interactivity through user-defined agendas —natural language descriptions of the perspective the user wishes to explore. By integrating a large language model into the pathfinding process 38 ; 7 , we enable the algorithm to steer toward documents that support the specified agenda. Running the algorithm with different agendas yields different storylines through the same corpus, enabling the kind of multi-perspective exploration that Narrative Maps achieves through coverage constraints, but via user-specified framing rather than algorithmic diversification. Thus, our work addresses two research questions. First, we investigate whether LLM-guided steering can produce narratives that align with specified agendas while maintaining coherence (RQ1). Second, we examine the trade-off between agenda alignment and narrative coherence (RQ2). The remainder of this paper is organized as follows. Section 2 reviews related work on narrative extraction and LLM-guided systems. Section 3 describes our agenda-driven pathfinding method and evaluation framework. Section 4 reports our findings, including sensitivity analysis. Section 5 discusses implications and limitations, and Section 6 concludes. 2 Related Work Computational Narrative Extraction. Computational narrative extraction encompasses methods for identifying and structuring storylines from document collections 10 ; 22 ; 24 ; 9 . Connect the Dots 27 formulates narrative extraction as finding chains between fixed endpoints that maximize word-based coherence constraints. Narrative Maps 12 extends this to directed acyclic graphs with multiple interconnected storylines, using linear programming to balance coherence and coverage. Metro Maps 25 similarly constructs multi-storyline visualizations. The newsLens algorithm 14 builds parallel timelines across entire datasets. Recent work has explored event-centric knowledge graphs for narrative construction 37 and multilingual narrative extraction from news 30 . None of these methods, however, allow the user to inject a particular viewpoint or framing into the extraction itself. LLM-Guided Systems. LLMs have recently shown promise as ranking agents in retrieval pipelines 40 ; 15 . Sun et al. 31 found that GPT-class models re-rank search results competitively with supervised baselines; Qin et al. 21 pushed this further by showing that framing the task as pairwise comparisons yields better rankings than pointwise scoring. The LLM-as-a-judge paradigm has been validated for evaluating text quality 39 , and Keith 8 specifically validates LLM judges as proxies for mathematical coherence measures in narrative extraction. We build on these findings but shift the goal: rather than improving relevance, we use the LLM to bias path selection toward a user-chosen narrative framing. Interactive Narrative Analytics. Interactive narrative analytics encompasses systems that allow analysts to explore and refine extracted storylines 9 ; key challenges include bridging computational extraction methods with human sensemaking processes. The Narrative Maps Visualization Tool (NMVT) 19 provides semantic interaction capabilities where analysts can group events, adjust connections, and iteratively refine narrative structures. Such systems support sensemaking workflows 4 where analysts move between foraging for information and synthesizing coherent explanations 20 . However, existing interactive systems require manual manipulation of graph structures; our approach provides interactivity through natural language agendas