Structure Liberates: How Constrained Sensemaking Produces More Novel Research Output

James Mooney, Zae Myung Kim, Young-Jun Lee, Dongyeop Kang · 2026

Read Structure Liberates: How Constrained Sensemaking Produces More Novel Research Output by James Mooney, Zae Myung Kim, Young-Jun Lee, Dongyeop Kang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-00557.txt.

Introduction

James Mooney and 3 co-authors test a counterintuitive claim about research agents: tighter structure in the thinking phase produces more novel science, not less. Language-model research systems usually treat ideation, surveying literature, forming hypotheses, refining reasoning, as a brief prelude. Their framework, SciSense, instead runs ideation as a structured sequence of eight cognitive stages drawn from classic sensemaking research.

They build 120 thousand research trajectories, each conditioned on a paper's citations. In hindsight mode a model reconstructs the path to a known paper; in foresight mode it proposes new directions from the same sources. Models trained on hindsight beat foresight-trained ones on trajectory quality and produced more novel, diverse outputs across every model family tested. Coding agents fed hindsight trajectories also built research artifacts that ran better and were more useful. Outcome-anchored ideation, the authors argue, frees downstream agents to explore.

Catalog record

CREATORJames Mooney, Zae Myung Kim, Young-Jun Lee, Dongyeop Kang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE81 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.00557

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Structure Liberates: How Constrained Sensemaking Produces More Novel Research Output James Mooney, Zae Myung Kim, Young-Jun Lee, Dongyeop Kang Abstract Scientific discovery is an extended process of ideation—surveying prior work, forming hypotheses, and refining reasoning—yet existing approaches treat this phase as a brief preamble despite its central role in research. We introduce SciSense , a sensemaking-grounded framework that operationalizes ideation as a structured sequence of eight cognitive stages ( 13 ) . We construct SciSense -Traj, a 100K-scale dataset of citation-conditioned research trajectories in two modes: Target , where an LLM reconstructs the ideation path leading to a known paper from its cited works, and Infer , where the LLM proposes novel directions from the same citations. We distill these into SciSense -LM, a family of sensemaking LLMs spanning 3B to 70B parameters. Contrary to the assumption that looser supervision promotes greater exploration, Target -trained models achieve a 2.0% improvement in trajectory quality over Infer -trained models while also producing more novel and diverse outputs. This advantage propagates downstream: coding agents conditioned on Target trajectories produce research artifacts with higher executability and quality than those conditioned on Infer trajectories. This suggests that targeted ideation reduces cognitive burden on downstream agents, freeing them to explore more creatively. SciSense offers both a practical tool for augmenting LLM-driven research workflows and a principled testbed for studying how planning shapes scientific discovery. 1 Introduction Scientific discovery has long been a key driver of human progress, characterized by an iterative refinement loop involving the surveying of prior work, hypothesis formation, reasoning refinement, and implementation. Recently, LLM-driven research agents ( 10 ; 7 ; 21 ; 3 ; 14 ) have demonstrated substantial progress on scientific discovery tasks. These agents typically consist of two streams: (1) an upstream phase, where they perform ideation and planning to propose novel ideas and formulate hypotheses, and (2) a downstream phase, where the proposed ideas are realized in practice through code implementation, experimental execution, and result analysis. The upstream phase naturally propagates into the downstream phase. Existing research agents often treat the upstream phase as a brief preamble, such as one or two paragraphs or simple, abstract statements. In contrast, the actual upstream process used by human researchers is considerably more complex, consisting of multiple detailed steps that are more structurally organized. Therefore, a gap exists between the simplified design in current systems and the structured processes followed by human researchers. To address this gap, we reinterpret the upstream phase through the sensemaking framework ( 13 ) , which describes how researchers structure information into explanatory frameworks, operationalized as eight structured cognitive stages (see Table 1 ). (a) Target trajectories are more diverse. (b) …without sacrificing quality. (c) …and improve downstream artifact quality. Figure 1: Overview of experimental findings. (a) Target trajectories exhibit more spread when measured using embedding similarity measures. (b) In addition to more diversity, Target trajectories display higher quality. (c) Downstream artifact evaluation: trajectories generated under stronger supervision (i.e., Target trajectories) lead to better end-to-end research artifacts, including improved implementation and paper outcomes, as compared to other baseline or distilled method variants. Building on sensemaking principles, we introduce SciSense , a sensemaking-grounded framework for scientific discovery that provides end-to-end support. Specifically, we construct SciSense -Traj, a 100K-scale dataset of sensemaking-based research trajectories conditioned on citation neighborhoods , comprising two complementary modes: Target , where an LLM reconstructs a plausible ideation trajectory leading to a known paper from its cited works, and Infer , where the LLM proposes novel research directions grounded in the same citations. Using this dataset, we distill sensemaking capabilities into SciSense -LM, a family of LLMs with various sizes from 3B to 70B. Figure 1 summarizes our central empirical findings. Contrary to the assumption that weaker constraints promote broader exploration, outcome-anchored Target supervision yields trajectories that are simultaneously more diverse and higher quality than open-ended Infer supervision across all evaluated model families and scales. Target -trained models achieve the strongest diversity under multiple automatic metrics and a 2.0% gain in aggregate plan quality over Infer —with no quality–diversity tradeoff: Target dominates Infer on both axes. Mechanistically, Target plans emphasize constructive sensemaking stages (Schema, Elaboration), while Infer plans disproportionately front-load Hypothesis and Questioning. This advantage transfers downstream: Target trajectories improve the quality of generated scientific artifacts when conditioning coding agents, with particular gains in scientific grounding and improvements in executability and downstream utility. Practitioners can use SciSense as a testbed for improving the ideation and planning capabilities of LLM-driven research agents. Our results suggest that reconstructive trajectories achieve higher quality while enabling more diverse ideation, and that such structured, strong supervision enhances the creativity of downstream coding agents—highlighting the importance of principled, structured ideation and planning. Overall, SciSense advances our understanding of how upstream planning shapes scientific discovery and provides a principled framework for developing and evaluating next-generation research agents. Figure 2: General Incorporation of Sensemaking into Scientific Research Agents. We explore the Upstream sensemaking phase of research to better emulate the trajectories of thought researchers take prior to generating paper and code artifacts in the Downstream phase. 2 SciSense Framework SciSense is the first sensemaking-based framework for automated scientific discovery that provides end-to-end support—from citation-grounded corpus construction to scalable trajectory learning and downstream evaluation—while remaining fully open-source, as shown in Table 4 . The framework operates in three stages—corpus construction, trajectory generation, and model distillation—each grounded in sensemaking principles. section 2.1 introduces the sensemaking principle; section 2.2 formalises the discovery problem; section 2.3 describes dataset construction; section 2.4 covers model training; and section 3 defines the evaluation protocol. 2.1 Preliminaries: Sensemaking Principle The sensemaking principle ( 13 ) describes how researchers iteratively construct meaning from prior work—collecting, organising, and synthesising evidence into coherent, testable, and procedurally grounded research trajectories that persuade others through empirical justification. We operationalise sensemaking as an ordered sequence of eight stages that mirror the process of a researcher turning a body of literature into a research contribution. These eight stages define a sensemaking trajectory : a structured, record of the intellectual process that transforms a citation neighbourhood into a research contribution. Foraging Retrieve prior work and gaps Shoebox Organise extracted evidence Schema Form initial problem framing Hypothesis Define testable hypotheses Elaboration Develop methodological plan Questioning Assess feasibility and novelty Reframe Revise formulation or approach Presentation Synthesize final trajectory Table 1: Sensemaking stages. 2.2 Problem Formulation for Automated Scientific Discovery in SciSense The goal of automated scientific discovery is to enable an LLM \mathcal{M} to autonomously conduct research by following a scientific pipeline \mathcal{P} , analogous to human researchers. Following prior work ( 10 ; 21 ) , this pipeline consists of four stages: ideation and planning ( \mathcal{P}_{\text{plan}} ), experimentation ( \mathcal{P}_{\text{expr}} ), analysis ( \mathcal{P}_{\text{analysis}} ), and paper writing ( \mathcal{P}_{\text{write}} ). Given contextual information \mathcal{C}=\{x_{\texttt{paper}},x_{\texttt{code}}\} , the pipeline produces outputs O:=\mathcal{P}(\mathcal{C};\mathcal{M}) , where O=\{y_{\texttt{paper}},y_{\texttt{code}}\} . The standard pipeline is formalised as: \displaystyle P=\hbox{\pagecolor{gray!20}$\mathcal{P}_{\text{plan}}(\mathcal{C})$},\quad E=\mathcal{P}_{\text{expr}}(\mathcal{C},P),\quad A=\mathcal{P}_{\text{analysis}}(\mathcal{C},P,E),\quad O=\mathcal{P}_{\text{write}}(\mathcal{C},P,E,A). The planning stage \mathcal{P}_{\text{plan}} is the critical bottleneck: shallow plans lead to incoherent or template-like downstream outputs. SciSense addresses this by replacing the shallow plan P with a sensemaking trajectory S , which encodes structured, fine-grained procedural knowledge about the research process. Let \mathcal{C}_{\text{cited}}(x_{\texttt{paper}})=\{c_{1},...,c_{N}\} denote the citation neighborhood of a target paper

Read the complete text