Alien Science: Sampling Coherent but Cognitively Unavailable Research Directions from Idea Atoms Alejandro H. Artiles, Martin Weiss, Levin Brinkmann, Anirudh Goyal, Nasim Rahaman Abstract Large language models are adept at synthesizing and recombining familiar material, yet they often fail at a specific kind of creativity that matters most in research: producing ideas that are both coherent and non-obvious to the current community. We formalize this gap through cognitive availability , the likelihood that a research direction would be naturally proposed by a typical researcher given what they have worked on. We introduce a pipeline that (i) decomposes papers into granular conceptual units, (ii) clusters recurring units into a shared vocabulary of idea atoms , and (iii) learns two complementary models: a coherence model that scores whether a set of atoms constitutes a viable direction, and an availability model that scores how likely that direction is to be generated by researchers drawn from the community. We then sample “alien” directions that score high on coherence but low on availability. On a corpus of ∼ \sim 7,500 recent LLM papers from NeurIPS, ICLR and ICML, we validate that (a) conceptual units preserve paper content under reconstruction, (b) idea atoms generalize across papers rather than memorizing paper-specific phrasing, and (c) the Alien sampler produces research directions that are more diverse than LLM baselines while maintaining coherence. 1 Introduction Scientific progress depends on ideas that are simultaneously feasible and surprising . Many ideas are feasible but unsurprising (incremental extensions); others are surprising but infeasible (incoherent combinations). Modern LLMs tend to occupy the former region: they fluently reproduce and interpolate within what they have seen, but they rarely generate research directions that the community would judge as genuinely non-obvious. This limitation is not merely anecdotal. When a model is trained to predict text drawn from the literature, the easiest way to be “right” is to stay close to the literature’s most common conceptual trajectories. Scaling alone does not solve this: even highly capable systems will inherit the bias toward familiar combinations unless explicitly designed to avoid it. Naïve LLM ideation will thus converge to high-likelihood continuations of existing patterns. We propose that “non-obviousness” can be operationalized via cognitive availability : some ideas are readily accessible to most researchers because they sit at the intersection of common background concepts; other ideas are available only to unusual combinations of expertise, reading history, or disciplinary perspective [ 11 , 2 ] . Breakthrough ideas often look like the latter [ 9 ] . Our goal is not to create randomness, but to deliberately search for coherent directions that fall in the blind spots of human scientific communities: ideas that are viable but would require an unusual confluence of expertise to surface naturally. To do so, we need a representation that makes “ideas” compositional. We therefore decompose papers into recombinable building blocks and learn a shared vocabulary of idea atoms . We then learn two complementary models: a coherence model C(\cdot) that scores whether a candidate combination of atoms forms a viable research direction, and an availability model A(\cdot) that scores how likely that combination is to be generated by researchers sampled from the community. Finally, we sample candidates that maximize coherence while minimizing availability. Contributions. (a) We introduce idea atoms , a compositional representation formed by decomposing papers into recombinable conceptual units and clustering them into a shared vocabulary of recurring building blocks that generalize across papers. (b) We formalize cognitive availability as a text-derived score capturing which ideas typical researchers would naturally propose, and pair it with a coherence model to sample directions that are viable yet fall outside common trajectories. (c) Preliminary experiments suggest this approach produces more diverse and coherent combinations than LLM baselines while exploring less-visited regions of the conceptual space. 2 Related Work Machine-assisted discovery and conceptual recombination. Prior work explores AI for hypothesis generation, literature-based discovery, and combinatorial recombination of concepts [ 5 , 1 , 6 , 12 , 13 ] . Our focus is complementary: we build a compositional representation directly from paper text using granular idea atoms, and explicitly optimize for low cognitive availability under a community distribution. Human-aware science acceleration. Recent work argues that accelerating science requires modeling what humans will and will not naturally explore [ 9 , 11 , 1 ] . Graph-based approaches can predict promising, unexplored combinations but require structured metadata and may miss implicit similarity between researchers who never directly interact [ 11 ] . We aim to capture such implicit structure directly from text-derived conceptual building blocks. 3 Method We describe (1) extracting conceptual units, (2) clustering them into atoms, (3) learning coherence and availability scores over atoms, and (4) sampling alien science. Figure 1 illustrates the overall pipeline. Figure 1: Overview of the Alien Science Sampling pipeline. Papers are distilled into conceptual units, which are clustered into a shared vocabulary of idea atoms. A coherence model learns which atom combinations form viable research directions, while an availability model estimates which combinations typical researchers would propose. Alien directions are sampled by maximizing coherence while minimizing availability. 3.1 From Papers to Conceptual Units We start from a corpus of 7,339 papers on large language models from NeurIPS, ICLR and ICML. Raw papers include redundancy (formatting, repeated citations, long experimental details). We therefore apply an LLM-based compression step to produce a high-signal “blog-post style” distillation of each paper’s core contributions. Given the distilled text, we prompt an LLM to extract conceptual units : short, self-contained statements describing a technique, insight, objective, architectural choice, or training/evaluation procedure. The key requirement is that units are recombinable : each unit should stand on its own and not depend on the paper’s narrative scaffolding. 1 1 1 All prompts used are available in the atomization repository at: https://anonymous.4open.science/r/Paper-atomyzer-82F4/config/prompts.py 3.2 Clustering Units into Idea Atoms Conceptual units repeat across papers with different wording. We embed all units and cluster them using HDBSCAN to group semantically related ideas. Each cluster is then summarized into a canonical description using an LLM, which we call an idea atom . An atom is therefore a recurring conceptual building block that appears across the literature. See Section D.1 for examples. The overall process yields (a) a vocabulary of \sim 2,500 atoms, and (b) a sparse mapping from each paper to the atoms it expresses. 3.3 Coherence Model over Atom Sets We want a score C(S) that is high when a sequence of atoms S forms a coherent research direction. A simple and effective approach is to learn a generative model over atom sequences derived from papers. We linearize each paper’s atoms in the order induced by the distilled summary (or by the order the units appear), then train an autoregressive model (GPT2) to predict the next atom [ 7 ] , treating each atom as a discrete token in the vocabulary. The coherence score can be defined as normalized log-likelihood: C(S)\;=\;\frac{1}{|S|}\sum_{t=1}^{|S|}\log p(\text{atom}_{t}\mid\text{atom}_{