Eliot: Interactively E xploring Fast-Changing Scientific Li terature Trends with O nline Da t a and Learning CCS: Computing methodologies CCS: Information systems Users and interactive retrieval CCS: Information systems Retrieval tasks and goals CCS: Human-centered computing

Bernardo A. Denkvitts, Nitin Gupta, Biplav Srivastava · 2026

Read Eliot: Interactively E xploring Fast-Changing Scientific Li terature Trends with O nline Da t a and Learning CCS: Computing methodologies CCS: Information systems Users and interactive retrieval CCS: Information systems Retrieval tasks and goals CCS: Human-centered computing by Bernardo A. Denkvitts, Nitin Gupta, Biplav Srivastava (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-27610.txt.

Introduction

Bernardo Denkvitts, Nitin Gupta, and Biplav Srivastava present Eliot, an interactive system for traceable exploration of fast-changing scientific literature. Given query terms and filters, it pulls arXiv papers, groups them into themes with keywords, and charts each group's year-by-year spread. Group labels rated meaningful in 85 percent of scenario answers, and the system proves most useful for checkable overviews of fast-changing areas.

Catalog record

CREATORBernardo A. Denkvitts, Nitin Gupta, Biplav Srivastava
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39889
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.27610

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Eliot: Interactively E xploring Fast-Changing Scientific Li terature Trends with O nline Da t a and Learning CCS: Computing methodologies CCS: Information systems Users and interactive retrieval CCS: Information systems Retrieval tasks and goals CCS: Human-centered computing Bernardo A. Denkvitts, Nitin Gupta, Biplav Srivastava Abstract . The rapid growth of scientific publishing has made it increasingly difficult to track how fast-moving areas evolve. Search engines and LLM-based assistants retrieve or summarize papers, but often hide how the corpus was selected, organized, or connected to temporal patterns. We present Eliot , a publicly deployed interactive system for traceable exploration of evolving scientific literature. Motivated by two studies on Large Language Models (LLMs) and Automated Planning and Scheduling (APS), Eliot generalizes literature-evolution analysis beyond hand-built taxonomies and domain-specific scripts. Given explicit query terms and filters, it retrieves arXiv papers at query time, represents each paper by title and abstract, clusters the corpus into themes, assigns representative keywords, and visualizes each cluster’s publication-year distribution. We evaluate Eliot as both an applied system and an interactive research aid. An offline configuration study across eight arXiv domains compares document representations, dimensionality reduction methods, and clustering algorithms using intrinsic clustering and topic-coherence metrics; the results support MiniLM embeddings with 10-dimensional UMAP and Agglomerative Clustering as a practical default. A scenario-based survey and expert focus group assess interpretability and use contexts: participants rated cluster labels as meaningful in 85% of scenario responses, and feedback indicated that Eliot is most valuable for auditable overviews of rapidly changing technical areas. These results suggest that query-time clustering and temporal inspection can complement search and generation tools by helping researchers inspect and refine the evidence behind literature trends. 1. Introduction Figure 1. The Eliot user interface, shown across four screenshots of a single scrollable application. (1) The search panel with default run configurations. (2) Auto-detected cluster overview, showing representative keywords for 8 of 14 discovered clusters (the full set is accessible via ‘Show All’). (3) Temporal interactive scatter plot showing the evolution of research topics over time across clusters. (4) Paginated paper list with per-cluster tabs. Additional papers are not shown due to space. Scientific publishing is growing quickly, making it difficult to track fast-changing areas 29 ; 15 . Researchers must find relevant papers, understand how they separate into themes, identify emerging directions, and verify which documents support an apparent temporal pattern 27 ; 44 . Recent literature assistants make search more interactive 36 ; 5 , but ranked lists and generated syntheses can hide retrieval, selection, and organization decisions. Literature evolution analysis therefore needs an inspectable workflow in which users can see the corpus, themes, labels, temporal patterns, and source papers. We present Eliot , an interactive system for exploring evolving scientific literature from online data. 1 1 1 Here, online data means that the corpus is retrieved at query time from arXiv rather than drawn from a fixed benchmark dataset, and trends refers to inspectable temporal patterns in that retrieved corpus rather than fully automated trend discovery. Given keywords, category filters, date ranges, and sorting criteria, Eliot retrieves papers from arXiv at query time, clusters them, labels clusters with representative keywords, and visualizes temporal distributions. The public Streamlit prototype 2 2 2 https://ai4society-paper-searcher.streamlit.app emphasizes traceability: users can revise the query, inspect cluster memberships, compare labels, and open source records rather than relying only on an opaque summary. Eliot is motivated by two ICAPS studies on LLMs in Automated Planning and Scheduling (APS), or LLM-planning . 28 manually reviewed 126 papers into eight categories, including plan generation, language translation, model construction, tool integration, and interactive planning. 27 then added a semi-automated arXiv pipeline for fetching, deduplication, classification, and trend analysis. With 47 new papers, it reported category drift: six categories declined in relative share, two increased, and goal decomposition and replanning emerged. These studies showed that category-level literature evolution is useful, but the workflow required a fixed taxonomy, domain-specific scripts, supervised labels, expert review, and post-hoc temporal analysis. Eliot generalizes this workflow from one expert-maintained domain to arbitrary arXiv-supported topics. Rather than classifying papers into prebuilt categories, it performs unsupervised, query-time grouping over the retrieved corpus, labels the discovered clusters, and exposes the source evidence behind each trend. This shift motivates our evaluation of semantic representations and clustering configurations beyond the TF-IDF supervised setting used in the LLM-planning update. Our evaluation is organized around three empirical questions: (RQ1) Which automated configuration should Eliot use by default? We ask which combination of document representation, dimensionality reduction, and clustering provides robust structure across diverse arXiv domains. (RQ2) Do users find the generated clusters interpretable and useful? We ask whether users perceive the cluster labels, groupings, and interaction flow as meaningful for literature exploration. (RQ3) When do users expect Eliot to be most useful, and what limitations matter? We ask which research contexts benefit from traceable cluster-and-time views, and where users need additional guidance when interpreting changing corpora. Thus, our contributions are: • A public interactive system for literature evolution exploration that combines query-time arXiv retrieval, clustering, keyword labeling, temporal visualization, and document-level inspection. • A traceable workflow that exposes query settings, retrieved papers, cluster assignments, and source links, supporting auditability in exploratory literature analysis. • An automated offline configuration evaluation across eight arXiv domains, complemented by a scenario-based user survey and expert focus group. 2. Related Work Figure 2. System pipeline overview. (1) The tool supports multiple keywords, both single-word and multi-word expressions. (2, 2a) After receiving user keywords, the system retrieves papers from arXiv. (3) It performs clustering and (4) keyword extraction. (5) The UI displays cluster keywords, cluster tabs, and a temporal visualization to support structured exploration. This section situates Eliot within four lines of work: LLM-planning literature analysis, scientific text clustering, AI-assisted search and synthesis, and literature discovery systems. 2.1. LLMs in Planning as a Motivating Case The LLM-planning literature illustrates why fast-changing fields need traceable evolution tools. 28 manually reviewed 126 papers and proposed an eight-category taxonomy covering language translation, plan generation, model construction, multi-agent planning, interactive planning, heuristics optimization, tool integration, and brain-inspired planning. The survey connected category-level volume to challenges such as executable plan generation, grounding language in planning representations, coordinating agents, and integrating LLMs with verifiers, planners, or other tools. 27 revisited the area with a semi-automated arXiv pipeline for extraction, deduplication, categorization, and supervised classification experiments. The study added 47 papers, reported drift across the original taxonomy, and surfaced goal decomposition and replanning as emerging categories. Its strongest result was human-augmented, showing that automation can scale updates but still needs inspectable evidence and expert judgment. Eliot starts from this lesson but changes the task. The ICAPS workflow assumed a known domain, fixed taxonomy, labeled examples, and bespoke scripts. Eliot supports earlier-stage exploration: it retrieves a fresh corpus from explicit query settings, clusters documents without supervised labels, produces representative keywords, and connects temporal patterns back to individual papers. The LLM-planning case is therefore a motivating precursor rather than a directly comparable baseline. 2.2. Scientific Text Clustering The rapid growth of scientific publications has motivated unsupervised methods for organizing academic texts. 29 compare TF, TF-IDF 30 , and binary weighting with K-Means 22 , finding that TF-IDF performs best under their keyword-overlap connection coefficient and

Read the complete text