ViviDoc : Generating Interactive Documents through Human-Agent Collaboration DOI: XXXXXXX.XXXXXXX Conference: ACM Conference; 2026; XXX, XXX ISBN: 978-1-4503-XXXX-X/2026/03 CCS: Human-centered computing Human computer interaction (HCI) CCS: Computing methodologies Artificial intelligence

Yinghao Tang, Yupeng Xie, Yingchaojie Feng, Tingfeng Lan, Jiale Lao, Yue Cheng, Wei Chen · 2026

Read ViviDoc : Generating Interactive Documents through Human-Agent Collaboration DOI: XXXXXXX.XXXXXXX Conference: ACM Conference; 2026; XXX, XXX ISBN: 978-1-4503-XXXX-X/2026/03 CCS: Human-centered computing Human computer interaction (HCI) CCS: Computing methodologies Artificial intelligence by Yinghao Tang, Yupeng Xie, Yingchaojie Feng, Tingfeng Lan, Jiale Lao, Yue Cheng, Wei Chen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-27991.txt.

Introduction

Tang and six co-authors present ViviDoc, a system that builds interactive documents with help from AI agents. A four-agent pipeline plans, styles, writes, and checks each document. Users steer the work through a structured spec, a style palette, and plain chat edits. The team also built ViviBench, a test set of 101 topics from real documents across 11 domains. In tests and a 12-person user study, ViviDoc gave the richest, most controllable output.

Catalog record

CREATORYinghao Tang, Yupeng Xie, Yingchaojie Feng, Tingfeng Lan, Jiale Lao, Yue Cheng, Wei Chen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46996
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.27991

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

ViviDoc : Generating Interactive Documents through Human-Agent Collaboration DOI: XXXXXXX.XXXXXXX Conference: ACM Conference; 2026; XXX, XXX ISBN: 978-1-4503-XXXX-X/2026/03 CCS: Human-centered computing Human computer interaction (HCI) CCS: Computing methodologies Artificial intelligence Yinghao Tang, Yupeng Xie, Yingchaojie Feng, Tingfeng Lan, Jiale Lao, Yue Cheng, Wei Chen Abstract . Interactive documents help readers engage with complex ideas through dynamic visualization, interactive animations, and exploratory interfaces. However, creating such documents remains costly, as it requires both domain expertise and web development skills. Recent Large Language Model (LLM)-based agents can automate content creation, but directly applying them to interactive document generation often produces outputs that are difficult to control. To address this, we present ViviDoc , to the best of our knowledge the first work to systematically address interactive document generation. ViviDoc introduces a multi-agent pipeline (Planner, Styler, Executor, Evaluator). To make the generation process controllable, we provide three levels of human control: (1) the Document Specification (DocSpec) with SRTC Interaction Specifications (State, Render, Transition, Constraint) for structured planning, (2) a content-aware Style Palette for customizing writing and interaction styles, and (3) chat-based editing for iterative refinement. We also construct ViviBench , a benchmark of 101 topics derived from real-world interactive documents across 11 domains, along with a taxonomy of 8 interaction types and a 4-dimensional automated evaluation framework validated against human ratings (Pearson r > 0.84 r>0.84 ). Experiments show that ViviDoc achieves the highest content richness and interaction quality in both automated and human evaluation. A 12-person user study confirms that the system is easy to use, provides effective control over the generation process, and produces documents that satisfy users. Our project homepage is available at https://vividoc-homepage.vercel.app/ . 1. Introduction Figure 1. Eight interactive visualization examples generated by ViviDoc , covering all 8 interaction types in our taxonomy, with styles automatically adapted to each topic’s content. (a) Parameter Exploration : sliders adjust flow rate and elevation parameters in real time. (b) Direct Manipulation : drag the object or focal points to update the lens equation live. (c) Inspection : hover to reveal a Voronoi cell and nearest-neighbor envelope. (d) Freeform Construction : click to place neurons and trigger animated signal propagation. (e) Scroll-driven Narrative : scroll to mix two particle gases and watch entropy rise. (f) Spatial Navigation : drag to rotate a 3D Möbius strip freely in space. (g) State Switching : switch quantum orbital states to redraw the electron probability cloud. (h) Temporal Control : play/pause and tune harmonics to build a Fourier series. Interactive documents are an emerging communication medium that leverages the dynamic capabilities of the web to help readers engage with complex ideas ( 20 ) . Through interactive elements such as sliders, dropdowns, and direct manipulation controls, readers can actively explore concepts, observe cause-and-effect relationships, and build intuition through experimentation. This form of communication has been adopted across diverse domains including education ( 5 ) , data-driven journalism ( 3 ) , and scientific publishing ( 8 ) . Studies show that interactive documents improve reader engagement and learning compared to static alternatives ( 8 ) . Despite their promise, creating interactive documents remains prohibitively costly. Producing a single piece, such as those on Explorable Explanations ( 7 ) or Distill.pub ( 8 ) , requires expertise in both domain knowledge and web development, often demanding days or weeks of effort per article. This bottleneck severely limits the production of high-quality interactive content. In this paper, we aim to address this by leveraging the reasoning and code generation capabilities of LLM-based agents. To the best of our knowledge, this is the first work to systematically address interactive document generation. Although end-to-end LLM-based agents have achieved promising results in content creation tasks such as video generation ( 4 ) , slide design ( 28 ; 11 ) , and infographic production ( 17 ) , naively applying them to interactive documents generation faces three key limitations. First, the generation process is largely uncontrollable : there is a fundamental gap between authoring intent and the executable code that realizes it, and the agent resolves this gap based on its own implicit preferences. Second, humans cannot effectively participate in the process: the agent operates as a black box , leaving educators no meaningful way to review or adjust intermediate decisions that shape the final output. Third, evaluation resources are scarce : no grounded dataset or systematic evaluation framework exists for this task, making it difficult to compare approaches. To address these limitations, we present ViviDoc , a human-agent collaborative system for generating interactive documents. ViviDoc is built on a multi-agent pipeline consisting of a Planner, Styler, Executor, and Evaluator. To make the generation process controllable and transparent, we provide three levels of human control: (1) The Document Specification (DocSpec), a structured intermediate representation that organizes a document into knowledge units, each containing a text description for content generation and an Interaction Specification for visualization generation. The Interaction Specification uses a four-component decomposition of State, Render, Transition, and Constraint (SRTC), inspired by interactive visualization theory ( 13 ) . SRTC can express all common interaction types found in real-world educational documents. Educators can review, modify, and refine both the content plan and the interaction design before any code is produced. (2) A Style Palette, where the LLM analyzes the spec content and generates style options for users to customize the writing and interaction style of the document. (3) Chat-based editing, which allows users to refine both the spec and the generated document through natural language conversation. To enable systematic evaluation, we construct ViviBench , a benchmark grounded in 101 real-world interactive documents collected from over 60 websites across 11 domains. We reverse-engineer teaching topics from these documents, ensuring that evaluation is grounded in topics for which high-quality interactive content already exists. From 482 interaction instances in these documents, we derive a taxonomy of 8 interaction types (e.g., Parameter Exploration, State Switching, Direct Manipulation). We also design a 4-dimensional automated evaluation framework combining rule-based checks (Interaction Functionality, Efficiency) with LLM-as-Judge assessment (Content Richness, Interaction Quality), and validate its reliability through human evaluation alignment (Pearson r>0.84 ). We evaluate ViviDoc through both automated evaluation and human evaluation with 12 raters. Results show that ViviDoc achieves the highest content richness and interaction quality among all methods. A 12-person user study further confirms that the system is easy to use (5.0/5), that DocSpec, Style Palette, and chat editing provide effective control (all rated above 4.0/5), and that participants are satisfied with the generated documents (4.58/5). We summarize our contributions as follows: • We introduce the task of interactive document generation and identify three key challenges of naively applying LLM-based agents to this task: uncontrollability, absence of human participation, and lack of evaluation resources. • We propose ViviDoc , a multi-agent system that provides three levels of human control: the Document Specification (DocSpec) with SRTC Interaction Specifications for structured planning, a content-aware Style Palette for style customization, and chat-based editing for iterative refinement, making the generation process controllable and transparent. • We construct ViviBench , a benchmark grounded in 101 real-world interactive documents from over 60 websites across 11 domains. We derive a taxonomy of 8 interaction types from 482 interaction instances and design an automated

Read the complete text